00000100:00100000:2.0F:1788837913.224390:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:83332:x1875729134933760:12345-0@lo:1000:osp_up1-0.0 Request processed in 13987us (20113us total) trans 77309411433 rc 0/0 00000100:00100000:2.0:1788837913.224412:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000004:00080000:3.0F:1788837913.225454:0:83332:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 77309411433 committed transno 77309411433 00000100:00100000:3.0:1788837913.225479:0:83332:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411433 gen 2 00000100:00100000:3.0:1788837913.225501:0:83332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:83332:1875729134933760:0@lo:1000:osp_up1-0.0 00000400:00080000:3.0:1788837913.300515:0:83747:0:(debug.c:456:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1788837913.83349 00010000:02000000:2.0:1788837913.306095:0:83349:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:06, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:3.0:1788837913.330277:0:83349:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f51879ffe10 00100000:10000000:3.0:1788837913.330299:0:83349:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1788837913.331623:0:83337:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:2.0:1788837913.331683:0:83337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83337:1875729134933888:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788837913.331777:0:83337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1788837913.331850:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134933888 00000100:00100000:2.0:1788837913.331865:0:83337:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a000 going to sleep for 20 seconds 00000100:00100000:1.0:1788837913.331867:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134933888 00000004:00080000:0.0F:1788837913.331975:0:83335:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1788837913.332004:0:83335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83335:1875729134934016:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788837913.332038:0:83335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837913.332100:0:83335:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505b6db40 going to sleep for 20 seconds 00000100:00100000:1.0:1788837913.339238:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134934016 00000100:00100000:1.0:1788837913.339261:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134934016 00000100:00100000:1.0:1788837913.339413:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5904 00000100:00100000:1.0:1788837913.339426:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:83337:x1875729134933888:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:1.0:1788837913.339435:0:26210:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1788837913.339482:0:26210:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -31 00002000:02000040:1.0:1788837913.339487:0:26210:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:705) 00000100:00100000:3.0:1788837913.340718:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5905 00000100:00100000:3.0:1788837913.340746:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:83335:x1875729134934016:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:3.0:1788837913.340756:0:26214:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1788837913.340787:0:26214:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -529 00002000:02000040:3.0:1788837913.340792:0:26214:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:705) 00002000:00010000:1.0:1788837913.350728:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.350751:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccc7a5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.350776:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c1:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.350782:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.350789:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccc7a5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.350897:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccc7a5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.350916:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccc7a5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.350923:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccc7a5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.350952:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788837913.351124:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.351146:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccc7a63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351155:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c0:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.351158:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.351162:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccc7a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351172:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccc7a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351180:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccc7a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351187:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccc7a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351210:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788837913.351223:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837913.351230:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccc7a5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351238:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c6400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.351244:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccc7a5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351254:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccc7a5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351282:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccc7a5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351289:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccc7a5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351315:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.351318:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccc7a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351325:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c6a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.351328:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccc7a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351336:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccc7a63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351346:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccc7a63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351352:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccc7a63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351362:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.351364:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.351371:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.351422:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.351428:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccc7a6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351436:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bf:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.351439:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.351444:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccc7a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351453:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccc7a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351473:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccc7a6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351480:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccc7a6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351495:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.351503:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.351506:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccc7a6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351513:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c7400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.351516:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccc7a6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351534:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccc7a6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351546:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccc7a6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351553:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccc7a6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351567:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.351568:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.351581:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.351634:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.351640:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061af10e8/0x88da08396ccc7a71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351647:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2be:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.351650:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.351654:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061af10e8/0x88da08396ccc7a71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351662:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061af10e8/0x88da08396ccc7a71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351670:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061af10e8/0x88da08396ccc7a71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351681:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061af10e8/0x88da08396ccc7a71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351703:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788837913.351744:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.351749:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccc7a78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351757:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bd:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.351760:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.351764:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccc7a78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351773:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccc7a78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351781:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccc7a78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351788:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccc7a78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351836:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788837913.351860:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837913.351865:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061af10e8/0x88da08396ccc7a71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351878:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.351882:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061af10e8/0x88da08396ccc7a71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351889:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061af10e8/0x88da08396ccc7a71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351903:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061af10e8/0x88da08396ccc7a71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351911:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061af10e8/0x88da08396ccc7a71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351925:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.351928:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccc7a78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351934:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.351937:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccc7a78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351944:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccc7a78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351952:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccc7a78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351964:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccc7a78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.351976:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.351978:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.351980:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.352024:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.352029:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000694b57a5/0x88da08396ccc7a7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352037:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bc:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.352040:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.352044:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000694b57a5/0x88da08396ccc7a7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352052:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000694b57a5/0x88da08396ccc7a7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352060:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000694b57a5/0x88da08396ccc7a7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352067:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000694b57a5/0x88da08396ccc7a7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352079:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.352092:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.352095:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000694b57a5/0x88da08396ccc7a7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352101:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.352105:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000694b57a5/0x88da08396ccc7a7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352112:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000694b57a5/0x88da08396ccc7a7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352122:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000694b57a5/0x88da08396ccc7a7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352128:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000694b57a5/0x88da08396ccc7a7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352141:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.352143:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.352144:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.352185:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.352190:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412319cc/0x88da08396ccc7a86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352198:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bb:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.352201:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.352204:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000412319cc/0x88da08396ccc7a86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352224:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000412319cc/0x88da08396ccc7a86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352232:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412319cc/0x88da08396ccc7a86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352238:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000412319cc/0x88da08396ccc7a86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352250:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.352257:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.352260:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000412319cc/0x88da08396ccc7a86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352266:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.352269:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000412319cc/0x88da08396ccc7a86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352282:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000412319cc/0x88da08396ccc7a86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352294:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000412319cc/0x88da08396ccc7a86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352300:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000412319cc/0x88da08396ccc7a86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352320:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.352321:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.352323:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.352365:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.352370:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c72c01a9/0x88da08396ccc7a8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352377:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ba:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.352380:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.352384:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c72c01a9/0x88da08396ccc7a8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352392:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c72c01a9/0x88da08396ccc7a8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352399:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c72c01a9/0x88da08396ccc7a8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352406:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c72c01a9/0x88da08396ccc7a8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352418:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.352424:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.352427:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c72c01a9/0x88da08396ccc7a8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352445:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.352449:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c72c01a9/0x88da08396ccc7a8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352457:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c72c01a9/0x88da08396ccc7a8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352468:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c72c01a9/0x88da08396ccc7a8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352474:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c72c01a9/0x88da08396ccc7a8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352487:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.352488:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.352490:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.352533:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.352538:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064ad4481/0x88da08396ccc7a94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352546:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b9:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.352549:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.352553:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064ad4481/0x88da08396ccc7a94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352561:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064ad4481/0x88da08396ccc7a94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352587:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064ad4481/0x88da08396ccc7a94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352594:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064ad4481/0x88da08396ccc7a94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352606:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.352613:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.352617:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064ad4481/0x88da08396ccc7a94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352623:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.352627:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064ad4481/0x88da08396ccc7a94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352634:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064ad4481/0x88da08396ccc7a94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352645:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064ad4481/0x88da08396ccc7a94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352652:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064ad4481/0x88da08396ccc7a94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352665:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.352671:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.352673:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.352714:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.352719:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046305a5d/0x88da08396ccc7a9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352727:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b8:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.352730:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.352734:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046305a5d/0x88da08396ccc7a9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352742:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046305a5d/0x88da08396ccc7a9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352748:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046305a5d/0x88da08396ccc7a9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352755:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046305a5d/0x88da08396ccc7a9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352767:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.352773:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.352777:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046305a5d/0x88da08396ccc7a9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352784:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.352787:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046305a5d/0x88da08396ccc7a9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352834:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046305a5d/0x88da08396ccc7a9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352845:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046305a5d/0x88da08396ccc7a9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352851:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046305a5d/0x88da08396ccc7a9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352864:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.352866:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.352867:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.352914:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.352919:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccc7aa2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352927:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b7:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.352930:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.352934:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccc7aa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352942:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccc7aa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352949:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccc7aa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352961:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccc7aa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352973:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.352980:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.352983:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccc7aa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.352990:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.352993:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccc7aa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353000:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccc7aa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353011:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccc7aa2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353018:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccc7aa2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353031:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353032:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353034:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.353079:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.353089:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a489cc1/0x88da08396ccc7aa9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353098:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b6:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.353101:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.353105:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a489cc1/0x88da08396ccc7aa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353115:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a489cc1/0x88da08396ccc7aa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353123:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a489cc1/0x88da08396ccc7aa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353131:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a489cc1/0x88da08396ccc7aa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353143:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.353149:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.353152:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a489cc1/0x88da08396ccc7aa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353159:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.353163:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a489cc1/0x88da08396ccc7aa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353170:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a489cc1/0x88da08396ccc7aa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353187:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a489cc1/0x88da08396ccc7aa9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353194:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a489cc1/0x88da08396ccc7aa9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353209:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353210:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353212:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.353254:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.353259:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004937d25b/0x88da08396ccc7ab0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353266:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b5:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.353269:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.353273:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004937d25b/0x88da08396ccc7ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353281:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004937d25b/0x88da08396ccc7ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353288:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004937d25b/0x88da08396ccc7ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353295:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004937d25b/0x88da08396ccc7ab0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353319:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.353326:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.353330:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004937d25b/0x88da08396ccc7ab0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353337:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.353341:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004937d25b/0x88da08396ccc7ab0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353350:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004937d25b/0x88da08396ccc7ab0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353363:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004937d25b/0x88da08396ccc7ab0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353370:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004937d25b/0x88da08396ccc7ab0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353383:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353385:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353387:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.353425:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.353430:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e075acf4/0x88da08396ccc7ab7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353438:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b4:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.353447:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.353451:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e075acf4/0x88da08396ccc7ab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353462:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e075acf4/0x88da08396ccc7ab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353469:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e075acf4/0x88da08396ccc7ab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353476:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e075acf4/0x88da08396ccc7ab7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353488:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.353495:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.353499:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e075acf4/0x88da08396ccc7ab7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353505:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.353508:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e075acf4/0x88da08396ccc7ab7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353516:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e075acf4/0x88da08396ccc7ab7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353527:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e075acf4/0x88da08396ccc7ab7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353545:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e075acf4/0x88da08396ccc7ab7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353559:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353561:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353563:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.353618:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.353623:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccc7abe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353631:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b3:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.353634:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.353637:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccc7abe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353646:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccc7abe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353652:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccc7abe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353659:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccc7abe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353671:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.353683:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.353686:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccc7abe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353694:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.353697:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccc7abe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353704:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccc7abe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353716:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccc7abe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353723:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccc7abe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353738:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353740:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353741:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.353781:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.353786:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccc7ac5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353793:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b2:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.353821:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.353826:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccc7ac5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353845:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccc7ac5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353852:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccc7ac5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353859:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccc7ac5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353871:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.353877:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.353880:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccc7ac5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353886:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.353889:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccc7ac5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353896:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccc7ac5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353906:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccc7ac5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353913:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccc7ac5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353931:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353932:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.353934:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.353978:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.353983:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccc7acc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.353990:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b1:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.353993:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.353997:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccc7acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354006:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccc7acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354013:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccc7acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354019:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccc7acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354031:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.354037:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.354040:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccc7acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354057:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.354060:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccc7acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354067:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccc7acc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354077:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccc7acc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354083:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccc7acc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354094:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.354096:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.354097:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.354137:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.354142:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccc7ad3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354150:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b0:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.354152:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.354156:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccc7ad3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354165:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccc7ad3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354179:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccc7ad3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354186:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccc7ad3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354198:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.354205:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.354208:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccc7ad3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354214:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.354217:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccc7ad3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354225:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccc7ad3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354235:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccc7ad3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354241:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccc7ad3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354253:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.354260:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.354262:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.354305:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.354311:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccc7ada lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354319:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2af:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.354323:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.354327:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccc7ada lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354337:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccc7ada lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354346:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccc7ada lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354354:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccc7ada lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354366:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.354371:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.354375:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccc7ada lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354382:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.354385:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccc7ada lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354404:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccc7ada lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354416:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccc7ada lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354424:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccc7ada lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354437:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.354439:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.354441:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837913.354483:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.354488:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ae1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354496:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ae:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.354499:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837913.354503:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354511:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354518:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354532:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ae1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354543:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.354550:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.354554:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ae1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.354560:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.354563:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ae1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.357351:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.357391:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837913.363700:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.363714:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc7ae8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.363735:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ad:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.363740:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.363747:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc7ae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.363763:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc7ae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.363776:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc7ae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.363785:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc7ae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.363827:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837913.363900:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.363906:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc7aef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.363915:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ac:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.363935:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.363939:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc7aef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.363948:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc7aef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.363956:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc7aef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.363962:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc7aef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.363977:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788837913.364647:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837913.364657:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc7ae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.364669:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.364673:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc7ae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.364685:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc7ae8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.364706:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc7ae8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.364714:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc7ae8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.364734:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837913.364746:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc7aef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.364752:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.364755:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc7aef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.364762:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc7aef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.364772:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc7aef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.364780:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.364782:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.364784:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.364967:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ae1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.365007:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.365018:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc7af6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365030:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c1:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.365035:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.365040:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc7af6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365120:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc7af6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365131:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc7af6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365136:0:26210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc7aef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365141:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc7af6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365169:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837913.365242:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.365248:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc7afd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365258:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ab:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.365261:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.365265:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc7afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365274:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc7afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365288:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc7afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365295:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc7afd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365308:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788837913.365349:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.365355:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc7b04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365363:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2aa:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.365366:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.365370:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc7b04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365379:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc7b04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365386:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc7b04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365392:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc7b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.365411:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788837913.365451:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.365456:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc7b0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.365591:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.365598:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc7b12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365608:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c0:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.365611:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.365615:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc7b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365625:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc7b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365633:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc7b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365640:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc7b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365649:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788837913.365691:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.365696:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc7b19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365703:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bf:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.365714:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.365718:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc7b19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365727:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc7b19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365735:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc7b19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365742:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc7b19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.365751:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788837913.365897:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788837913.365905:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc7af6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.365913:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.365918:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc7af6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.365925:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc7af6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.365955:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc7af6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.365963:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc7af6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.365997:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788837913.366001:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc7afd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366007:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.366010:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc7afd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366017:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc7afd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366027:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc7afd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366033:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc7afd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366045:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837913.366048:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc7b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366060:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.366064:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc7b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366071:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc7b04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366081:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc7b04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366088:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc7b04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366101:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837913.366104:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc7b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366110:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.366113:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc7b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366121:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc7b12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366129:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc7b12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366142:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc7b12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366154:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837913.366157:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc7b19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366162:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.366165:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc7b19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366172:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc7b19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366181:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc7b19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366186:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc7b19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.366196:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.366198:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.366199:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.366205:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.366271:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a9:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.366274:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.366278:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc7b0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366287:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc7b0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366296:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc7b0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366303:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc7b0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366324:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837913.366548:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.366556:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc7b27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366565:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a8:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.366584:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.366588:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc7b27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366597:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc7b27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366606:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc7b27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366614:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc7b27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366625:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788837913.366668:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.366672:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a6ca11/0x88da08396ccc7b2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366679:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a7:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.366683:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.366687:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a6ca11/0x88da08396ccc7b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366696:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6a6ca11/0x88da08396ccc7b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366704:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a6ca11/0x88da08396ccc7b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366716:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a6ca11/0x88da08396ccc7b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366724:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788837913.366762:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.366767:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035b6c419/0x88da08396ccc7b35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366775:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a6:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.366778:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.366782:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035b6c419/0x88da08396ccc7b35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366791:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035b6c419/0x88da08396ccc7b35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366822:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035b6c419/0x88da08396ccc7b35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366830:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035b6c419/0x88da08396ccc7b35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366838:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788837913.366873:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.366878:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000152776e1/0x88da08396ccc7b3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366891:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a5:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.366894:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.366899:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000152776e1/0x88da08396ccc7b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366907:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000152776e1/0x88da08396ccc7b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366916:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000152776e1/0x88da08396ccc7b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.366925:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ae1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366926:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000152776e1/0x88da08396ccc7b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.366949:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ae1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.366952:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788837913.366981:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788837913.366986:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc7b0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.367004:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460000 already unused, calling callback (ffffffffc0dd5350) 00002000:00010000:0.0:1788837913.367007:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.367009:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc7b0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367015:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc7b43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.367023:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc7b0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367028:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a4:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.367036:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.367042:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc7b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.367045:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc7b0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367060:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc7b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.367061:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc7b0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.367089:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788837913.367094:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc7b27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367096:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc7b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.367109:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837913.367112:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc7b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.367115:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc7b27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367130:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788837913.367133:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc7b27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.367145:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc7b27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.367158:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc7b27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837913.367173:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.367174:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788837913.367180:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6a6ca11/0x88da08396ccc7b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367183:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018353291/0x88da08396ccc7b4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367191:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a3:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.367194:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.367198:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018353291/0x88da08396ccc7b4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367208:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018353291/0x88da08396ccc7b4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367216:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018353291/0x88da08396ccc7b4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367224:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018353291/0x88da08396ccc7b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367245:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788837913.367420:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788837913.367431:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035b6c419/0x88da08396ccc7b35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.367439:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.367443:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035b6c419/0x88da08396ccc7b35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.367451:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035b6c419/0x88da08396ccc7b35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.367664:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00080000:0.0:1788837913.367669:0:26210:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00010000:00010000:3.0:1788837913.367675:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc7b20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367685:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2be:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.367689:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.367693:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc7b20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367703:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc7b20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367711:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc7b20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367724:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc7b20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367733:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788837913.367765:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:83337:x1875729134933888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 28339us (35984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.367775:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5904 00002000:00010000:3.0:1788837913.367788:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.367794:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc7b51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367817:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bd:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.367820:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.367824:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc7b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367833:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc7b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367840:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc7b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367847:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc7b51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367856:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788837913.367859:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788837913.367865:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000152776e1/0x88da08396ccc7b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367874:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837913.367877:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000152776e1/0x88da08396ccc7b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367884:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000152776e1/0x88da08396ccc7b3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.367893:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.367898:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000152776e1/0x88da08396ccc7b3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367900:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc7b58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367907:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000152776e1/0x88da08396ccc7b3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367928:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bc:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.367932:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.367937:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc7b58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367938:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788837913.367944:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc7b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367955:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc7b58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367972:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc7b58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.367975:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788837913.367982:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc7b58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.367991:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788837913.368030:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.368035:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc7b5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368042:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bb:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.368045:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.368061:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc7b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368070:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc7b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368089:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc7b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368096:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc7b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368103:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788837913.368140:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035b6c419/0x88da08396ccc7b35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.368143:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837913.368154:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035b6c419/0x88da08396ccc7b35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368155:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc7b66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368174:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ba:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.368177:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.368181:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc7b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368181:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788837913.368189:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018353291/0x88da08396ccc7b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368197:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.368200:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018353291/0x88da08396ccc7b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368207:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018353291/0x88da08396ccc7b4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368228:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018353291/0x88da08396ccc7b4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368235:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018353291/0x88da08396ccc7b4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368247:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788837913.368250:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc7b20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368257:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.368260:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc7b20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368269:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc7b20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368279:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc7b20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368302:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc7b20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.368302:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.368309:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a6ca11/0x88da08396ccc7b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.368320:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a6ca11/0x88da08396ccc7b2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368323:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837913.368330:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc7b51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.368337:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6a6ca11/0x88da08396ccc7b2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368359:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.368360:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6a6ca11/0x88da08396ccc7b2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368362:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc7b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368367:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc7b51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368390:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc7b51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.368392:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788837913.368400:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc7b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368405:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc7b51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368413:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc7b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368418:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc7b51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368438:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837913.368440:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837913.368443:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc7b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368452:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.368455:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc7b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.368535:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc7b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.368544:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc7b43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.368554:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.368555:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc7b43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368562:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc7b6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.368565:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc7b43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368592:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b9:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.368595:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.368598:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837913.368600:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc7b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.368604:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc7b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.368611:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc7b58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368620:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc7b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.368628:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837913.368634:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc7b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.368637:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788837913.368642:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc7b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.368647:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc7b66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.368650:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc7b58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368661:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc7b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.368678:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc7b58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.368679:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc7b66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368682:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837913.368700:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc7b58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.368701:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc7b66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.368724:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837913.368725:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc7b58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368735:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc7b74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.368735:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837913.368742:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc7b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368748:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b8:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:1.0:1788837913.368749:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.368753:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.368754:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.368760:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc7b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.368761:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.368762:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.368772:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc7b74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.368776:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc7b6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.368792:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc7b74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368852:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc7b5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368863:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc7b5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368877:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc7b5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.368892:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.368893:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.368895:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.368903:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837913.368947:0:83337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83337:1875729134933888:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788837913.368963:0:83337:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2c1:0x0] from OST, last_created [0x2c0000401:0x2c1:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:2.0:1788837913.369178:0:83337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83337:1875729134934272:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788837913.369232:0:83337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837913.369268:0:83337:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a000 going to sleep for 20 seconds 00000100:00100000:2.0:1788837913.369288:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837913.369300:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134934144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837913.369326:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837913.369363:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134934272 00010000:00010000:3.0:1788837913.369364:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc7b74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369375:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc7b74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837913.369375:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134934272 00010000:00010000:3.0:1788837913.369401:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788837913.369459:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.369465:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc7b7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369474:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b7:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.369477:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.369481:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc7b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369490:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc7b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369498:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc7b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369513:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc7b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369528:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788837913.369563:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5906 00000100:00100000:2.0:1788837913.369584:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:83337:x1875729134934272:12345-0@lo:5:osp-pre-1-0.0 00002000:00010000:3.0:1788837913.369589:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000020:02000000:2.0:1788837913.369592:0:26209:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1788837913.369596:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18d11ea/0x88da08396ccc7b82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369605:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b6:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.369608:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.369612:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b18d11ea/0x88da08396ccc7b82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369622:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b18d11ea/0x88da08396ccc7b82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369630:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18d11ea/0x88da08396ccc7b82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788837913.369637:0:26209:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 706 00010000:00010000:3.0:1788837913.369639:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b18d11ea/0x88da08396ccc7b82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369656:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788837913.369702:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.369708:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc7b89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369724:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b5:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.369728:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.369734:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc7b89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369745:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc7b89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369755:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc7b89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369763:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc7b89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369774:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788837913.369821:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.369827:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008db245dd/0x88da08396ccc7b90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369835:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b4:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.369838:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.369842:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008db245dd/0x88da08396ccc7b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.369844:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc7b6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369862:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008db245dd/0x88da08396ccc7b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.369864:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc7b6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369904:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008db245dd/0x88da08396ccc7b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369912:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008db245dd/0x88da08396ccc7b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369921:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788837913.369962:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.369967:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048d278e3/0x88da08396ccc7b97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369974:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b3:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.369977:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.369981:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048d278e3/0x88da08396ccc7b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369990:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048d278e3/0x88da08396ccc7b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.369998:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048d278e3/0x88da08396ccc7b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.370005:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048d278e3/0x88da08396ccc7b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.370025:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788837913.371754:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788837913.371767:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc7b74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.371781:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.371787:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc7b74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.371853:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788837913.371860:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc7b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.371868:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837913.371886:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc7b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.371894:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc7b7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.371914:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc7b7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.371921:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc7b7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.371944:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788837913.371948:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b18d11ea/0x88da08396ccc7b82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.371954:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837913.371957:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18d11ea/0x88da08396ccc7b82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.371965:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18d11ea/0x88da08396ccc7b82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.371975:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b18d11ea/0x88da08396ccc7b82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.372176:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc7b74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.372192:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc7b74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372204:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b18d11ea/0x88da08396ccc7b82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.372209:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc7b74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.372243:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837913.372245:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837913.372248:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc7b89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372250:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008db245dd/0x88da08396ccc7b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.372268:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837913.372271:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.372274:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc7b89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372276:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008db245dd/0x88da08396ccc7b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.372293:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc7b89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372296:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008db245dd/0x88da08396ccc7b90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.372319:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc7b89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372321:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008db245dd/0x88da08396ccc7b90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.372343:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc7b89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372344:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008db245dd/0x88da08396ccc7b90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372375:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837913.372379:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048d278e3/0x88da08396ccc7b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372386:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837913.372389:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048d278e3/0x88da08396ccc7b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372412:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048d278e3/0x88da08396ccc7b97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372424:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048d278e3/0x88da08396ccc7b97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372431:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048d278e3/0x88da08396ccc7b97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.372456:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.372460:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.372462:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788837913.372519:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.372527:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015065e6a/0x88da08396ccc7b9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.372536:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.372540:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.372541:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b2:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.372543:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.372549:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.372556:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015065e6a/0x88da08396ccc7b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.373736:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015065e6a/0x88da08396ccc7b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.373764:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015065e6a/0x88da08396ccc7b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.373772:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015065e6a/0x88da08396ccc7b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.373816:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837913.373953:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788837913.373959:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837913.373962:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015065e6a/0x88da08396ccc7b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.373969:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006738d72a/0x88da08396ccc7ba5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.373983:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b1:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.373993:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788837913.374002:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.374004:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015065e6a/0x88da08396ccc7b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.374011:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006738d72a/0x88da08396ccc7ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.374018:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015065e6a/0x88da08396ccc7b9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.374026:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006738d72a/0x88da08396ccc7ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.374041:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006738d72a/0x88da08396ccc7ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.374050:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015065e6a/0x88da08396ccc7b9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.374173:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015065e6a/0x88da08396ccc7b9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.374196:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.374199:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.374200:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837913.375254:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134934144 00000100:00100000:1.0:1788837913.375267:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134934144 00000100:00100000:1.0:1788837913.375337:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:1.0:1788837913.375348:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729134934144:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:1.0:1788837913.375355:0:12691:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788837913.375442:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8654144 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837913.375522:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729134934144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (6194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837913.375604:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00010000:00010000:1.0:1788837913.375631:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837913.375685:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134934144:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788837913.375720:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837913.375943:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:83337:x1875729134934272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6369us (6709us total) trans 4294969447 rc 0/0 00000100:00100000:2.0:1788837913.375951:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5906 00000100:00100000:1.0:1788837913.375985:0:83337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83337:1875729134934272:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788837913.375999:0:83337:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2c1:0x0]-[0x2c0000401:0x2e1:0x0] 00010000:00010000:3.0:1788837913.376896:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006738d72a/0x88da08396ccc7ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.376926:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788837913.377071:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.377079:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c80dbc/0x88da08396ccc7bac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.377094:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b0:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.377098:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.377105:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c80dbc/0x88da08396ccc7bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.377121:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7c80dbc/0x88da08396ccc7bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.377131:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c80dbc/0x88da08396ccc7bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.377152:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c80dbc/0x88da08396ccc7bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.377177:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788837913.377588:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837913.377597:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006738d72a/0x88da08396ccc7ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.377608:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5ea00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.377614:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006738d72a/0x88da08396ccc7ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.377626:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006738d72a/0x88da08396ccc7ba5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.377651:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006738d72a/0x88da08396ccc7ba5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.377674:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006738d72a/0x88da08396ccc7ba5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.377715:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837913.377720:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7c80dbc/0x88da08396ccc7bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.377727:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837913.377731:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c80dbc/0x88da08396ccc7bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.377739:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c80dbc/0x88da08396ccc7bac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.377751:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7c80dbc/0x88da08396ccc7bac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.377759:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7c80dbc/0x88da08396ccc7bac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837913.377773:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.377774:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.377776:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.379220:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788837913.379931:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.379953:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc7bb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.379971:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2af:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.379976:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.379983:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc7bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.379996:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc7bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.380009:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc7bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.380017:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc7bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.380048:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788837913.380090:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.380095:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc7bba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.380118:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ae:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.380121:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.380126:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc7bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.380135:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc7bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.380145:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc7bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380148:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837913.380161:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc7bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380161:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc7bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380186:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.380193:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc7bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380203:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc7bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380223:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc7bb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380230:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc7bb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380256:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837913.380260:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc7bba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380267:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.380270:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc7bba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380278:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc7bba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380302:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc7bba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.380310:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.380312:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.380947:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788837913.380954:0:26214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc7bba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.381042:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.381182:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc7bc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.381192:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ad:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.381195:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.381200:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc7bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.381218:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc7bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.381227:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc7bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.381234:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc7bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.382593:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837913.382615:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc7bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.382631:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.382636:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc7bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.382647:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc7bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.382677:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc7bc1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.382692:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.382695:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.382697:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.383745:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788837913.383757:0:26214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc7bc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.383854:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788837913.383950:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.383958:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc7bc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.383973:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ac:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.383978:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.383986:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc7bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384007:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc7bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384043:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc7bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384053:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc7bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384078:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788837913.384125:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.384130:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc7bcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384138:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ab:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.384141:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.384145:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc7bcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384154:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc7bcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384162:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc7bcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384169:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837913.384170:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc7bcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384182:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc7bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384204:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837913.384209:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc7bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384215:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837913.384219:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc7bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384242:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc7bc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384250:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc7bc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.384261:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.384268:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc7bd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384272:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788837913.384277:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2aa:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.384282:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.384286:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc7bcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384288:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc7bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384307:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788837913.384312:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc7bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384313:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc7bcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384339:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc7bcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384340:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc7bd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384362:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc7bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384366:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc7bcf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384375:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc7bcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384390:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.384393:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837913.384394:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837913.384399:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc7bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384406:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837913.384410:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc7bd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384420:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc7bd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.384435:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.384443:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc7bdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384444:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc7bd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384461:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a9:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.384475:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc7bd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384476:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.384485:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc7bdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384497:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.384498:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc7bdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.384501:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.384505:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.384512:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc7bdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.384520:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc7bdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.384628:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.385440:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788837913.385507:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.385514:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc7be4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.385524:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a8:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:0.0:1788837913.385548:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837913.385556:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc7bdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.385566:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837913.385580:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc7bdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.385590:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc7bdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.385605:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc7bdd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.385612:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc7bdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.385645:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.385646:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837913.385649:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.385652:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.385654:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc7be4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.385668:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc7be4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.385676:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc7be4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.385690:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc7be4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.385712:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788837913.385757:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.385763:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc7beb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.385770:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a7:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.385774:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.385778:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc7beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.385787:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc7beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.385793:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc7beb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386023:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc7beb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386042:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788837913.386061:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837913.386069:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc7be4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.386088:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837913.386089:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.386095:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc7be4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386098:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc7bf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386106:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc7be4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386126:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a6:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.386131:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837913.386132:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc7be4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386138:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc7bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386147:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc7be4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386155:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc7bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386165:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc7bf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386166:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837913.386173:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc7beb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386178:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc7bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386187:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.386194:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc7beb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386202:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837913.386202:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc7beb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386218:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc7beb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386233:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc7beb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386249:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837913.386252:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc7bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788837913.386256:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837913.386265:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788837913.386268:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc7bf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386271:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc7bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386290:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a5:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:2.0:1788837913.386292:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc7bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386297:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.386307:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc7bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386313:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc7bf2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386322:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc7bf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386330:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc7bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.386335:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.386338:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.386340:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.386354:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc7bf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.386361:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc7bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837913.386385:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.386391:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837913.386784:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788837913.387167:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.387174:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc7c00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387185:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a4:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.387189:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.387193:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc7c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387205:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc7c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387214:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc7c00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387221:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc7c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387261:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788837913.387308:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.387314:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc7c07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387322:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a3:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.387324:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.387328:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc7c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387338:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc7c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387345:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc7c07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387352:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc7c07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387428:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788837913.387472:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788837913.387477:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc7c0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387486:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a2:0x0].0x0 since=3307s v=(0 0) 00010000:00010000:3.0:1788837913.387494:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837913.387499:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc7c0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387508:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc7c0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387516:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc7c0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387523:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc7c0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837913.387531:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788837913.387562:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788837913.387579:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc7bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387596:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.387600:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc7bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387613:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc7bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387632:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc7bf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387642:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc7bf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387672:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837913.387676:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc7c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387684:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.387688:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc7c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387696:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc7c00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387706:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc7c00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387723:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc7c00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387738:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837913.387743:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc7c07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387751:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.387755:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc7c07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387764:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc7c07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387778:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc7c07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387787:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc7c07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387822:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837913.387826:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc7c0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387833:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837913.387843:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc7c0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387852:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc7c0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387863:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc7c0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387870:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc7c0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837913.387883:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.387885:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837913.387887:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.388557:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837913.388566:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.388643:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837913.388649:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788837913.392153:0:26214:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:3.0:1788837913.392286:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:83335:x1875729134934016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 51549us (60243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837913.392297:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5905 00000100:00100000:0.0:1788837913.394901:0:83335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83335:1875729134934016:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788837913.394925:0:83335:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2c1:0x0] from OST, last_created [0x280000401:0x2c1:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1788837913.395035:0:83335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f44380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83335:1875729134934528:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788837913.395110:0:83335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837913.395149:0:83335:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff607ecbc00 going to sleep for 20 seconds 00000100:00100000:2.0:1788837913.395344:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134934400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837913.395378:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837913.395597:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134934400 00000100:00100000:0.0:1788837913.395605:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134934400 00000100:00100000:0.0:1788837913.395668:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:0.0:1788837913.395679:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134934400:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:0.0:1788837913.395687:0:8465:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788837913.395719:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216384 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837913.395766:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134934400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.395774:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00100000:2.0:1788837913.395894:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134934400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837913.396439:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134934528 00000100:00100000:1.0:1788837913.396446:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134934528 00000100:00100000:1.0:1788837913.396487:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5907 00000100:00100000:1.0:1788837913.396497:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:83335:x1875729134934528:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:1.0:1788837913.396502:0:26208:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1788837913.396532:0:26208:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 706 00000100:00100000:0.0:1788837913.400308:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:83335:x1875729134934528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3805us (5190us total) trans 4294969448 rc 0/0 00000100:00100000:0.0:1788837913.400322:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5907 00000100:00100000:1.0:1788837913.400502:0:83335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f44380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83335:1875729134934528:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788837913.400519:0:83335:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2c1:0x0]-[0x280000401:0x2e1:0x0] 00010000:00010000:2.0:1788837913.533179:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837913.981176:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837913.981202:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134934656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837913.981298:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837913.981465:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134934656 00000100:00100000:0.0:1788837913.981494:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134934656 00000100:00100000:0.0:1788837913.981555:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:0.0:1788837913.981576:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134934656:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:0.0:1788837913.981584:0:8464:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788837913.981613:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837913.981678:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134934656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837913.981685:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:2.0:1788837913.982193:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134934656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837913.988471:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134934784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837913.988557:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837913.988703:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134934784 00000100:00100000:1.0:1788837913.988714:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134934784 00000100:00100000:1.0:1788837913.988783:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:1.0:1788837913.988794:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134934784:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:1.0:1788837913.988824:0:12691:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788837913.988850:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837913.988897:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134934784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837913.988903:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1788837913.988987:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134934784:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788837914.045176:0:37907:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff62bc95880 x1875729134932608/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1788837922 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837914.045335:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729134932608:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1064179us (1066152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837914.045347:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00080000:3.0:1788837914.045614:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788837914.045624:0:3642:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8ff62bc94700 x1875729134932608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788837942 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837914.045634:0:3642:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8ff62bc94700 x1875729134932608/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788837942 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837914.045640:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788837914.045660:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788837914.045666:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001ee1d931): req@ffff8ff639c5d880 x1875729134847616/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788837732 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837914.045719:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134932608:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1788837914.046157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837914.046334:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788837914.046346:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134934912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837914.046378:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837914.046518:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134847616 00000100:00100000:2.0:1788837914.046528:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134847616 00000100:00100000:2.0:1788837914.046584:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134934912 00000100:00100000:2.0:1788837914.046588:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134934912 00000100:00100000:2.0:1788837914.046615:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:2.0:1788837914.046624:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729134847616:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1788837914.046631:0:8471:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1788837914.046665:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445089280 avail 1298849792 00000100:00100000:2.0:1788837914.046722:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729134847616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837914.046729:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00100000:2.0:1788837914.046748:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:2.0:1788837914.046754:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134934912:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1788837914.046758:0:8471:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1788837914.046768:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445089280 avail 1298849792 00000100:00100000:2.0:1788837914.046832:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134934912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837914.046838:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:2.0:1788837914.046879:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134847616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837914.047012:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134934912:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788837914.556987:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837915.581404:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837916.030651:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627fb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134935040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837916.030737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837916.033045:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134935040 00000100:00100000:0.0:1788837916.033059:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134935040 00000100:00100000:0.0:1788837916.033134:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:0.0:1788837916.033145:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134935040:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1788837916.033153:0:8471:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1788837916.033194:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788837916.033294:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134935040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837916.033301:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00100000:1.0:1788837916.033843:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627fb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134935040:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788837916.605096:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837917.629762:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837918.081675:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134935168:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.081760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.081829:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134935680:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.081858:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.081895:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729134936192:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.081930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.081955:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788837918.081960:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729134935552:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.081980:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.081996:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134936064:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.082018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.082065:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134935168 00000100:00100000:2.0:1788837918.082073:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134935168 00000100:00100000:2.0:1788837918.082118:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788837918.082126:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729134935168:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788837918.082133:0:83323:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788837918.082182:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729134935168:12345-0@lo:400:kworker.0 Request processed in 56us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837918.082190:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788837918.082221:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729134935424:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.082245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.082262:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134935936:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.082288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.082307:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788837918.082314:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729134935296:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.082337:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.082354:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134935808:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.082381:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.082398:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134936320:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.082430:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.082459:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134935680 00000100:00100000:2.0:1788837918.082463:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134935680 00000100:00100000:2.0:1788837918.082494:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134936192 00000100:00100000:2.0:1788837918.082498:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134936192 00000100:00100000:2.0:1788837918.082509:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134935552 00000100:00100000:2.0:1788837918.082511:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134935552 00000100:00100000:2.0:1788837918.082522:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134935424 00000100:00100000:2.0:1788837918.082524:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134935424 00000100:00100000:2.0:1788837918.082534:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134935296 00000100:00100000:2.0:1788837918.082536:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134935296 00000100:00100000:2.0:1788837918.082942:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1788837918.082951:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134935680:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788837918.082956:0:75504:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788837918.082993:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134935680:12345-0@lo:400:kworker.0 Request processed in 44us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837918.082999:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1788837918.083014:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:2.0:1788837918.083021:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729134936192:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788837918.083025:0:75504:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788837918.083056:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729134936192:12345-0@lo:400:kworker.0 Request processed in 35us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837918.083063:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:2.0:1788837918.083075:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1788837918.083081:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729134935552:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788837918.083085:0:75504:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788837918.083115:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729134935552:12345-0@lo:400:kworker.0 Request processed in 34us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837918.083132:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1788837918.083144:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1788837918.083150:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729134935424:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788837918.083154:0:75504:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788837918.083190:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729134935424:12345-0@lo:400:kworker.0 Request processed in 40us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837918.083196:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1788837918.083210:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1788837918.083217:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729134935296:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788837918.083222:0:75504:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788837918.083257:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729134935296:12345-0@lo:400:kworker.0 Request processed in 40us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837918.083264:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00080000:3.0:1788837918.083270:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837918.083276:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837918.083284:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134936064 00000100:00100000:2.0:1788837918.083289:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134936064 00000100:00100000:3.0:1788837918.083296:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134935808 00000100:00100000:3.0:1788837918.083302:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134935808 00000100:00100000:2.0:1788837918.083321:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134935936 00000100:00100000:2.0:1788837918.083326:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134935936 00000100:00100000:3.0:1788837918.083334:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134936320 00000100:00100000:3.0:1788837918.083339:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134936320 00000100:00100000:2.0:1788837918.083353:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384 00000100:00100000:2.0:1788837918.083362:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134936064:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788837918.083367:0:26220:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788837918.083370:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:3.0:1788837918.083382:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134935808:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788837918.083388:0:8472:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788837918.083404:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134936064:12345-0@lo:400:kworker.0 Request processed in 43us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837918.083411:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384 00000100:00100000:2.0:1788837918.083427:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:2.0:1788837918.083434:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134935936:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788837918.083438:0:26220:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788837918.083451:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134935808:12345-0@lo:400:kworker.0 Request processed in 71us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837918.083459:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:3.0:1788837918.083482:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:3.0:1788837918.083491:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134936320:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788837918.083498:0:8472:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788837918.083499:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134935936:12345-0@lo:400:kworker.0 Request processed in 62us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837918.083507:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00100000:3.0:1788837918.083556:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134936320:12345-0@lo:400:kworker.0 Request processed in 52us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837918.083563:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00080000:3.0:1788837918.083580:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837918.083583:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837918.083609:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729134936704:0@lo:400:kworker.0 00000100:00100000:3.0:1788837918.083642:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837918.083696:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134936576:0@lo:400:kworker.0 00000100:00100000:3.0:1788837918.083698:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729134935552:0@lo:400:kworker.0 00000100:00100000:3.0:1788837918.083738:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134936064:0@lo:400:kworker.0 00000100:00100000:1.0:1788837918.083739:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837918.083779:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134935168:0@lo:400:kworker.0 00000100:00100000:1.0:1788837918.083781:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134936576 00000100:00100000:1.0:1788837918.083787:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134936576 00000100:00100000:1.0:1788837918.083848:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:1.0:1788837918.083854:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729134936576:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1788837918.083858:0:26218:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788837918.083893:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729134936576:12345-0@lo:400:kworker.0 Request processed in 39us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837918.083899:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00080000:1.0:1788837918.083918:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837918.083939:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134936576:0@lo:400:kworker.0 00000100:00100000:0.0:1788837918.084167:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134936704 00000100:00100000:0.0:1788837918.084172:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134936704 00000100:00100000:3.0:1788837918.084192:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134935680:0@lo:400:kworker.0 00000100:00100000:0.0:1788837918.084215:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1788837918.084219:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729134936192:0@lo:400:kworker.0 00000100:00100000:0.0:1788837918.084228:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729134936704:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788837918.084233:0:67312:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788837918.084274:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729134936704:12345-0@lo:400:kworker.0 Request processed in 51us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837918.084282:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1788837918.084303:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729134936704:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.085059:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134936448:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.085102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.085207:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729134935296:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.085221:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134935808:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.085233:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134936320:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.085246:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729134935424:0@lo:400:kworker.0 00000100:00100000:2.0:1788837918.085259:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134935936:0@lo:400:kworker.0 00000100:00100000:3.0:1788837918.094898:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134936448 00000100:00100000:3.0:1788837918.094989:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134936448 00000100:00100000:3.0:1788837918.095098:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387 00000100:00100000:3.0:1788837918.095109:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134936448:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788837918.095118:0:20253:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788837918.095349:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134936448:12345-0@lo:400:kworker.0 Request processed in 242us (10245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837918.095358:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387 00000100:00080000:1.0:1788837918.095738:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837918.102677:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134936448:0@lo:400:kworker.0 00000100:00100000:1.0:1788837918.269240:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837918.269281:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837918.269322:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837918.269355:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837918.269383:0:83324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116364160 00000100:00100000:1.0:1788837918.269408:0:83324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116364160 00000100:00100000:1.0:1788837918.269458:0:83324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 153 00000100:00100000:1.0:1788837918.269468:0:83324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116364160:12345-192.168.203.30@tcp:400:kworker.0 00000020:02000000:1.0:1788837918.269475:0:83324:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788837918.269557:0:83324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116364160:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837918.269585:0:83324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 153 00000100:00100000:0.0:1788837918.269794:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116364288 00000100:00100000:0.0:1788837918.269825:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116364288 00000100:00100000:0.0:1788837918.269859:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116364416 00000100:00100000:0.0:1788837918.269862:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116364416 00000100:00100000:0.0:1788837918.269898:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 999 00000100:00100000:0.0:1788837918.269906:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116364416:12345-192.168.203.30@tcp:400:kworker.0 00000020:02000000:0.0:1788837918.269910:0:75504:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788837918.269943:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116364416:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837918.269949:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 999 00000100:00100000:0.0:1788837918.269965:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1014 00000100:00100000:0.0:1788837918.269969:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116364288:12345-192.168.203.30@tcp:38:kworker.0 00000020:02000000:0.0:1788837918.269973:0:75504:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1788837918.269999:0:75504:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp t94489280513 exp 0000000000000000 cur 3312 last 0 00000020:00000080:0.0:1788837918.270061:0:75504:0:(genops.c:1385:class_connect()) connect: client fdcf066d-ff07-4b2e-96ab-52415ed6bf72, cookie 0x88da08396ccc7c15 00000004:00100000:0.0:1788837918.270087:0:75504:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788837918.270179:0:75504:0:(import.c:65:import_set_state_nolock()) ffff8ff6104df000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837918.270209:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116364288:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 238us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837918.270216:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1014 00000100:00080000:0.0:1788837918.270233:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837918.270531:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116364544 00000100:00100000:3.0:1788837918.270552:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116364544 00000100:00100000:3.0:1788837918.270607:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2388 00000100:00100000:3.0:1788837918.270616:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116364544:12345-192.168.203.30@tcp:400:kworker.0 00000020:02000000:3.0:1788837918.270621:0:26211:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788837918.270652:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116364544:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837918.270658:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2388 00000100:00080000:0.0:1788837918.271152:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837918.290647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837918.290771:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116364672 00000100:00100000:0.0:1788837918.290782:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116364672 00000100:00100000:0.0:1788837918.290867:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1015 00000100:00100000:0.0:1788837918.290878:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64002:x1875729116364672:12345-192.168.203.30@tcp:41:lfs.0 00000020:02000000:0.0:1788837918.290887:0:67312:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1788837918.290965:0:67312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788837918.291057:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64002:x1875729116364672:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 180us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837918.291066:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1015 00000100:00100000:3.0:1788837918.304832:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837918.306601:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116364800 00000100:00100000:0.0:1788837918.306618:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116364800 00000100:00100000:0.0:1788837918.306744:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5908 00000100:00100000:0.0:1788837918.306753:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875729116364800:12345-192.168.203.30@tcp:8:lfs.0 00000020:02000000:0.0:1788837918.306761:0:8462:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1788837918.306794:0:8462:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp t0 exp 0000000000000000 cur 3312 last 0 00000020:00000080:0.0:1788837918.306853:0:8462:0:(genops.c:1385:class_connect()) connect: client fdcf066d-ff07-4b2e-96ab-52415ed6bf72, cookie 0x88da08396ccc7c1c 00002000:00100000:0.0:1788837918.306865:0:8462:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fdcf066d-ff07-4b2e-96ab-52415ed6bf72/ffff8ff6104df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788837918.306883:0:8462:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788837918.306985:0:8462:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788837918.307036:0:8462:0:(import.c:65:import_set_state_nolock()) ffff8ff6104dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837918.307115:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116364800:12345-192.168.203.30@tcp:8:lfs.0 Request processed in 360us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837918.307126:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5908 00000100:00100000:3.0:1788837918.314842:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837918.315154:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116364928 00000100:00100000:1.0:1788837918.315165:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116364928 00000100:00100000:1.0:1788837918.315227:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1858 00000100:00100000:1.0:1788837918.315238:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64002:x1875729116364928:12345-192.168.203.30@tcp:13:lfs.0 00000020:02000000:1.0:1788837918.315246:0:8465:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788837918.315273:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837918.315354:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64002:x1875729116364928:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 117us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837918.315363:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1858 00000100:00100000:3.0:1788837918.318082:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837918.318223:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116365056 00000100:00100000:0.0:1788837918.318242:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116365056 00000100:00100000:0.0:1788837918.318320:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1859 00000100:00100000:0.0:1788837918.318332:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64002:x1875729116365056:12345-192.168.203.30@tcp:13:lfs.0 00000020:02000000:0.0:1788837918.318340:0:8464:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788837918.318374:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837918.318530:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64002:x1875729116365056:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 200us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837918.318721:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1859 00000100:00100000:2.0:1788837918.591242:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837918.591269:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134936832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837918.591353:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837918.591440:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134936832 00000100:00100000:2.0:1788837918.591450:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134936832 00000100:00100000:2.0:1788837918.591500:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:2.0:1788837918.591509:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134936832:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:2.0:1788837918.591516:0:12691:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788837918.591697:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837918.591707:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134936960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837918.591740:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837918.591766:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134936960 00000100:00100000:0.0:1788837918.591770:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134936960 00000100:00100000:0.0:1788837918.591822:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:0.0:1788837918.591830:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729134936960:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:0.0:1788837918.591835:0:8464:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788837918.591848:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837918.591892:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729134936960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837918.591899:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00000100:00100000:0.0:1788837918.591954:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134936960:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837918.592822:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837918.592890:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134936832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1381us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837918.592898:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00000100:00100000:0.0:1788837918.593459:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134936832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788837918.652925:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837919.102866:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134937088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837919.102947:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837919.103005:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837919.103023:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134937216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837919.103059:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837919.103061:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627fb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134937344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837919.103124:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134937088 00000100:00100000:3.0:1788837919.103134:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134937088 00000100:00100000:3.0:1788837919.103180:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1788837919.103192:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134937088:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:3.0:1788837919.103199:0:8472:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788837919.103219:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1788837919.103235:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:2.0:1788837919.103279:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134937216 00000100:00100000:2.0:1788837919.103284:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134937216 00000100:00100000:1.0:1788837919.103393:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134937344 00000100:00100000:1.0:1788837919.103399:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134937344 00000100:00100000:3.0:1788837919.103408:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134937088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 215us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837919.103417:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00100000:1.0:1788837919.103427:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862 00000100:00100000:1.0:1788837919.103437:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134937216:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:1.0:1788837919.103443:0:8464:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788837919.103447:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00002000:00000024:1.0:1788837919.103458:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837919.103460:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134937344:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:2.0:1788837919.103467:0:12691:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788837919.103479:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134937088:0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1788837919.103480:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837919.103503:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134937216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837919.103511:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862 00000100:00100000:3.0:1788837919.103522:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134937216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837919.103543:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134937344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837919.103552:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1788837919.103592:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627fb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134937344:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788837919.107513:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00080000:1.0:1788837919.108458:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969448 is committed 00000001:00100000:2.0:1788837919.109155:0:83317:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00080000:2.0:1788837919.113718:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969447 is committed 00010000:00010000:0.0:1788837919.677256:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837920.190380:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837920.191149:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116365184 00000100:00100000:0.0:1788837920.191165:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116365184 00000100:00100000:0.0:1788837920.191248:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1016 00000100:00100000:0.0:1788837920.191260:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:64093:x1875729116365184:12345-192.168.203.30@tcp:101:lfs.0 00000020:02000000:0.0:1788837920.191269:0:75504:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1788837920.191293:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837920.191327:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc7c23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cb72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788837920.192568:0:75504:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 975us 00010000:00010000:2.0:1788837920.214356:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5600/0x88da08396ccc7c2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837920.214385:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5600/0x88da08396ccc7c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837920.214575:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5600/0x88da08396ccc7c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837920.214649:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788837920.214654:0:75504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1788837920.214709:0:75504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5600/0x88da08396ccc7c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837920.214755:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc7c23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb72 expref: 7 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837920.215109:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5600/0x88da08396ccc7c2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb72 expref: 6 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837920.215119:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61d6b9900) 00010000:00010000:2.0:1788837920.215122:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837920.215127:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff6082a5600, rc 0) 00000100:00100000:2.0:1788837920.215225:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64093:x1875729116365184:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 23966us (24860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837920.215245:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1016 00000100:00100000:1.0:1788837920.225497:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837920.226245:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116365312 00000100:00100000:3.0:1788837920.226262:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116365312 00000100:00100000:3.0:1788837920.226354:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1017 00000100:00100000:3.0:1788837920.226368:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64093:x1875729116365312:12345-192.168.203.30@tcp:41:lfs.0 00000020:02000000:3.0:1788837920.226378:0:66254:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1788837920.226442:0:66254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:3.0:1788837920.226566:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64093:x1875729116365312:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 199us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837920.226575:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1017 00000100:00100000:0.0:1788837920.231058:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837920.231247:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116365440 00000100:00100000:2.0:1788837920.231262:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116365440 00000100:00100000:2.0:1788837920.231379:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1018 00000100:00100000:2.0:1788837920.231392:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64093:x1875729116365440:12345-192.168.203.30@tcp:41:lfs.0 00000020:02000000:2.0:1788837920.231400:0:67312:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1788837920.231470:0:67312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788837920.231584:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64093:x1875729116365440:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 195us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837920.231593:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1018 00000100:00080000:0.0:1788837920.232387:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837920.239628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837920.239740:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116365568 00000100:00100000:3.0:1788837920.239754:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116365568 00000100:00100000:2.0:1788837920.246416:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1864 00000100:00100000:2.0:1788837920.246435:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:64093:x1875729116365568:12345-192.168.203.30@tcp:13:lfs.0 00000020:02000000:2.0:1788837920.246454:0:8465:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1788837920.246500:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837920.246656:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:64093:x1875729116365568:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 224us (7046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837920.246683:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1864 00000100:00100000:3.0:1788837920.255641:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837920.256221:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116365696 00000100:00100000:1.0:1788837920.256239:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116365696 00000100:00100000:1.0:1788837920.256346:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1865 00000100:00100000:1.0:1788837920.256379:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64093:x1875729116365696:12345-192.168.203.30@tcp:13:lfs.0 00000020:02000000:1.0:1788837920.256389:0:8464:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788837920.256431:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837920.256547:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64093:x1875729116365696:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 173us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837920.256555:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1865 00000100:00080000:0.0:1788837920.256660:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837920.295211:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837920.295459:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116365824 00000100:00100000:1.0:1788837920.295480:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116365824 00000100:00100000:1.0:1788837920.295626:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1019 00000100:00100000:1.0:1788837920.295640:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:63610:x1875729116365824:12345-192.168.203.30@tcp:101:multiop.0 00000020:02000000:1.0:1788837920.295649:0:66253:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1788837920.295673:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837920.295703:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cb79 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.295843:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.295860:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.295875:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.295891:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc7c3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.295898:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc7c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.295927:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc7c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296160:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc7c46 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296169:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc7c46 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296178:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc7c46 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837920.296226:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:1.0:1788837920.296231:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1788837920.296286:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc7c46 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296314:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc7c46 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296324:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296332:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296339:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296347:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296364:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788837920.296370:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296379:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296395:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61d6b9900) 00010000:00010000:1.0:1788837920.296397:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837920.296402:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296409:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccc7c38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296427:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc7c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296433:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc7c3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296439:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc7c3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296444:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788837920.296447:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc7c3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296454:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc7c3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296472:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff8ff6192f8000) 00010000:00010000:1.0:1788837920.296474:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837920.296478:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc7c3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296484:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc7c3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296532:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb79 expref: 8 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296549:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc7c46 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb79 expref: 7 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837920.296557:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8ff6192f8e00) 00010000:00010000:1.0:1788837920.296559:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788837920.296562:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d200, rc 0) 00000100:00100000:1.0:1788837920.296647:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:63610:x1875729116365824:12345-192.168.203.30@tcp:101:multiop.0 Request processed in 1010us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837920.296655:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1019 00010000:00010000:1.0:1788837920.701815:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837921.149033:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134937472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837921.149113:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837921.149273:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134937472 00000100:00100000:1.0:1788837921.149281:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134937472 00000100:00100000:1.0:1788837921.149329:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:1.0:1788837921.149338:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134937472:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:1.0:1788837921.149346:0:37907:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1788837921.149374:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:1.0:1788837921.149429:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134937472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837921.149436:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00100000:0.0:1788837921.149512:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134937472:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788837921.725230:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837922.753190:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837923.197206:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134937600:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.197284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837923.197328:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729134938112:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.197357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837923.197377:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729134938624:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.197413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837923.197432:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729134939136:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.197455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837923.197479:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788837923.197485:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729134937728:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.197527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837923.197545:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134938240:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.197571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837923.197590:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134938752:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.197612:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837923.197647:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134937600 00000100:00100000:1.0:1788837923.197655:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134937600 00000100:00100000:1.0:1788837923.197703:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788837923.197712:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729134937600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.197761:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729134937600:12345-0@lo:400:kworker.0 Request processed in 51us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837923.197768:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788837923.197833:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134938112 00000100:00100000:1.0:1788837923.197837:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134938112 00000100:00100000:1.0:1788837923.197873:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134938624 00000100:00100000:1.0:1788837923.197876:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134938624 00000100:00100000:1.0:1788837923.197892:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134939136 00000100:00100000:1.0:1788837923.197895:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134939136 00000100:00100000:1.0:1788837923.197904:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134937728 00000100:00100000:1.0:1788837923.197906:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134937728 00000100:00100000:1.0:1788837923.197920:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1788837923.197926:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729134938112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.197958:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729134938112:12345-0@lo:400:kworker.0 Request processed in 34us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837923.197965:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1788837923.197977:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1788837923.197996:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729134938624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198025:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729134938624:12345-0@lo:400:kworker.0 Request processed in 43us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837923.198031:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1788837923.198042:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1788837923.198047:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729134939136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198082:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729134939136:12345-0@lo:400:kworker.0 Request processed in 35us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837923.198088:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1788837923.198099:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1788837923.198104:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729134937728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198131:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729134937728:12345-0@lo:400:kworker.0 Request processed in 26us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837923.198145:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1788837923.198177:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134938240 00000100:00100000:1.0:1788837923.198180:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134938240 00000100:00100000:1.0:1788837923.198201:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134938752 00000100:00100000:1.0:1788837923.198204:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134938752 00000100:00100000:1.0:1788837923.198221:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:1.0:1788837923.198227:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134938240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198261:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134938240:12345-0@lo:400:kworker.0 Request processed in 34us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837923.198267:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00100000:1.0:1788837923.198279:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:1.0:1788837923.198284:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134938752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198328:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134938752:12345-0@lo:400:kworker.0 Request processed in 43us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837923.198334:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00080000:1.0:1788837923.198355:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837923.198358:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837923.198397:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729134937728:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198407:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134938240:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198416:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134938752:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198424:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134937600:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198432:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729134938112:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198440:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729134938624:0@lo:400:kworker.0 00000100:00100000:1.0:1788837923.198462:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729134939136:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.198764:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134937856:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.198823:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837923.198861:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134938368:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.198886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837923.198909:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134938880:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.198931:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837923.198956:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788837923.198962:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729134937984:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.198999:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837923.199020:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134938496:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199042:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837923.199169:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134939008:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199194:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837923.199237:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134938368 00000100:00100000:3.0:1788837923.199242:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134938368 00000100:00100000:3.0:1788837923.199276:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134938880 00000100:00100000:3.0:1788837923.199279:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134938880 00000100:00100000:3.0:1788837923.199296:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134938496 00000100:00100000:3.0:1788837923.199299:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134938496 00000100:00100000:3.0:1788837923.199318:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134939008 00000100:00100000:3.0:1788837923.199320:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134939008 00000100:00100000:3.0:1788837923.199341:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:3.0:1788837923.199347:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134938368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199471:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134938368:12345-0@lo:400:kworker.0 Request processed in 122us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837923.199486:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:3.0:1788837923.199503:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:3.0:1788837923.199521:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134938880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199554:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134938880:12345-0@lo:400:kworker.0 Request processed in 34us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837923.199560:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00000100:00100000:3.0:1788837923.199571:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:3.0:1788837923.199577:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134938496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199603:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134938496:12345-0@lo:400:kworker.0 Request processed in 27us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837923.199609:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:3.0:1788837923.199619:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:3.0:1788837923.199625:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134939008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199649:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134939008:12345-0@lo:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837923.199654:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00100000:3.0:1788837923.199691:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134937856 00000100:00100000:3.0:1788837923.199695:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134937856 00000100:00100000:3.0:1788837923.199722:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134937984 00000100:00100000:3.0:1788837923.199724:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134937984 00000100:00100000:3.0:1788837923.199743:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1788837923.199749:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134937856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199782:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134937856:12345-0@lo:400:kworker.0 Request processed in 34us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837923.199788:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1788837923.199835:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1788837923.199841:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729134937984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199875:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729134937984:12345-0@lo:400:kworker.0 Request processed in 34us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837923.199880:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00080000:3.0:1788837923.199901:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837923.199904:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837923.199906:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837923.199908:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837923.199934:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729134937984:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199946:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134938496:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199954:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969447 gen 2 00000100:00100000:3.0:1788837923.199966:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134939008:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.199977:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134937856:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.201323:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134938368:0@lo:400:kworker.0 00000100:00100000:3.0:1788837923.201353:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000100:00100000:3.0:1788837923.201372:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134938880:0@lo:400:kworker.0 00000100:00100000:0.0:1788837923.328372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837923.328456:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116366080 00000100:00100000:2.0:1788837923.328467:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116366080 00000100:00100000:2.0:1788837923.328551:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1020 00000100:00100000:2.0:1788837923.328560:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:64212:x1875729116366080:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1788837923.328613:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788837923.328642:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc7c46 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb79 expref: 7 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.328661:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8ff6192f8e00) 00010000:00010000:2.0:1788837923.328676:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5600/0x88da08396ccc7c2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb72 expref: 6 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.328686:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61d6b9900) 00010000:00010000:2.0:1788837923.328694:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788837923.328734:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5200/0x88da08396ccc7c4d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.328748:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5200/0x88da08396ccc7c4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.328758:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5200/0x88da08396ccc7c4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.328772:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.328779:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.328825:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.328907:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc7c5b lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.328915:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc7c5b lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.328922:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc7c5b lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788837923.329188:0:75504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].2, 64 off8320 00000004:00080000:2.0:1788837923.329198:0:75504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3317348399653ns, next at 3318348397491ns, rc = 0 00010000:00010000:2.0:1788837923.329252:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329261:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329268:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329275:0:75504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329282:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329288:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329314:0:75504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837923.329346:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc7c5b lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329352:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc7c5b lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329358:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc7c5b lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329364:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788837923.329369:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc7c5b lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329376:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc7c5b lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329385:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8ff612676900) 00010000:00010000:2.0:1788837923.329388:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788837923.329391:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc7c5b lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329397:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc7c5b lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329411:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5200/0x88da08396ccc7c4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329417:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5200/0x88da08396ccc7c4d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329431:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5200/0x88da08396ccc7c4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329436:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6082a5200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788837923.329439:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5200/0x88da08396ccc7c4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329444:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5200/0x88da08396ccc7c4d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329452:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff612676d00) 00010000:00010000:2.0:1788837923.329454:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837923.329456:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5200/0x88da08396ccc7c4d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329462:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a5200/0x88da08396ccc7c4d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837923.329473:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000718e0aae reply state 00000000a9cab403 transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329482:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329487:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff8ff612676500) 00010000:00010000:2.0:1788837923.329489:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788837923.329492:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788837923.329574:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:64212:x1875729116366080:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1014us (1208us total) trans 98784247809 rc 0/0 00000100:00100000:2.0:1788837923.329581:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1020 00010000:00010000:2.0:1788837923.329613:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837923.329618:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329624:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837923.329628:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329634:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329643:0:15289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8ff612676900) 00010000:00010000:2.0:1788837923.329645:0:15289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788837923.329648:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329653:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4400/0x88da08396ccc7c62 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837923.329664:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837923.329666:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837923.329667:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837923.332402:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837923.397717:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837923.397867:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837923.397979:0:83324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116366208 00000100:00100000:1.0:1788837923.397989:0:83324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116366208 00000100:00100000:1.0:1788837923.398046:0:83324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00100000:1.0:1788837923.398057:0:83324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116366208:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837923.398143:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116366464 00000100:00100000:2.0:1788837923.398149:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116366464 00000100:00100000:2.0:1788837923.398192:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2393 00000100:00100000:2.0:1788837923.398200:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116366464:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837923.398279:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116366464:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837923.398297:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2393 00000100:00080000:2.0:1788837923.398318:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837923.398350:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837923.398375:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116366336 00000100:00100000:2.0:1788837923.398379:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116366336 00000100:00100000:0.0:1788837923.398472:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837923.398490:0:83324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116366208:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 435us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837923.398497:0:83324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00100000:0.0:1788837923.398497:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116366592 00000100:00100000:0.0:1788837923.398501:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116366592 00000100:00100000:0.0:1788837923.398546:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2394 00000100:00100000:0.0:1788837923.398553:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116366592:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837923.398583:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116366592:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837923.398589:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2394 00000100:00080000:0.0:1788837923.398620:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837923.398623:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837923.398683:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1006 00000100:00100000:2.0:1788837923.398691:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116366336:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837923.398739:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116366336:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837923.398745:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1006 00000100:00100000:1.0:1788837923.710054:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837923.710082:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134939264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837923.710182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837923.714350:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134939264 00000100:00100000:0.0:1788837923.714363:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134939264 00000100:00100000:0.0:1788837923.714478:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:0.0:1788837923.714488:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134939264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837923.714536:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837923.714567:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837923.714586:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134939392:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788837923.714681:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837923.714761:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134939264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837923.714986:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134939264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (4449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837923.715013:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:1.0:1788837923.722020:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837923.722236:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134939392 00000100:00100000:3.0:1788837923.722247:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134939392 00000100:00100000:3.0:1788837923.722325:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:3.0:1788837923.722336:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134939392:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788837923.722338:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788837923.722375:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837923.722465:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134939392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837923.722489:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00100000:0.0:1788837923.722564:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134939392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788837923.773946:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837924.221024:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837924.221050:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134939520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837924.221132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837924.221448:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837924.221458:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134939648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837924.221507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837924.221546:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134939648 00000100:00100000:0.0:1788837924.221554:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134939648 00000100:00100000:0.0:1788837924.221610:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:0.0:1788837924.221619:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134939648:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788837924.221627:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788837924.221652:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837924.221705:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134939648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837924.221711:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00100000:2.0:1788837924.221906:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134939648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837924.222379:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837924.222390:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134939776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837924.222426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837924.222965:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134939520 00000100:00100000:1.0:1788837924.222975:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134939520 00000100:00100000:1.0:1788837924.223033:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1788837924.223041:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134939520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837924.223071:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:1.0:1788837924.223122:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134939520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837924.223128:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1788837924.223177:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134939520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837924.223632:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134939776 00000100:00100000:0.0:1788837924.223846:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134939776 00000100:00100000:0.0:1788837924.223944:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:0.0:1788837924.223953:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134939776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837924.223968:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837924.224026:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134939776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837924.224032:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:0.0:1788837924.224094:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134939776:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788837924.224351:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788837924.802100:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837925.830346:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837926.275080:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134939904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837926.275154:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837926.275233:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134939904 00000100:00100000:3.0:1788837926.275242:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134939904 00000100:00100000:3.0:1788837926.275289:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:3.0:1788837926.275298:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134939904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837926.275333:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788837926.275376:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134939904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837926.275382:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:3.0:1788837926.275425:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134939904:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788837926.846005:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837927.871292:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837928.323025:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729134940160:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323101:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837928.323137:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134940672:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837928.323181:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134941184:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837928.323241:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788837928.323248:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134940288:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837928.323289:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134940800:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323316:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837928.323334:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134941312:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323356:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837928.323390:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134940160 00000100:00100000:2.0:1788837928.323397:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134940160 00000100:00100000:2.0:1788837928.323449:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134940288 00000100:00100000:2.0:1788837928.323453:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134940288 00000100:00100000:2.0:1788837928.323490:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1788837928.323499:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729134940160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323552:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729134940160:12345-0@lo:400:kworker.0 Request processed in 54us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.323560:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1788837928.323576:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1788837928.323582:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134940288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323609:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134940288:12345-0@lo:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.323616:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1788837928.323635:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134940672 00000100:00100000:2.0:1788837928.323639:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134940672 00000100:00100000:2.0:1788837928.323663:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134941184 00000100:00100000:2.0:1788837928.323666:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134941184 00000100:00100000:2.0:1788837928.323684:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:2.0:1788837928.323690:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134940672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323735:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134940672:12345-0@lo:400:kworker.0 Request processed in 45us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.323742:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:2.0:1788837928.323754:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:2.0:1788837928.323760:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134941184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323786:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134941184:12345-0@lo:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.323792:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:2.0:1788837928.323843:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134940800 00000100:00100000:2.0:1788837928.323847:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134940800 00000100:00100000:2.0:1788837928.323872:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134941312 00000100:00100000:2.0:1788837928.323875:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134941312 00000100:00100000:2.0:1788837928.323895:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395 00000100:00100000:2.0:1788837928.323902:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134940800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323933:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134940800:12345-0@lo:400:kworker.0 Request processed in 32us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.323939:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395 00000100:00100000:2.0:1788837928.323951:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:2.0:1788837928.323957:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134941312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.323984:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134941312:12345-0@lo:400:kworker.0 Request processed in 27us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.323990:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 00000100:00080000:2.0:1788837928.324008:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837928.324012:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837928.324014:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837928.324062:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134940288:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.324086:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134940800:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.324096:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134941312:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.324106:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729134940160:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.324116:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134940672:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.324125:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134941184:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.324275:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729134940416:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.324308:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837928.324347:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134940928:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.324372:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837928.324391:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134941440:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.324413:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837928.324433:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788837928.324439:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134940032:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.324462:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837928.324499:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729134940544:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.324518:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837928.324535:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729134941056:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.324552:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837928.324564:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729134941568:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.324582:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837928.324605:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134940928 00000100:00100000:0.0:1788837928.324608:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134940928 00000100:00100000:0.0:1788837928.324733:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134941440 00000100:00100000:0.0:1788837928.324737:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134941440 00000100:00100000:0.0:1788837928.324760:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:0.0:1788837928.324766:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134940928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.324827:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134940928:12345-0@lo:400:kworker.0 Request processed in 61us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.324834:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00100000:0.0:1788837928.324848:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:0.0:1788837928.324854:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6334a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134941440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.324880:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6334a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134941440:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.324895:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:0.0:1788837928.324932:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134940032 00000100:00100000:0.0:1788837928.324935:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134940032 00000100:00100000:0.0:1788837928.324962:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788837928.324968:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729134940032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325000:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729134940032:12345-0@lo:400:kworker.0 Request processed in 32us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.325007:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788837928.325034:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134940416 00000100:00100000:0.0:1788837928.325037:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134940416 00000100:00100000:0.0:1788837928.325058:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134940544 00000100:00100000:0.0:1788837928.325060:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134940544 00000100:00100000:0.0:1788837928.325075:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134941056 00000100:00100000:0.0:1788837928.325077:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134941056 00000100:00100000:0.0:1788837928.325085:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134941568 00000100:00100000:0.0:1788837928.325087:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134941568 00000100:00100000:0.0:1788837928.325098:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1788837928.325102:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729134940416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325132:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729134940416:12345-0@lo:400:kworker.0 Request processed in 28us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.325138:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1788837928.325150:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1788837928.325156:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6334a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729134940544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325181:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6334a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729134940544:12345-0@lo:400:kworker.0 Request processed in 26us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.325186:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1788837928.325197:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1788837928.325209:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6334a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729134941056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325237:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6334a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729134941056:12345-0@lo:400:kworker.0 Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.325243:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1788837928.325255:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1788837928.325260:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6334a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729134941568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325286:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6334a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729134941568:12345-0@lo:400:kworker.0 Request processed in 26us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.325291:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00080000:0.0:1788837928.325320:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788837928.325324:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837928.325326:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837928.325350:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134940032:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325362:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729134940544:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325371:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729134941056:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325380:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729134941568:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325389:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729134940416:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325399:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134940928:0@lo:400:kworker.0 00000100:00100000:0.0:1788837928.325408:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134941440:0@lo:400:kworker.0 00000100:00100000:2.0:1788837928.518521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837928.518643:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837928.518682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837928.518714:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837928.518775:0:83324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116366720 00000100:00100000:3.0:1788837928.518792:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116367104 00000100:00100000:1.0:1788837928.518819:0:83324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116366720 00000100:00100000:3.0:1788837928.518820:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116367104 00000100:00100000:3.0:1788837928.518870:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2399 00000100:00100000:3.0:1788837928.518880:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116367104:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788837928.518881:0:83324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:1.0:1788837928.518888:0:83324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2407:x1875729116366720:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788837928.518951:0:83324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2407:x1875729116366720:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 63us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837928.518958:0:83324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:3.0:1788837928.522994:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116367104:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 4099us (4334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837928.523034:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2399 00000100:00100000:0.0:1788837928.523153:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116366848 00000100:00100000:0.0:1788837928.523163:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116366848 00000100:00100000:0.0:1788837928.523229:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116366976 00000100:00100000:0.0:1788837928.523233:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116366976 00000100:00100000:2.0:1788837928.523241:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837928.523281:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1013 00000100:00100000:2.0:1788837928.523298:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1014 00000100:00100000:0.0:1788837928.523302:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116366848:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837928.523314:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116366976:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837928.523368:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116366976:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 61us (4653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.523375:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1014 00000100:00100000:2.0:1788837928.523400:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116367232 00000100:00100000:2.0:1788837928.523404:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116367232 00000100:00100000:2.0:1788837928.523436:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2400 00000100:00100000:2.0:1788837928.523443:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116367232:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837928.523760:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116366848:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 460us (5245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837928.523768:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1013 00000100:00080000:0.0:1788837928.523792:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837928.523900:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788837928.523903:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837928.523905:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837928.526528:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116367232:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3072us (3277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.526545:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2400 00000004:00080000:2.0:1788837928.829322:0:83337:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3322848521928ns, next at 3323848518471ns, rc = 0 00000100:00100000:2.0:1788837928.829365:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134941696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837928.829434:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837928.829532:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134941696 00000100:00100000:2.0:1788837928.829539:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134941696 00000100:00100000:2.0:1788837928.829587:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:2.0:1788837928.829596:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134941696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837928.829766:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837928.831461:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134941696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1841us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.831486:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00100000:2.0:1788837928.831564:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134941696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837928.831655:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134941824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837928.831716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837928.831876:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134941824 00000100:00100000:3.0:1788837928.831883:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134941824 00000100:00100000:3.0:1788837928.831922:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:3.0:1788837928.831931:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134941824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788837928.831960:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837928.832007:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134941824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837928.832049:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134941824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837928.834378:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000001:00080000:1.0:1788837928.837336:0:83317:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247809 is committed 00000004:00080000:1.0:1788837928.837353:0:83317:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788837928.837575:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837928.837608:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60753dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134941952:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788837928.837687:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837928.837893:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134941952 00000100:00100000:3.0:1788837928.837901:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134941952 00000100:00100000:3.0:1788837928.837968:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5909 00000100:00100000:3.0:1788837928.837980:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134941952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788837928.838127:0:26208:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:674 count 1 00010000:00010000:3.0:1788837928.838163:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.838191:0:26208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee414dfb/0x88da08396ccc7809 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb4f expref: 5 pid: 26206 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.838200:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=217s v=(0 0) 00010000:00010000:3.0:1788837928.838205:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788837928.838210:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.838271:0:26208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee414dfb/0x88da08396ccc7809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb4f expref: 5 pid: 26206 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837928.838288:0:26208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee414dfb/0x88da08396ccc7809 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb4f expref: 5 pid: 26206 timeout: 3422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837928.838301:0:26208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60753d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26208:1875729134942080:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788837928.838389:0:26208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60820f900 going to sleep for 11 seconds 00010000:00010000:2.0:1788837928.839666:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.839687:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.839696:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.839703:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6082a4200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788837928.839709:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.839717:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.839758:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff8ff612676500) 00010000:00010000:2.0:1788837928.839761:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837928.839767:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.839774:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6082a4200/0x88da08396ccc7c54 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837928.844161:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837928.844453:0:26208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60753d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26208:1875729134942080:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788837928.844492:0:26208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837928.844592:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116367360 00000100:00100000:1.0:1788837928.844658:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116367360 00010000:00010000:1.0:1788837928.844701:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee414dfb/0x88da08396ccc7809 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb4f expref: 6 pid: 26206 timeout: 3422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837928.844742:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2535 00000100:00100000:1.0:1788837928.844752:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116367360:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788837928.844766:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837928.844771:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee414dfb/0x88da08396ccc7809 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb4f expref: 6 pid: 26206 timeout: 3422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.844784:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee414dfb/0x88da08396ccc7809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb4f expref: 6 pid: 26206 timeout: 3422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.844830:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee414dfb/0x88da08396ccc7809 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb4f expref: 6 pid: 26206 timeout: 3422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.844865:0:6532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837928.844870:0:6532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837928.844875:0:6532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.844885:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837928.845165:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837928.845246:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116367360:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 493us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837928.845255:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2535 00010000:00010000:0.0:1788837928.850486:0:26208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.850511:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.850527:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.850536:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837928.850627:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788837928.850908:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134941952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12926us (13216us total) trans 4294969448 rc 0/0 00000100:00100000:0.0:1788837928.850924:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5909 00000004:00080000:3.0:1788837928.851371:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ff60753dc00/2, rc 0, transno 4294969448 00000100:00100000:3.0:1788837928.851379:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60753dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134941952:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788837928.852726:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837928.852739:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.852752:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837928.852757:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.852768:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.853463:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.853487:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc7c69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837928.853515:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837928.853542:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837928.853544:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837928.893050:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837929.341335:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60753d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134942208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837929.341403:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837929.341610:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134942208 00000100:00100000:3.0:1788837929.341628:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134942208 00000100:00100000:3.0:1788837929.341694:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:3.0:1788837929.341705:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134942208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837929.341741:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:3.0:1788837929.341824:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134942208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837929.341830:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000100:00100000:1.0:1788837929.342751:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60753d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134942208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837929.342968:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134942336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837929.343021:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837929.343368:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134942336 00000100:00100000:3.0:1788837929.343381:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134942336 00000100:00100000:3.0:1788837929.343435:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:3.0:1788837929.343443:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6334a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134942336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837929.343481:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837929.343547:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6334a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134942336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837929.343554:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00100000:1.0:1788837929.343786:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134942336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837929.345056:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837929.345078:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134942464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837929.345144:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837929.345570:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134942464 00000100:00100000:3.0:1788837929.345578:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134942464 00000100:00100000:3.0:1788837929.345646:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:3.0:1788837929.345656:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134942464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788837929.345680:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837929.345763:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134942464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837929.345778:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:1.0:1788837929.346015:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134942464:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788837929.920111:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788837930.539143:0:84047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 23:25:29 (1788837929) 00010000:00010000:1.0:1788837930.942310:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837931.389842:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837931.389878:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134942592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837931.390007:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837931.390215:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134942592 00000100:00100000:2.0:1788837931.390231:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134942592 00000100:00100000:2.0:1788837931.390489:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:2.0:1788837931.390503:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134942592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837931.390552:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788837931.390628:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134942592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837931.390637:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:1.0:1788837931.390728:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134942592:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1788837931.582742:0:83317:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788837931.591256:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969448 is committed 00000100:00100000:1.0:1788837931.702486:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837931.702949:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116367488 00000100:00100000:3.0:1788837931.702959:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116367488 00000100:00100000:3.0:1788837931.703027:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1021 00000100:00100000:3.0:1788837931.703038:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:64800:x1875729116367488:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788837931.703057:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837931.703079:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cb80 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.703150:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7c77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.703164:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.703194:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837931.703244:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788837931.703248:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1788837931.703268:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788837931.704601:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788837931.705465:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb80 expref: 7 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.705505:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb80 expref: 6 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.705514:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff50a140400) 00010000:00010000:3.0:1788837931.705517:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837931.705521:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f5200, rc 0) 00000100:00100000:3.0:1788837931.706272:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64800:x1875729116367488:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 3229us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837931.706283:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1021 00000100:00100000:0.0:1788837931.713352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837931.715907:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116367616 00000100:00100000:3.0:1788837931.715923:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116367616 00000100:00100000:3.0:1788837931.717627:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1022 00000100:00100000:3.0:1788837931.717649:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64800:x1875729116367616:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788837931.717694:0:66254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:3.0:1788837931.717768:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64800:x1875729116367616:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 129us (4427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837931.717785:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1022 00000100:00100000:1.0:1788837931.723791:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837931.724683:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116367744 00000100:00100000:3.0:1788837931.724697:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116367744 00000100:00100000:3.0:1788837931.724779:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1023 00000100:00100000:3.0:1788837931.724791:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64800:x1875729116367744:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788837931.724843:0:76060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788837931.724912:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64800:x1875729116367744:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 124us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837931.724919:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1023 00000100:00080000:0.0:1788837931.725111:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837931.727725:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837931.737036:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116367872 00000100:00100000:0.0:1788837931.737049:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116367872 00000100:00100000:0.0:1788837931.737150:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1874 00000100:00100000:0.0:1788837931.737162:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:64800:x1875729116367872:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:0.0:1788837931.737196:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837931.737269:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:64800:x1875729116367872:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 109us (9551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837931.737276:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1874 00000100:00080000:3.0:1788837931.737658:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837931.740953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837931.741055:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116368000 00000100:00100000:2.0:1788837931.741066:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116368000 00000100:00100000:2.0:1788837931.741119:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1875 00000100:00100000:2.0:1788837931.741129:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:64800:x1875729116368000:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788837931.741160:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837931.741223:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:64800:x1875729116368000:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 95us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837931.741231:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1875 00000100:00080000:3.0:1788837931.741419:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837931.803490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837931.803596:0:66262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116368128 00000100:00100000:0.0:1788837931.803607:0:66262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116368128 00000100:00100000:0.0:1788837931.803658:0:66262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:0.0:1788837931.803668:0:66262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64807:x1875729116368128:12345-192.168.203.30@tcp:700:mcreate.0 00000100:00100000:0.0:1788837931.803754:0:66262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64807:x1875729116368128:12345-192.168.203.30@tcp:700:mcreate.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837931.803762:0:66262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1788837931.806216:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837931.806430:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116368384 00000100:00100000:3.0:1788837931.806456:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116368384 00000100:00100000:3.0:1788837931.806547:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1024 00000100:00100000:3.0:1788837931.806561:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64807:x1875729116368384:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00010000:3.0:1788837931.806644:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837931.806680:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7c77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb80 expref: 6 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.806703:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff50a140400) 00010000:00010000:3.0:1788837931.806722:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837931.806834:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.806850:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.806883:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.806902:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.806910:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.806918:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.807870:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.807886:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c7e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.807894:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.807901:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837931.807906:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.807914:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c7e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.808678:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff50a140200) 00010000:00010000:3.0:1788837931.808686:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837931.808692:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c7e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.808717:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7c7e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837931.808748:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000861467e4 reply state 00000000f8470e6d transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.808762:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.808770:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50a140500) 00010000:00010000:3.0:1788837931.808773:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788837931.808776:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788837931.809650:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:64807:x1875729116368384:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 2752us (3102us total) trans 98784247810 rc 0/0 00000100:00100000:3.0:1788837931.809667:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1024 00000100:00100000:3.0:1788837931.826679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837931.827509:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116368512 00000100:00100000:0.0:1788837931.827525:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116368512 00000100:00100000:0.0:1788837931.827614:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1025 00000100:00100000:0.0:1788837931.827625:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:64810:x1875729116368512:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1788837931.827654:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837931.827676:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7c8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cb87 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.827767:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9000/0x88da08396ccc7c93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.827782:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9000/0x88da08396ccc7c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.827794:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9000/0x88da08396ccc7c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837931.827877:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788837931.827882:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1788837931.827909:0:66255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9000/0x88da08396ccc7c93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.827935:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7c8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb87 expref: 9 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.827956:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9000/0x88da08396ccc7c93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb87 expref: 8 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.827964:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61d6b9500) 00010000:00010000:0.0:1788837931.827966:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788837931.827970:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9000, rc 0) 00000100:00100000:0.0:1788837931.828047:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:64810:x1875729116368512:12345-192.168.203.30@tcp:101:rm.0 Request processed in 423us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837931.828054:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1025 00000100:00100000:2.0:1788837931.837071:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837931.837238:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116368640 00000100:00100000:3.0:1788837931.837248:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116368640 00000100:00100000:3.0:1788837931.837315:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1026 00000100:00100000:3.0:1788837931.837326:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:64810:x1875729116368640:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1788837931.837348:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837931.837368:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7c9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cb8e expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837431:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837445:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837474:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837488:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7ca8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837496:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837503:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837593:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4e00/0x88da08396ccc7caf lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837601:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4e00/0x88da08396ccc7caf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837609:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4e00/0x88da08396ccc7caf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837931.837651:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x1:0x0]: returning size 0 00000004:00200000:3.0:1788837931.837655:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1788837931.837678:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4e00/0x88da08396ccc7caf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837690:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4e00/0x88da08396ccc7caf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837698:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837714:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837720:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837725:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837731:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837931.837735:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837744:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837758:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61d6b9500) 00010000:00010000:3.0:1788837931.837761:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837931.837765:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837771:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7ca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837784:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837790:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837821:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837833:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837931.837837:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837843:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837851:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50a140500) 00010000:00010000:3.0:1788837931.837854:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837931.837857:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7ca8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837863:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7ca8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837890:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb8e expref: 10 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837903:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4e00/0x88da08396ccc7caf lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb8e expref: 9 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837931.837910:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff8ff50a140200) 00010000:00010000:3.0:1788837931.837912:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837931.837915:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f4e00, rc 0) 00000100:00100000:3.0:1788837931.837986:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:64810:x1875729116368640:12345-192.168.203.30@tcp:101:rm.0 Request processed in 662us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837931.837993:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1026 00000100:00100000:3.0:1788837931.841326:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837931.841406:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116368896 00000100:00100000:0.0:1788837931.841417:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116368896 00000100:00100000:0.0:1788837931.841490:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1027 00000100:00100000:0.0:1788837931.841502:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:64810:x1875729116368896:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:0.0:1788837931.841556:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788837931.841597:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4e00/0x88da08396ccc7caf lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb8e expref: 9 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.841615:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff8ff50a140200) 00010000:00010000:0.0:1788837931.841632:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9000/0x88da08396ccc7c93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb87 expref: 8 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.841643:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61d6b9500) 00010000:00010000:0.0:1788837931.841652:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788837931.841676:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.841689:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.841699:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.841710:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.841718:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.841725:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.841851:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccc7cc4 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.841861:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccc7cc4 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.841867:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccc7cc4 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842039:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842048:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842055:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842062:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842068:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842073:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842096:0:66253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837931.842113:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccc7cc4 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842120:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccc7cc4 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842133:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccc7cc4 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842139:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788837931.842143:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccc7cc4 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842150:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccc7cc4 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842159:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff8ff61d6b9700) 00010000:00010000:0.0:1788837931.842162:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788837931.842166:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccc7cc4 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842172:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccc7cc4 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842186:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842192:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842196:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842201:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842205:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788837931.842214:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842219:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842227:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61d6b9800) 00010000:00010000:0.0:1788837931.842229:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837931.842232:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842237:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc7cb6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788837931.842249:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000788855ae reply state 000000008e5a17c6 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842258:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837931.842265:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50a140500) 00010000:00010000:0.0:1788837931.842267:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788837931.842269:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788837931.842334:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788837931.842339:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:64810:x1875729116368896:12345-192.168.203.30@tcp:36:rm.0 Request processed in 838us (1020us total) trans 98784247811 rc 0/0 00010000:00010000:1.0:1788837931.842343:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837931.842353:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1027 00010000:00010000:1.0:1788837931.842356:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837931.842361:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837931.842369:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837931.842381:0:63563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff8ff61d6b9700) 00010000:00010000:1.0:1788837931.842384:0:63563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788837931.842387:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837931.842394:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc7ccb lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837931.842412:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837931.842414:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837931.842416:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837931.965100:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837933.001544:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837933.437038:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134942720:0@lo:400:kworker.0 00000100:00100000:0.0:1788837933.437038:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729134942848:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.440764:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.440944:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837933.440958:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134943232:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441014:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837933.441040:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729134942976:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441043:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729134943104:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.441102:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134943744:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441122:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.441138:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729134944256:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441156:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.441172:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788837933.441176:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134943616:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441200:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.441217:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134944128:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441238:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.441270:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134943616 00000100:00100000:2.0:1788837933.441277:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134943616 00000100:00100000:1.0:1788837933.441285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837933.441314:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134943488:0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.441343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.441344:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134944128 00000100:00100000:2.0:1788837933.441349:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134944128 00000100:00100000:1.0:1788837933.441370:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134944000:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441376:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134943488 00000100:00100000:2.0:1788837933.441381:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134943488 00000100:00100000:1.0:1788837933.441404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.441408:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401 00000100:00100000:2.0:1788837933.441418:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134943616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.441430:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788837933.441453:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134943360:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441490:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134943616:12345-0@lo:400:kworker.0 Request processed in 73us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.441497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.441505:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401 00000100:00100000:2.0:1788837933.441523:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134944000 00000100:00100000:2.0:1788837933.441527:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134944000 00000100:00100000:1.0:1788837933.441527:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134943872:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441555:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:1.0:1788837933.441561:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.441567:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134944128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.441600:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134943360 00000100:00100000:1.0:1788837933.441605:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134943360 00000100:00100000:2.0:1788837933.441612:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134944128:12345-0@lo:400:kworker.0 Request processed in 47us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837933.441620:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00100000:2.0:1788837933.441635:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403 00000100:00100000:1.0:1788837933.441639:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134943872 00000100:00100000:2.0:1788837933.441644:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134943488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.441644:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134943872 00000100:00100000:1.0:1788837933.441674:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:2.0:1788837933.441684:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134943488:12345-0@lo:400:kworker.0 Request processed in 42us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837933.441691:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403 00000100:00100000:2.0:1788837933.441703:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:2.0:1788837933.441710:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134944000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.441736:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134944000:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837933.441742:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1788837933.441749:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729134943360:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788837933.441767:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff63956bb80 x1875729134943360/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1788837944 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837933.441778:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:2.0:1788837933.441787:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134943872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.441831:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729134943360:12345-0@lo:400:kworker.0 Request processed in 87us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837933.441860:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134943872:12345-0@lo:400:kworker.0 Request processed in 74us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.441903:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00000100:00100000:1.0:1788837933.441945:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134943360:0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.441954:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134943872:0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.441972:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134943488:0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.441982:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134944000:0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.442035:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134943232 00000100:00100000:1.0:1788837933.442039:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134943232 00000100:00100000:1.0:1788837933.442155:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134943104 00000100:00100000:1.0:1788837933.442159:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134943104 00000100:00100000:1.0:1788837933.442177:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134943744 00000100:00100000:1.0:1788837933.442179:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134943744 00000100:00100000:1.0:1788837933.442189:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134944256 00000100:00100000:1.0:1788837933.442191:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134944256 00000100:00100000:1.0:1788837933.442201:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134942976 00000100:00100000:1.0:1788837933.442204:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134942976 00000100:00100000:1.0:1788837933.442217:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:1.0:1788837933.442223:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134943232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.442261:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134943232:12345-0@lo:400:kworker.0 Request processed in 38us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.442267:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:1.0:1788837933.442279:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1788837933.442284:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729134943104:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788837933.442296:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640ef0a80 x1875729134943104/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1788837944 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837933.442323:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729134943104:12345-0@lo:400:kworker.0 Request processed in 38us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.442328:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1788837933.442339:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1788837933.442344:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729134943744:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788837933.442366:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640ef2a00 x1875729134943744/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1788837944 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837933.442393:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729134943744:12345-0@lo:400:kworker.0 Request processed in 49us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.442400:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1788837933.442412:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1788837933.442418:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729134944256:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788837933.442428:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640ef3480 x1875729134944256/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1788837944 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837933.442468:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729134944256:12345-0@lo:400:kworker.0 Request processed in 50us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.442475:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1788837933.442486:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:1.0:1788837933.442491:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729134942976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.442523:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729134942976:12345-0@lo:400:kworker.0 Request processed in 32us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.442529:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:1.0:1788837933.442562:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729134942976:0@lo:400:kworker.0 00000100:00080000:1.0:1788837933.442633:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837933.442637:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837933.442639:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837933.442642:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837933.442756:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134943616:0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.442772:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000004:00080000:1.0:1788837933.442776:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ff60753dc00, transno 4294969448 00000100:00100000:1.0:1788837933.442823:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134944128:0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.442840:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134943744:0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.442937:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729134944256:0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.442950:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134943232:0@lo:400:kworker.0 00000100:00100000:1.0:1788837933.442960:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729134943104:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.443748:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:00100000:3.0:1788837933.444672:0:83323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134942720 00000100:00100000:3.0:1788837933.444683:0:83323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134942720 00000100:00100000:0.0:1788837933.446848:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837933.447017:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134942848 00000100:00100000:3.0:1788837933.447026:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134942848 00000100:00100000:3.0:1788837933.447095:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:3.0:1788837933.447105:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729134942848:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788837933.447130:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640e56680 x1875729134942848/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:589/0 lens 224/224 e 0 to 0 dl 1788837944 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837933.447189:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729134942848:12345-0@lo:400:kworker.0 Request processed in 86us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837933.447197:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00080000:0.0:1788837933.448883:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837933.449156:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729134942848:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.450046:0:83323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788837933.450062:0:83323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729134942720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.450164:0:83323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729134942720:12345-0@lo:400:kworker.0 Request processed in 108us (9409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837933.450171:0:83323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788837933.451072:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134942720:0@lo:400:kworker.0 00000100:00100000:2.0:1788837933.633219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837933.633407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837933.633475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837933.633513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837933.633541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837933.633625:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116369536 00000100:00100000:3.0:1788837933.633636:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116369536 00000100:00100000:3.0:1788837933.633698:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116369408 00000100:00100000:3.0:1788837933.633702:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116369408 00000100:00100000:3.0:1788837933.633722:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2405 00000100:00100000:3.0:1788837933.633732:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116369536:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837933.633826:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116369536:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837933.633834:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2405 00000100:00100000:3.0:1788837933.633851:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2406 00000100:00100000:3.0:1788837933.633858:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116369408:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837933.633886:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116369408:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837933.633893:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2406 00000100:00100000:0.0:1788837933.636615:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116369280 00000100:00100000:0.0:1788837933.636634:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116369280 00000100:00100000:0.0:1788837933.636714:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116369152 00000100:00100000:0.0:1788837933.636718:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116369152 00000100:00100000:0.0:1788837933.636754:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1021 00000100:00100000:0.0:1788837933.636764:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116369280:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837933.636877:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116369280:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 115us (3469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837933.636885:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1021 00000100:00100000:0.0:1788837933.636904:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1022 00000100:00100000:0.0:1788837933.636923:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:2407:x1875729116369152:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000080:0.0:1788837933.636942:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff627d29880 x1875729116369152/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:589/0 lens 224/224 e 0 to 0 dl 1788837944 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837933.636968:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:2407:x1875729116369152:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 58us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837933.636974:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1022 00000100:00080000:2.0:1788837933.637836:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788837933.637843:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837933.637846:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837933.637849:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837933.639463:0:83324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116369024 00000100:00100000:1.0:1788837933.639477:0:83324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116369024 00000100:00100000:1.0:1788837933.639547:0:83324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:1.0:1788837933.639557:0:83324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2407:x1875729116369024:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788837933.639640:0:83324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2407:x1875729116369024:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 84us (6430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837933.639647:0:83324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:3.0:1788837933.949150:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134944384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837933.949243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837933.949409:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134944512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837933.949451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837933.949703:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134944384 00000100:00100000:2.0:1788837933.949712:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134944384 00000100:00100000:2.0:1788837933.949764:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134944512 00000100:00100000:2.0:1788837933.949767:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134944512 00000100:00100000:2.0:1788837933.949786:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1788837933.949794:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134944384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837933.949869:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837933.950080:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134944384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 285us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837933.950088:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1788837933.950105:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:2.0:1788837933.950112:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134944512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837933.950127:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837933.953406:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134944384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837933.953876:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134944512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3762us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837933.953887:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00100000:0.0:1788837933.954131:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134944512:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788837934.019015:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837934.464121:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134944640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837934.464190:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837934.464247:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837934.464253:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134944768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837934.464277:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837934.464325:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134944640 00000100:00100000:3.0:1788837934.464333:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134944640 00000100:00100000:3.0:1788837934.464379:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:2.0:1788837934.466599:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134944896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837934.466669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837934.466727:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134944896 00000100:00100000:2.0:1788837934.466733:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134944896 00000100:00100000:2.0:1788837934.466769:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1788837934.466790:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134944896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837934.466829:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837934.466875:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134944896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837934.466882:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1788837934.466925:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134944896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837934.466965:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134944768 00000100:00100000:2.0:1788837934.466969:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134944768 00000100:00100000:2.0:1788837934.466997:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:2.0:1788837934.467003:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134944768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788837934.467026:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00010000:00000080:2.0:1788837934.467038:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff624ebc000 x1875729134944768/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:590/0 lens 224/368 e 0 to 0 dl 1788837945 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837934.467071:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134944768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837934.467077:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00100000:2.0:1788837934.467120:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134944768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837934.467936:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134944640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837934.467969:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837934.468053:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134944640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3665us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837934.468062:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000100:00100000:2.0:1788837934.469812:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134944640:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788837935.040390:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837936.063168:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837936.510063:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788837936.510098:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134945024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837936.510182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837936.510717:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134945024 00000100:00100000:2.0:1788837936.510728:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134945024 00000100:00100000:2.0:1788837936.510814:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:2.0:1788837936.510825:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134945024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788837936.510863:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788837936.510933:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134945024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837936.510949:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000100:00100000:0.0:1788837936.513940:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134945024:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788837937.090741:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837938.123236:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788837938.180277:0:83317:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247811 is committed 00010000:00010000:3.0:1788837938.182884:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.182902:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.182910:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.182916:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837938.182921:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.182940:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.185809:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50a140500) 00010000:00010000:3.0:1788837938.185819:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837938.185827:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.185836:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7c85 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.185862:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.185868:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.185874:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.185879:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837938.185883:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.185890:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.185898:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50a140500) 00010000:00010000:3.0:1788837938.185901:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837938.185904:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837938.185932:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc7cbd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837938.567720:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729134945536:0@lo:400:kworker.0 00000100:00100000:2.0:1788837938.567861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837938.567916:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837938.567922:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729134945408:0@lo:400:kworker.0 00000100:00100000:2.0:1788837938.567946:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837938.567994:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134945536 00000100:00100000:2.0:1788837938.568001:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134945536 00000100:00100000:2.0:1788837938.568061:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134945408 00000100:00100000:2.0:1788837938.568064:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134945408 00000100:00100000:2.0:1788837938.568087:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1788837938.568097:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729134945536:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788837938.568120:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff609dd7800 x1875729134945536/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:594/0 lens 224/224 e 0 to 0 dl 1788837949 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837938.568174:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729134945536:12345-0@lo:400:kworker.0 Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837938.568181:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1788837938.568199:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1788837938.568206:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729134945408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837938.568234:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729134945408:12345-0@lo:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837938.568240:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00080000:2.0:1788837938.568260:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837938.568264:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788837938.568292:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729134945408:0@lo:400:kworker.0 00000100:00100000:2.0:1788837938.568303:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729134945536:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569366:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729134945280:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569432:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.569469:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134945792:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.569516:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134946304:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.569596:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788837938.569603:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134945152:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569634:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.569663:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134945664:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569687:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.569705:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134946176:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.569745:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729134946688:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.569815:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134945920:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.569863:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134946432:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569887:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.569907:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788837938.569913:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134946048:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.569951:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134946560:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.569973:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837938.570005:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134945280 00000100:00100000:0.0:1788837938.570011:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134945280 00000100:00100000:0.0:1788837938.570048:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134945664 00000100:00100000:0.0:1788837938.570057:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134945664 00000100:00100000:0.0:1788837938.570073:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134946176 00000100:00100000:0.0:1788837938.570076:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134946176 00000100:00100000:0.0:1788837938.570086:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134946688 00000100:00100000:0.0:1788837938.570089:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134946688 00000100:00100000:0.0:1788837938.570101:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1788837938.570109:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729134945280:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788837938.570131:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504f06a00 x1875729134945280/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:594/0 lens 224/224 e 0 to 0 dl 1788837949 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837938.570502:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134945792 00000100:00100000:2.0:1788837938.570508:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134945792 00000100:00100000:2.0:1788837938.570536:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134946304 00000100:00100000:2.0:1788837938.570549:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134946304 00000100:00100000:2.0:1788837938.570569:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:2.0:1788837938.570576:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134945792:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788837938.570591:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504ff8000 x1875729134945792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:594/0 lens 224/224 e 0 to 0 dl 1788837949 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837938.570648:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729134945280:12345-0@lo:400:kworker.0 Request processed in 539us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837938.570656:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1788837938.570674:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1788837938.570680:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134945664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837938.573018:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134945792:12345-0@lo:400:kworker.0 Request processed in 2432us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837938.573032:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00100000:2.0:1788837938.573081:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:2.0:1788837938.573094:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134946304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837938.573170:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134946304:12345-0@lo:400:kworker.0 Request processed in 70us (3592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837938.573176:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00080000:2.0:1788837938.573207:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837938.573212:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788837938.573498:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134945664:12345-0@lo:400:kworker.0 Request processed in 2815us (3807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837938.573507:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1788837938.573530:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1788837938.573538:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729134946176:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788837938.573631:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504d78a80 x1875729134946176/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:594/0 lens 224/224 e 0 to 0 dl 1788837949 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837938.573664:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729134946176:12345-0@lo:400:kworker.0 Request processed in 128us (3937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837938.573670:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1788837938.573681:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:0.0:1788837938.573687:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729134946688:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788837938.573712:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504d7a300 x1875729134946688/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:594/0 lens 224/224 e 0 to 0 dl 1788837949 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837938.573737:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729134946688:12345-0@lo:400:kworker.0 Request processed in 50us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837938.573742:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:0.0:1788837938.573776:0:83322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134945152 00000100:00100000:0.0:1788837938.573784:0:83322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134945152 00000100:00100000:1.0:1788837938.573862:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134945920 00000100:00100000:1.0:1788837938.573866:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134945920 00000100:00100000:1.0:1788837938.573903:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134946432 00000100:00100000:1.0:1788837938.573906:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134946432 00000100:00100000:1.0:1788837938.573923:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134946048 00000100:00100000:1.0:1788837938.573932:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134946048 00000100:00100000:1.0:1788837938.573953:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134946560 00000100:00100000:1.0:1788837938.573955:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134946560 00000100:00100000:1.0:1788837938.573973:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:1.0:1788837938.573979:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134945920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837938.574017:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134945920:12345-0@lo:400:kworker.0 Request processed in 39us (4173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837938.574023:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00100000:1.0:1788837938.574035:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408 00000100:00100000:1.0:1788837938.574040:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134946432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837938.574079:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134946432:12345-0@lo:400:kworker.0 Request processed in 39us (4191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837938.574085:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408 00000100:00100000:1.0:1788837938.574095:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409 00000100:00100000:1.0:1788837938.574101:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134946048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837938.574127:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134946048:12345-0@lo:400:kworker.0 Request processed in 26us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837938.574132:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409 00000100:00100000:1.0:1788837938.574144:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410 00000100:00100000:1.0:1788837938.574150:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134946560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837938.574316:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134946560:12345-0@lo:400:kworker.0 Request processed in 165us (4340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837938.574323:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410 00000100:00080000:2.0:1788837938.574416:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837938.574420:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837938.574735:0:83322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788837938.574746:0:83322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729134945152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.574784:0:83322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729134945152:12345-0@lo:400:kworker.0 Request processed in 42us (5149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837938.574791:0:83322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788837938.574884:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134946048:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.574897:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134946560:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.574908:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134945920:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.574918:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134946432:0@lo:400:kworker.0 00000100:00100000:3.0:1788837938.575008:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729134945280:0@lo:400:kworker.0 00000100:00100000:3.0:1788837938.575025:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134945792:0@lo:400:kworker.0 00000100:00100000:3.0:1788837938.575037:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134946304:0@lo:400:kworker.0 00000100:00100000:3.0:1788837938.575071:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134945152:0@lo:400:kworker.0 00000100:00100000:3.0:1788837938.575083:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134945664:0@lo:400:kworker.0 00000100:00100000:3.0:1788837938.575094:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134946176:0@lo:400:kworker.0 00000100:00100000:3.0:1788837938.575105:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729134946688:0@lo:400:kworker.0 00000100:00100000:0.0:1788837938.757996:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837938.758056:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837938.758193:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116369792 00000100:00100000:1.0:1788837938.758209:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116369792 00000100:00100000:1.0:1788837938.758285:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1029 00000100:00100000:1.0:1788837938.758295:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116369792:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000080:1.0:1788837938.758335:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504d79500 x1875729116369792/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:594/0 lens 224/224 e 0 to 0 dl 1788837949 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837938.758394:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116369792:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 100us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837938.758410:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1029 00000100:00100000:0.0:1788837938.760791:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837938.760853:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837938.760891:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837938.761558:0:83324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116369664 00000100:00100000:1.0:1788837938.761569:0:83324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116369664 00000100:00100000:1.0:1788837938.761625:0:83324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:1.0:1788837938.761635:0:83324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116369664:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788837938.761712:0:83324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116369664:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 78us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837938.761720:0:83324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:1.0:1788837938.762153:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116369920 00000100:00100000:1.0:1788837938.762158:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116369920 00000100:00100000:1.0:1788837938.762200:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1030 00000100:00100000:1.0:1788837938.762209:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116369920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788837938.762248:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116369920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 41us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837938.762256:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1030 00000100:00080000:3.0:1788837938.763665:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837938.763672:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837938.771137:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116370176 00000100:00100000:3.0:1788837938.771154:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116370176 00000100:00100000:2.0:1788837938.771592:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116370048 00000100:00100000:2.0:1788837938.771599:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116370048 00000100:00080000:2.0:1788837938.771653:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837938.771712:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2411 00000100:00100000:2.0:1788837938.771723:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116370048:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837938.771791:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2412 00000100:00080000:0.0:1788837938.771820:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837938.771825:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116370176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837938.772039:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116370176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 240us (11146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837938.772151:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116370048:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 430us (14103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837938.772167:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2411 00000100:00100000:3.0:1788837938.776502:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2412 00000100:00100000:0.0:1788837939.069630:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134946816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788837939.069703:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837939.069769:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134946816 00000100:00100000:2.0:1788837939.069778:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134946816 00000100:00100000:2.0:1788837939.069852:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1788837939.069862:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134946816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837939.069889:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837939.069945:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134946816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837939.069953:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:0.0:1788837939.070054:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134946816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837939.071407:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837939.071427:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134946944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837939.071490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837939.071695:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134946944 00000100:00100000:2.0:1788837939.071702:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134946944 00000100:00100000:2.0:1788837939.071759:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:2.0:1788837939.071768:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134946944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837939.071793:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837939.071855:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134946944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837939.071867:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00100000:1.0:1788837939.071908:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134946944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788837939.134150:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837939.582056:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134947072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837939.582145:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837939.582204:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134947072 00000100:00100000:1.0:1788837939.582211:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134947072 00000100:00100000:1.0:1788837939.582254:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:1.0:1788837939.582263:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134947072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788837939.582285:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837939.582327:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134947072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837939.582334:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:3.0:1788837939.582350:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134947200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837939.582377:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134947072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837939.582379:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837939.582447:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134947200 00000100:00100000:3.0:1788837939.582451:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134947200 00000100:00100000:3.0:1788837939.582484:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:3.0:1788837939.582491:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134947200:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837939.582498:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134947328:0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1788837939.582503:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837939.582529:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837939.582532:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134947200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837939.582539:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1788837939.582558:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134947328 00000100:00100000:0.0:1788837939.582562:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134947328 00000100:00100000:0.0:1788837939.582589:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:0.0:1788837939.582596:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134947328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788837939.582621:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00010000:00000080:0.0:1788837939.582637:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504d7b100 x1875729134947328/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:595/0 lens 224/368 e 0 to 0 dl 1788837950 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837939.582673:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134947328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837939.582679:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:0.0:1788837939.582709:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134947328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837939.582738:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134947200:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788837939.588235:0:84442:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788837939.689895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837939.690038:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116370304 00000100:00100000:2.0:1788837939.690048:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116370304 00000100:00100000:2.0:1788837939.690105:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1028 00000100:00100000:2.0:1788837939.690116:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:64877:x1875729116370304:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788837939.690140:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837939.690164:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7cd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cb95 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.690253:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc7cd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.690414:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc7cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.690430:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc7cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788837939.690478:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788837939.690481:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1788837939.690502:0:66255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc7cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.690528:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7cd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb95 expref: 7 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.690546:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc7cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb95 expref: 6 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.690554:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6082c8900) 00010000:00010000:2.0:1788837939.690557:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788837939.690560:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5c00, rc 0) 00010000:00000080:2.0:1788837939.690566:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504d79180 x1875729116370304/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:595/0 lens 576/688 e 0 to 0 dl 1788837950 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788837939.690724:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64877:x1875729116370304:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 609us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837939.690733:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1028 00000100:00100000:3.0:1788837939.698080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837939.698255:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116370432 00000100:00100000:1.0:1788837939.698275:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116370432 00000100:00100000:1.0:1788837939.698334:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1029 00000100:00100000:1.0:1788837939.698343:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60876d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64877:x1875729116370432:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788837939.698363:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837939.698383:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc7ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cb9c expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698455:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698469:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698481:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698496:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7cee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698509:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698515:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698554:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698562:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698567:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698573:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698578:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788837939.698593:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698601:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698612:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6082c8900) 00010000:00010000:1.0:1788837939.698614:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837939.698618:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698624:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d000/0x88da08396ccc7ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698640:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698646:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7cee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698651:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698655:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712da00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788837939.698658:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698662:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7cee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698669:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8ff64216ec00) 00010000:00010000:1.0:1788837939.698671:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837939.698673:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7cee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698678:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc7cee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698707:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc7ce0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb9c expref: 7 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698716:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6082c8900) 00010000:00010000:1.0:1788837939.698719:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837939.698727:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc7ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb9c expref: 7 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837939.698737:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d400, rc 0) 00010000:00000080:1.0:1788837939.698745:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff60876d050 x1875729116370432/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:595/0 lens 592/584 e 0 to 0 dl 1788837950 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788837939.698835:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60876d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64877:x1875729116370432:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 491us (763us total) trans 0 rc 301/301 00000100:00100000:1.0:1788837939.698842:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1029 00000100:00100000:1.0:1788837939.706186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837939.706262:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116370688 00000100:00100000:3.0:1788837939.706283:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116370688 00000100:00100000:3.0:1788837939.706341:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1030 00000100:00100000:3.0:1788837939.706350:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:64877:x1875729116370688:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788837939.706370:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837939.706373:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788837939.706404:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc7cd9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb95 expref: 6 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.706423:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6082c8900) 00010000:00010000:3.0:1788837939.706433:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788837939.706446:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7cf5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cba3 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.706539:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7cfc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.706552:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7cfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.706574:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7cfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.706598:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.706606:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.706613:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707019:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707029:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707035:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837939.707044:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788837939.707068:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7cfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707075:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7cfc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707082:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7cfc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707088:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837939.707099:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7cfc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707107:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7cfc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707116:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff50a140e00) 00010000:00010000:3.0:1788837939.707119:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837939.707123:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7cfc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707129:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f5200/0x88da08396ccc7cfc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788837939.707140:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abe525c0 reply state 00000000822a8aef transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707149:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707155:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8ff50a140a00) 00010000:00010000:3.0:1788837939.707157:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788837939.707159:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788837939.707185:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4800/0x88da08396ccc7cf5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 8 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707203:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 7 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.707210:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff8ff50a140700) 00010000:00010000:3.0:1788837939.707212:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788837939.707220:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f4000, rc 0) 00010000:00000080:3.0:1788837939.707229:0:75504:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff626a88e00 x1875729116370688/t98784247812(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:595/0 lens 536/608 e 0 to 0 dl 1788837950 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788837939.707299:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:64877:x1875729116370688:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 950us (1122us total) trans 98784247812 rc 0/0 00000100:00100000:3.0:1788837939.707306:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1030 00000100:00100000:3.0:1788837939.717313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837939.717410:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116370944 00000100:00100000:2.0:1788837939.717420:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116370944 00000100:00100000:2.0:1788837939.717490:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1031 00000100:00100000:2.0:1788837939.717501:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:64877:x1875729116370944:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788837939.717528:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837939.717552:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbaa expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.717673:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.717687:0:66255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 9 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.717695:0:66255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.717726:0:66255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 9 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837939.717740:0:66255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 9 pid: 75504 timeout: 3433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837939.717755:0:66255:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66255:1875729134947456:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788837939.717862:0:66255:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a316000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837939.724558:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837939.724688:0:66255:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66255:1875729134947456:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788837939.724714:0:66255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837939.729179:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116371072 00000100:00100000:3.0:1788837939.729194:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116371072 00010000:00010000:3.0:1788837939.729235:0:6531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 10 pid: 75504 timeout: 3433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837939.729349:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2536 00000100:00100000:3.0:1788837939.729361:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2405:x1875729116371072:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788837939.729376:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788837939.729383:0:6531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 10 pid: 75504 timeout: 3433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.729408:0:6531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 10 pid: 75504 timeout: 3433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.729435:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4000/0x88da08396ccc7d0a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 10 pid: 75504 timeout: 3433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.729451:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff8ff50a140700) 00010000:00010000:3.0:1788837939.729456:0:6531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.729480:0:6531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.729488:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837939.729526:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788837939.729589:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:2405:x1875729116371072:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 230us (5037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837939.729598:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2536 00010000:00010000:0.0:1788837939.731114:0:66255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837939.731128:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837939.731148:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788837939.731349:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837939.731368:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837939.731375:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837939.731381:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788837939.731386:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837939.731404:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837939.731420:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff8ff50a140700) 00010000:00010000:0.0:1788837939.731423:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788837939.731428:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837939.731434:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc7d1f lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837939.731496:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7d18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbaa expref: 9 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837939.731506:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6082c8a00) 00010000:00010000:0.0:1788837939.731508:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837939.731512:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbaa expref: 9 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837939.731524:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5800, rc 0) 00010000:00000080:0.0:1788837939.731541:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504f04700 x1875729116370944/t98784247813(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:595/0 lens 712/824 e 0 to 0 dl 1788837950 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788837939.731594:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:64877:x1875729116370944:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 14095us (14290us total) trans 98784247813 rc 301/301 00000100:00100000:0.0:1788837939.731603:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1031 00000100:00100000:3.0:1788837939.746003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837939.746452:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116371328 00000100:00100000:2.0:1788837939.746464:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116371328 00000100:00100000:2.0:1788837939.746525:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:2.0:1788837939.746535:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:64877:x1875729116371328:12345-192.168.203.30@tcp:35:lfs.0 00010000:00000080:2.0:1788837939.746736:0:66257:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504f05f80 x1875729116371328/t98784247814(0) o35->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:595/0 lens 392/456 e 0 to 0 dl 1788837950 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788837939.746831:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:64877:x1875729116371328:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 297us (837us total) trans 98784247814 rc 0/0 00000100:00100000:2.0:1788837939.746839:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:3.0:1788837939.752724:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837939.753917:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116371584 00000100:00100000:3.0:1788837939.754004:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116371584 00000100:00100000:3.0:1788837939.754058:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 215 00000100:00100000:3.0:1788837939.754069:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:64877:x1875729116371584:12345-192.168.203.30@tcp:35:lfs.0 00010000:00000080:3.0:1788837939.754244:0:66257:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504f06300 x1875729116371584/t98784247815(0) o35->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:595/0 lens 392/456 e 0 to 0 dl 1788837950 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788837939.754305:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:64877:x1875729116371584:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 238us (1590us total) trans 98784247815 rc 0/0 00000100:00100000:3.0:1788837939.754312:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 215 00010000:00010000:1.0:1788837940.157032:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837941.186305:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837941.632394:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788837941.632417:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134947584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837941.632485:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837941.632532:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134947584 00000100:00100000:1.0:1788837941.632539:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134947584 00000100:00100000:1.0:1788837941.632584:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:1.0:1788837941.632592:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134947584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788837941.632631:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:1.0:1788837941.632672:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134947584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837941.632680:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:1.0:1788837941.632724:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134947584:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1788837941.924559:0:84539:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788837941.924612:0:84539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.924627:0:84539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.924635:0:84539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.924643:0:84539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.924660:0:84539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788837941.924665:0:84539:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788837941.924691:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837941.924695:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788837941.924701:0:84539:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788837941.924725:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff503547800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788837941.925142:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837941.925150:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.925158:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6082a4600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788837941.925162:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.925170:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837941.925177:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837941.925182:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788837941.925184:0:6534:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788837941.925187:0:6534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788837941.925228:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.925235:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837941.925268:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.925275:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4600/0x88da08396ccc7928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc792f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.925285:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837941.925287:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837941.925288:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837941.925295:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837941.925324:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134947840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837941.925396:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837941.925452:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134947840 00000100:00100000:1.0:1788837941.925459:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134947840 00000100:00100000:1.0:1788837941.925500:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1788837941.925508:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729134947840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837941.925520:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837941.925533:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607460800/0x88da08396ccc792f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7928 expref: 24 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837941.925546:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837941.925578:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3645:x1875729134947840:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837941.925585:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1788837941.925620:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134947840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788837941.925752:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729134947712:0@lo:39:umount.0 00000100:00100000:3.0:1788837941.925785:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837941.928391:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134947712 00000100:00100000:1.0:1788837941.928405:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134947712 00000100:00100000:1.0:1788837941.928469:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1788837941.928478:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729134947712:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788837941.928505:0:76060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7a47 00000100:00080000:1.0:1788837941.928515:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff6104de800 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1788837941.928547:0:76060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504f05180 x1875729134947712/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:597/0 lens 224/224 e 0 to 0 dl 1788837952 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837941.928625:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1875729134947712:12345-0@lo:39:umount.0 Request processed in 148us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837941.928632:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000020:00000080:1.0:1788837941.928642:0:76060:0:(genops.c:885:class_export_put()) final put ffff8ff639712000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788837941.928678:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837941.928724:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff503547800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788837941.928734:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729134947712:0@lo:39:umount.0 00000020:00000080:1.0:1788837941.928771:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff639712000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788837941.928841:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6104de800 for lustre-MDT0000 00000100:00080000:2.0:1788837941.929928:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788837941.929934:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788837941.929940:0:84539:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788837941.930891:0:84539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.930921:0:84539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.930930:0:84539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.930937:0:84539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.930953:0:84539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788837941.930959:0:84539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.930966:0:84539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.930973:0:84539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.930979:0:84539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.930998:0:84539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788837941.931005:0:84539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931007:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837941.931012:0:84539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.931027:0:84539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.931033:0:84539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.931042:0:84539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788837941.931047:0:84539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.931053:0:84539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.931059:0:84539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.931066:0:84539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837941.931076:0:84539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788837941.931079:0:84539:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788837941.931082:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931090:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6082a4e00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788837941.931093:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931101:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837941.931108:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788837941.931109:0:84539:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788837941.931113:0:84539:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 10000000:01000000:0.0:1788837941.931114:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788837941.931116:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000020:00000080:2.0:1788837941.931117:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:0.0:1788837941.931118:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:02000400:2.0:1788837941.931121:0:84539:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1788837941.931151:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931157:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837941.931178:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931196:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4e00/0x88da08396ccc7848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc784f expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931209:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837941.931212:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931217:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6082a5400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788837941.931220:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931226:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837941.931231:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837941.931236:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788837941.931237:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788837941.931239:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788837941.931252:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931257:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837941.931263:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931269:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5400/0x88da08396ccc794b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7952 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931289:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837941.931292:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931298:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5fa00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788837941.931301:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.931308:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837941.931314:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837941.931320:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788837941.931322:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788837941.931324:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000004:00000080:2.0:1788837941.933005:0:84539:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:0.0:1788837941.933485:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.933497:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837941.933533:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.933541:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5fa00/0x88da08396ccc791a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7921 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.933561:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837941.933566:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.933590:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461a00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788837941.933594:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.933602:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788837941.933608:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837941.933614:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788837941.934243:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788837941.934248:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788837941.934282:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.934290:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788837941.934300:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.934306:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607461a00/0x88da08396ccc7833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7841 expref: -99 pid: 83316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.934318:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837941.934320:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837941.934322:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837941.934705:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134947968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837941.934774:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837941.934782:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837941.934787:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837941.935450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837941.935520:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788837941.935544:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134948096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837941.935579:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837941.936273:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134948352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837941.936312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837941.936414:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837941.936420:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134948224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837941.936445:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837941.936505:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134947968 00000100:00100000:0.0:1788837941.936513:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134947968 00000100:00100000:0.0:1788837941.936561:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134948096 00000100:00100000:0.0:1788837941.936565:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134948096 00000100:00100000:0.0:1788837941.936582:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134948352 00000100:00100000:0.0:1788837941.936585:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134948352 00000100:00100000:0.0:1788837941.936594:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134948224 00000100:00100000:0.0:1788837941.936597:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134948224 00000100:00100000:0.0:1788837941.936610:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1788837941.936698:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+26:3643:x1875729134947968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837941.936714:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837941.936733:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff6082a4800/0x88da08396ccc784f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7848 expref: 26 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.936752:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837941.936890:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+25:3643:x1875729134947968:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837941.936898:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1788837941.936920:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1788837941.937008:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729134948096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837941.937171:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837941.937189:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc7952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc794b expref: 24 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.937200:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837941.937225:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3643:x1875729134948096:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837941.937231:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1788837941.937245:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1788837941.937252:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3646:x1875729134948352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837941.937259:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837941.937268:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607460600/0x88da08396ccc7841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7833 expref: 22 pid: 83327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.937276:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837941.937302:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624eaf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3646:x1875729134948352:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837941.937308:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1788837941.937476:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1788837941.937482:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3646:x1875729134948224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788837941.937489:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788837941.937500:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff6082a5c00/0x88da08396ccc7921 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc791a expref: 20 pid: 83327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837941.937511:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788837941.937537:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+19:3646:x1875729134948224:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837941.937543:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000001:00080000:0.0:1788837941.937604:0:83317:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00010000:00010000:3.0:1788837941.938535:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.938547:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.938564:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.938570:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837941.938575:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.938583:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.938598:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8ff50a140a00) 00010000:00010000:3.0:1788837941.938601:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837941.938605:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837941.938611:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4400/0x88da08396ccc7d03 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837941.938735:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134948096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837941.938746:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134947968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837941.938866:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134948224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788837941.938876:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134948352:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788837941.939415:0:84539:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1788837941.939428:0:84539:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff6104d9800 fdcf066d-ff07-4b2e-96ab-52415ed6bf72 192.168.203.30@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 98784247815 stale:0 00000020:00080000:2.0:1788837941.939435:0:84539:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff639710000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788837941.939450:0:84539:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff50a9bd800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788837941.939454:0:84539:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff50a9ba800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788837941.939458:0:84539:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff632f53000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788837941.939464:0:84539:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8ff503ca19b8) has exports, disconnecting them 00000020:00080000:2.0:1788837941.939470:0:84539:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.30@tcp (ffff8ff6104d9800), last request at 1788837939 00000020:00000080:2.0:1788837941.939478:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7c15 00000100:00080000:2.0:1788837941.939486:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff6104df000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788837941.939507:0:84539:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff6104d9800): rc 0 00000020:00000080:2.0:1788837941.939509:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff6104d9800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00080000:2.0:1788837941.939519:0:84539:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff639710000), last request at 1788837731 00000020:00000080:2.0:1788837941.939522:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7a40 00000100:00080000:2.0:1788837941.939526:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff639717000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788837941.939533:0:84539:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff639710000): rc 0 00000020:00000080:2.0:1788837941.939534:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff639710000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788837941.939538:0:84539:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff50a9bd800), last request at 1788837938 00000020:00000080:2.0:1788837941.939540:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7a39 00000100:00080000:2.0:1788837941.939543:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff50a9bb000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788837941.939549:0:84539:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff50a9bd800): rc 0 00000020:00000080:2.0:1788837941.939551:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff50a9bd800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788837941.939554:0:84539:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff50a9ba800), last request at 1788837938 00000020:00000080:2.0:1788837941.939557:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7a32 00000100:00080000:2.0:1788837941.939568:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff50a9bc000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788837941.939599:0:84539:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff50a9ba800): rc 0 00000020:00000080:2.0:1788837941.939601:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff50a9ba800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788837941.939605:0:84539:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff632f53000), last request at 1788837726 00000020:00000080:2.0:1788837941.939608:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc789c 00000020:00000080:1.0:1788837941.939723:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104d9800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-MDT0000 00010000:00010000:3.0:1788837941.940009:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837941.940015:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788837941.940343:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff639710000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788837941.940375:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50a9bd800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788837941.940400:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50a9ba800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788837941.940420:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6104df000 for lustre-MDT0000 00000020:00000080:1.0:1788837941.940424:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff639717000 for lustre-MDT0000 00000020:00000080:1.0:1788837941.940428:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50a9bb000 for lustre-MDT0000 00000020:00000080:1.0:1788837941.940431:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50a9bc000 for lustre-MDT0000 00010000:00010000:1.0:1788837941.940443:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788837941.940736:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff640eee000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788837941.940755:0:84539:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff632f53000): rc 0 00000020:00000080:2.0:1788837941.940758:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff632f53000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1788837941.940767:0:84539:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f51833fbae0 00000020:00000080:1.0:1788837941.940848:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632f53000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788837941.940886:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff640eee000 for lustre-MDT0000 00000100:00080000:2.0:1788837941.940888:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788837941.940892:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411433 gen 3 00010000:00010000:3.0:1788837941.941412:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837941.941763:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788837941.943525:0:84539:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788837941.943568:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff503542000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788837941.944042:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134948480:0@lo:39:umount.0 00000100:00100000:1.0:1788837941.944114:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837941.944478:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134948480 00000100:00080000:2.0:1788837941.944483:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788837941.944486:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000100:00100000:0.0:1788837941.944486:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134948480 00000004:00080000:2.0:1788837941.944506:0:84539:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788837941.944559:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00080000:2.0:1788837941.944560:0:84539:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788837941.944568:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729134948480:12345-0@lo:39:umount.0 00000100:00080000:2.0:1788837941.944573:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff632fea800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788837941.944584:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788837941.944586:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000004:00080000:2.0:1788837941.944594:0:84539:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:0.0:1788837941.944594:0:37907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc78db 00000100:00080000:0.0:1788837941.944602:0:37907:0:(import.c:65:import_set_state_nolock()) ffff8ff604961000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788837941.944622:0:37907:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411433 00000100:00080000:2.0:1788837941.944670:0:84539:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788837941.944677:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff509c71000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788837941.944717:0:84539:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff503ca19b8) has no exports 00000100:00100000:0.0:1788837941.944755:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3642:x1875729134948480:12345-0@lo:39:umount.0 Request processed in 187us (639us total) trans 77309411434 rc 0/0 00000100:00100000:0.0:1788837941.944773:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:1.0:1788837941.944847:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134948608:0@lo:9:umount.0 00000100:00100000:1.0:1788837941.944877:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837941.944899:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134948736:0@lo:9:umount.0 00000100:00100000:1.0:1788837941.944936:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788837941.944966:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff503542000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788837941.944988:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134948480:0@lo:39:umount.0 00000100:00100000:1.0:1788837941.945006:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134948608 00000100:00100000:1.0:1788837941.945010:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134948608 00010000:00010000:0.0:1788837941.945063:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837941.945216:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134948736 00000100:00100000:2.0:1788837941.945220:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134948736 00000100:00100000:2.0:1788837941.945267:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5910 00000100:00080000:3.0:1788837941.945348:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837941.945400:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00100000:1.0:1788837941.945407:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729134948608:12345-0@lo:9:umount.0 00000020:00080000:3.0:1788837941.945417:0:84539:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff503ca19b8) has no exports 00000020:00000080:1.0:1788837941.945423:0:26218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc78e9 00000100:00080000:1.0:1788837941.945429:0:26218:0:(import.c:65:import_set_state_nolock()) ffff8ff509c67800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788837941.945461:0:26218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:1.0:1788837941.945553:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729134948608:12345-0@lo:9:umount.0 Request processed in 146us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837941.945560:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00000100:00080000:1.0:1788837941.945578:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788837941.945584:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837941.945600:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632fea800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788837941.945606:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788837941.945608:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837941.945611:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134948608:0@lo:9:umount.0 00000100:00100000:2.0:1788837941.945732:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff641348050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729134948736:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788837941.945750:0:26210:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7905 00000100:00080000:2.0:1788837941.945755:0:26210:0:(import.c:65:import_set_state_nolock()) ffff8ff640eeb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788837941.945874:0:26210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:2.0:1788837941.946010:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff641348050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729134948736:12345-0@lo:9:umount.0 Request processed in 736us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837941.946144:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5910 00010000:00010000:1.0:1788837941.946409:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837941.946429:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff509c71000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788837941.946442:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788837941.946444:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788837941.946448:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134948736:0@lo:9:umount.0 00000020:00000080:3.0:1788837941.995240:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc78b1 00000020:00000080:3.0:1788837941.995255:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff604962800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788837941.995352:0:84539:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788837941.995480:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788837941.995494:0:84539:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788837941.995498:0:84539:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ff610240000) has no exports 00000020:00000080:2.0:1788837941.995909:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc78aa 00000020:00000080:2.0:1788837941.995915:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff608211000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788837941.995957:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604962800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788837941.996228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff608211000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788837941.996363:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788837941.996373:0:84539:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788837941.996377:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff602d1d800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788837941.996390:0:84539:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff602d1d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788837941.996398:0:84539:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788837941.996542:0:84539:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff50441c5a0 - data ffff8ff63fcfd870/ffff8ff604986400 00000020:01000000:2.0:1788837941.996698:0:84539:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff610de84e0 - data ffff8ff633deeca8/ffff8ff639526400 00000100:00080000:3.0:1788837942.058543:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788837942.058553:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411433 gen 4 00000100:00100000:3.0:1788837942.058568:0:84539:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ff609dd7100 x1875729134948480/t77309411434(77309411434) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788837951 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837942.058621:0:84539:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788837942.060407:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788837942.060414:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:3.0:1788837942.060862:0:84539:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837942.060866:0:84539:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788837942.069750:0:83334:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788837942.069758:0:83334:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:0.0:1788837942.069771:0:83334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:3.0:1788837942.070825:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788837942.070841:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:3.0:1788837942.070859:0:84539:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837942.070862:0:84539:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788837942.071728:0:83336:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788837942.071734:0:83336:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 2 count 1 00000040:00080000:0.0:1788837942.071745:0:83336:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:3.0:1788837942.074127:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7864 00000020:00000080:3.0:1788837942.074141:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff503543000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788837942.075240:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503543000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788837942.076119:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7879 00000020:00000080:3.0:1788837942.076131:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff509c66800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788837942.076373:0:84539:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788837942.076388:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837942.076401:0:84539:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788837942.076405:0:84539:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8ff503ca0000) has no exports 00000004:01000000:3.0:1788837942.076607:0:84539:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788837942.076619:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc78fe 00000020:00000080:3.0:1788837942.076624:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff640eec800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837942.076823:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c66800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788837942.076970:0:84539:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788837942.076975:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837942.076985:0:84539:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788837942.076988:0:84539:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8ff6271cb370) has no exports 00000020:00000080:3.0:1788837942.076994:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc78f7 00000020:00000080:3.0:1788837942.076999:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff509c75000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788837942.077313:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640eec800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788837942.077941:0:84539:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788837942.077947:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788837942.077952:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:3.0:1788837942.077958:0:84539:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837942.077960:0:84539:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788837942.078372:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c75000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788837942.078560:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837942.078574:0:84539:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837942.078581:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc78e2 00000020:00000080:3.0:1788837942.078590:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff62ceac800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837942.079016:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff509c71000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788837942.079024:0:36:0:(genops.c:885:class_export_put()) final put ffff8ff62ceab800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837942.079027:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788837942.079032:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788837942.079113:0:84539:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788837942.079132:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837942.079144:0:84539:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788837942.079148:0:84539:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8ff624ff3370) has no exports 00000020:00000080:3.0:1788837942.079154:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc78d4 00000020:00000080:3.0:1788837942.079158:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff632fef800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788837942.079200:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceac800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788837942.079534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632fef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788837942.079921:0:84539:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788837942.079925:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788837942.079928:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:3.0:1788837942.079933:0:84539:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788837942.079936:0:84539:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788837942.079988:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff632fea800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788837942.080167:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788837942.080178:0:84539:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788837942.080183:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff62ceaa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788837942.080186:0:84539:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceaa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788837942.080197:0:84539:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788837942.080274:0:84539:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788837942.080281:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc78c6 00000020:00000080:3.0:1788837942.080286:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff62ceac000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788837942.080301:0:84539:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788837942.080305:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788837942.080310:0:84539:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788837942.080313:0:84539:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8ff6271ccd28) has no exports 00000020:00000080:3.0:1788837942.080318:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc78bf 00000020:00000080:3.0:1788837942.080321:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff503542800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788837942.080396:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceac000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788837942.080404:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503542800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788837942.088888:0:84539:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788837942.088897:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788837942.088902:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411433 gen 5 00000100:00100000:0.0:1788837942.088913:0:84539:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788837942.088969:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837942.089003:0:84539:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837942.089036:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837942.089041:0:84539:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837942.089046:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff503543800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788837942.089050:0:84539:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503543800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788837942.089058:0:84539:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837942.089161:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7880 00000020:00000080:0.0:1788837942.089167:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff509c65800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788837942.089173:0:84539:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788837942.089176:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837942.089190:0:84539:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788837942.089194:0:84539:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ff503ca4d28) has no exports 00000020:00000080:0.0:1788837942.089216:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837942.089220:0:84539:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788837942.089224:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7887 00000020:00000080:0.0:1788837942.089228:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff509c64000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788837942.089235:0:84539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff6048e2000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788837942.089238:0:84539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff6048e2000 3 00000020:01000004:0.0:1788837942.089241:0:84539:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff6048e2000 from lustre-MDT0000 00000020:00000080:0.0:1788837942.089258:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837942.089262:0:84539:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788837942.089264:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff503544000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788837942.089266:0:84539:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503544000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788837942.089274:0:84539:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788837942.089305:0:84539:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788837942.089309:0:84539:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788837942.089312:0:84539:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788837942.089315:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837942.089318:0:84539:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788837942.089326:0:84539:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff50a9bc800 4043f878-3455-4729-a2a8-e06e8394cc00 192.168.203.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837942.089333:0:84539:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff627d18800 57943c9a-ca27-46d8-8845-5d2bce640e45 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788837942.089337:0:84539:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8ff6102419b8) has exports, disconnecting them 00000020:00080000:0.0:1788837942.089348:0:84539:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.30@tcp (ffff8ff50a9bc800), last request at 1788837727 00000020:00000080:0.0:1788837942.089371:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc79ad 00000020:00010000:0.0:1788837942.089377:0:84539:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff50a9bc800: total 2 00000100:00080000:0.0:1788837942.089392:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff50a9b9800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788837942.089406:0:84539:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff50a9bc800): rc 0 00000020:00080000:0.0:1788837942.089410:0:84539:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ff627d18800), last request at 1788837726 00000020:00010000:0.0:1788837942.089451:0:15289:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff50a9bc800: total 2 00010000:00010000:0.0:1788837942.089455:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837942.089491:0:15289:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff50a9bc800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788837942.089523:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff6082a4c00/0x88da08396ccc7a1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb5d expref: 5 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089541:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff6421c7600/0x88da08396ccc7a2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb6b expref: 4 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089553:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5fc00/0x88da08396ccc7a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb56 expref: 3 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089565:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc7a24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cb64 expref: 2 pid: 83327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089574:0:15289:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff50a9bc800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788837942.089594:0:15289:0:(genops.c:885:class_export_put()) final put ffff8ff50a9bc800/4043f878-3455-4729-a2a8-e06e8394cc00 00010000:00010000:0.0:1788837942.089599:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837942.089601:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837942.089602:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788837942.089615:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc782c 00000020:00010000:0.0:1788837942.089619:0:84539:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff627d18800: total 3 00000100:00080000:0.0:1788837942.089621:0:84539:0:(import.c:65:import_set_state_nolock()) ffff8ff627d1b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788837942.089643:0:84539:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff627d18800): rc 0 00000020:00080000:0.0:1788837942.089654:0:84539:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ff6102419b8) has no exports 00000020:00010000:0.0:1788837942.089663:0:6535:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff627d18800: total 3 00010000:00010000:0.0:1788837942.089859:0:6535:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff627d18800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788837942.089884:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5e800/0x88da08396ccc796e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7967 expref: 14 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089900:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff6082a5800/0x88da08396ccc797c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7975 expref: 13 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089912:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5e600/0x88da08396ccc79bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc79b4 expref: 12 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089926:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607461800/0x88da08396ccc798a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7983 expref: 11 pid: 83323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089941:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff6082a5000/0x88da08396ccc79c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc79c2 expref: 10 pid: 83327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089951:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f400/0x88da08396ccc7998 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7991 expref: 9 pid: 83324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089961:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607461200/0x88da08396ccc79d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc79d0 expref: 8 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089974:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607460e00/0x88da08396ccc79f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc79ec expref: 7 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089988:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5fe00/0x88da08396ccc79a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc799f expref: 6 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.089999:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff6421c6600/0x88da08396ccc79e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc79de expref: 5 pid: 83324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.090022:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5ee00/0x88da08396ccc7960 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7959 expref: 4 pid: 83324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.090033:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff6421c7200/0x88da08396ccc7a01 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc79fa expref: 3 pid: 83327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.090046:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff6421c7a00/0x88da08396ccc7a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7a08 expref: 2 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837942.090059:0:6535:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff627d18800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788837942.090077:0:6535:0:(genops.c:885:class_export_put()) final put ffff8ff627d18800/57943c9a-ca27-46d8-8845-5d2bce640e45 00010000:00010000:0.0:1788837942.090082:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837942.090083:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837942.090085:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837942.090145:0:83322:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ff5059cc600:83322] 0 exiting: rc = 1 00000100:00100000:1.0:1788837942.090319:0:83324:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ff64042f000:83324] 2 exiting: rc = 0 00000100:00100000:1.0:1788837942.090398:0:83327:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8ff501aa8000:83327] 3 exiting: rc = 0 00000020:00000080:1.0:1788837942.090465:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff503542000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788837942.090476:0:36:0:(genops.c:885:class_export_put()) final put ffff8ff62ceae000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837942.090479:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceae000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788837942.090484:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788837942.090564:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c65800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788837942.090569:0:36:0:(genops.c:885:class_export_put()) final put ffff8ff509c62000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788837942.090570:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c62000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788837942.090573:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788837942.090596:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c64000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788837942.090600:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50a9bc800/4043f878-3455-4729-a2a8-e06e8394cc00 for MGS 00000020:00000080:1.0:1788837942.090630:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d18800/57943c9a-ca27-46d8-8845-5d2bce640e45 for MGS 00000020:00000080:1.0:1788837942.090642:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50a9b9800 for MGS 00000020:00000080:1.0:1788837942.090645:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff627d1b800 for MGS 00000100:00100000:0.0:1788837942.092975:0:83323:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ff50a680a00:83323] 1 exiting: rc = 0 00000100:00100000:1.0:1788837942.093164:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093173:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093202:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093208:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093214:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093219:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093224:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093230:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093235:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093240:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093247:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093255:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093261:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093266:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093272:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093278:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093283:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093289:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093295:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093301:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093307:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093313:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093319:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093325:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093331:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093336:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093341:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093346:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093352:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093357:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093363:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093368:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093373:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093388:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093395:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093400:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093406:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093420:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093426:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093432:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093437:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093442:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093448:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093453:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093459:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093465:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093471:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093476:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093481:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093487:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093492:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093497:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093504:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093509:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093515:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093521:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093527:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093532:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093538:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093543:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093549:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093555:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093561:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788837942.093567:0:84539:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788837942.097496:0:84539:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff50441c2a0 - data ffff8ff633cb3a20/ffff8ff503697000 00000020:01000000:1.0:1788837942.097777:0:84539:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff611ab3d80 - data ffff8ff633f90438/ffff8ff639c5b800 00000020:00000080:1.0:1788837942.098277:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7825 00000020:00000080:1.0:1788837942.098288:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff632f51800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788837942.098300:0:84539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff6048e2000 from MGS, refs=2 00000020:01000004:1.0:1788837942.098304:0:84539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff6048e2000 2 00000020:01000004:1.0:1788837942.098307:0:84539:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff6048e2000 from MGS 00000020:00000080:1.0:1788837942.098343:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788837942.098350:0:84539:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788837942.098353:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff632f52000/MGS 00000020:00000080:1.0:1788837942.098355:0:84539:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632f52000/MGS for MGS 00000020:01000000:1.0:1788837942.098361:0:84539:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1788837942.098463:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632f51800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788837942.098545:0:84539:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788837942.098550:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788837942.098566:0:84539:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788837942.098575:0:84539:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ff627d19000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788837942.098581:0:84539:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8ff503ca3370) has exports, disconnecting them 00000020:00080000:1.0:1788837942.098586:0:84539:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ff627d19000), last request at 1788837726 00000020:00000080:1.0:1788837942.098590:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc793d 00000020:00080000:1.0:1788837942.098599:0:84539:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff627d19000): rc 0 00000020:00000080:1.0:1788837942.098606:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff627d19000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788837942.099821:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d19000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788837942.101266:0:84539:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788837942.101273:0:84539:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788837942.101278:0:84539:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788837942.101285:0:84539:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788837942.101318:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff503547800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788837942.101495:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837942.101509:0:84539:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788837942.101514:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff509c65000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788837942.101517:0:84539:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c65000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788837942.101523:0:84539:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788837942.101616:0:84539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff6048e2000 1 00000020:00000080:0.0:1788837942.101622:0:84539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7817 00000020:00000080:0.0:1788837942.101627:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff632f57800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788837942.101647:0:84539:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788837942.101656:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632f57800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788837942.101666:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788837942.101682:0:84539:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788837942.101686:0:84539:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ff624ff19b8) has no exports 00010000:00010000:3.0:1788837942.206277:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788837942.428217:0:84539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788837942.428310:0:84539:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788837942.428316:0:84539:0:(genops.c:885:class_export_put()) final put ffff8ff6057c0800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788837942.428321:0:84539:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6057c0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788837942.428332:0:84539:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788837942.428459:0:84539:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ff6057c6800 00000020:02000400:0.0:1788837942.428527:0:84539:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788837943.231072:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837943.678133:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729134948992:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.678201:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837943.678231:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134949504:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.678256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837943.678281:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788837943.678287:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134948864:0@lo:400:kworker.0 00000400:00000100:1.0:1788837943.678307:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729134948864 offset 0 length 224: 4 00000100:00100000:1.0:1788837943.678327:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134949376:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.678347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837943.678364:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134949888:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.678397:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837943.678464:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134948992 00000100:00100000:3.0:1788837943.678472:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134948992 00000100:00100000:3.0:1788837943.678517:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134949376 00000100:00100000:3.0:1788837943.678521:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134949376 00000100:00100000:3.0:1788837943.678552:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134949888 00000100:00100000:3.0:1788837943.678554:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134949888 00000100:00100000:3.0:1788837943.678571:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1788837943.678582:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134949376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837943.678633:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134949376:12345-0@lo:400:kworker.0 Request processed in 54us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837943.678640:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1788837943.678658:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1788837943.678662:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875729134948992:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788837943.678667:0:75504:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788837943.678692:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875729134948992:12345-0@lo:400:kworker.0 Request processed in 29us (491us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788837943.678698:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1788837943.678709:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1788837943.678713:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875729134949888:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788837943.678717:0:75504:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788837943.678737:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875729134949888:12345-0@lo:400:kworker.0 Request processed in 23us (339us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788837943.678742:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00080000:3.0:1788837943.678763:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837943.679413:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134949120:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.679470:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837943.679504:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134949632:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.679531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837943.679599:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788837943.679606:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729134949248:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.679630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837943.679646:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134949760:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.679666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837943.679708:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134949120 00000100:00100000:3.0:1788837943.679713:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134949120 00000100:00100000:3.0:1788837943.679753:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134949248 00000100:00100000:3.0:1788837943.679755:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134949248 00000100:00100000:3.0:1788837943.679771:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1788837943.679779:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134949120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837943.679848:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134949120:12345-0@lo:400:kworker.0 Request processed in 70us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837943.679861:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1788837943.679878:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1788837943.679882:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875729134949248:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788837943.679887:0:67312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788837943.679913:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875729134949248:12345-0@lo:400:kworker.0 Request processed in 30us (282us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788837943.679918:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:3.0:1788837943.679952:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837943.682998:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134949120:0@lo:400:kworker.0 00000100:00080000:1.0:1788837943.683032:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788837943.683037:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788837943.683041:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788837943.683047:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837943.683051:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3125 00000100:00080000:1.0:1788837943.683058:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837943.683089:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a89180 x1875729134950016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837943.683110:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729134949248:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.683147:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134949504 00000100:00100000:1.0:1788837943.683153:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134949504 00000100:00100000:1.0:1788837943.683195:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:1.0:1788837943.683202:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1875729134949504:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788837943.683210:0:8471:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788837943.683263:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1875729134949504:12345-0@lo:400:kworker.0 Request processed in 60us (5005us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788837943.683277:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00100000:1.0:1788837943.683307:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134950016:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788837943.683342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837943.683401:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134949376:0@lo:400:kworker.0 00000100:00080000:1.0:1788837943.683414:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788837943.683418:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788837943.683420:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788837943.683424:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837943.683427:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3125 00000100:00080000:1.0:1788837943.683431:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837943.683447:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff501afc000 x1875729134950144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837943.683462:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134949888:0@lo:400:kworker.0 00000100:00080000:1.0:1788837943.683475:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788837943.683478:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788837943.683481:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788837943.683483:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837943.683486:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3125 00000100:00080000:1.0:1788837943.683490:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837943.683502:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff604230700 x1875729134950272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837943.683512:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729134948992:0@lo:400:kworker.0 00000100:00080000:1.0:1788837943.683534:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788837943.683538:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788837943.683541:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788837943.683544:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837943.683548:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3306 00000100:00080000:1.0:1788837943.683551:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837943.683564:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff604231500 x1875729134950400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837943.683574:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134949504:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.683607:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff501afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134950144:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788837943.683631:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837943.683647:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134950272:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788837943.683667:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837943.683680:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134950400:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788837943.683698:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837943.683836:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134949632 00000100:00100000:2.0:1788837943.683841:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134949632 00000100:00100000:2.0:1788837943.683889:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134949760 00000100:00100000:2.0:1788837943.683893:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134949760 00000100:00100000:2.0:1788837943.683911:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:2.0:1788837943.683918:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134949632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837943.683969:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134949632:12345-0@lo:400:kworker.0 Request processed in 52us (4437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837943.683975:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:2.0:1788837943.683988:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:2.0:1788837943.683994:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134949760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837943.684023:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134949760:12345-0@lo:400:kworker.0 Request processed in 30us (4356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837943.684029:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00100000:3.0:1788837943.688582:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134950400 00000100:00100000:3.0:1788837943.688597:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134950400 00000100:00100000:3.0:1788837943.688639:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:3.0:1788837943.688648:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134950400:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788837943.688672:0:8472:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837943.688753:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134950400:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 105us (5053us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837943.688761:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00100000:3.0:1788837943.688789:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134950016 00000100:00100000:3.0:1788837943.688793:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134950016 00000100:00100000:3.0:1788837943.688837:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134950144 00000100:00100000:3.0:1788837943.688840:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134950144 00000100:00100000:3.0:1788837943.688852:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134950272 00000100:00100000:3.0:1788837943.688855:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134950272 00000100:00100000:3.0:1788837943.688868:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1788837943.688873:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134950016:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788837943.688883:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837943.688912:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134950016:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 37us (5569us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837943.688927:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1788837943.688939:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:3.0:1788837943.688943:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134950144:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788837943.688953:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837943.688980:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134950144:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 35us (5349us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837943.688986:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:3.0:1788837943.688997:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1788837943.689002:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134950272:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788837943.689010:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837943.689032:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134950272:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 29us (5365us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837943.689037:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00080000:3.0:1788837943.689086:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837943.689093:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837943.689097:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff501afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134950144:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788837943.689109:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837943.689112:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837943.689115:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134950272:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788837943.689124:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837943.689127:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837943.689130:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134950400:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788837943.689139:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837943.689150:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837943.689152:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134950016:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788837943.689360:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788837943.689366:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837943.689406:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134949760:0@lo:400:kworker.0 00000100:00100000:1.0:1788837943.689419:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134949632:0@lo:400:kworker.0 00000400:00000100:2.0:1788837943.870776:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116371712 offset 0 length 224: 4 00000100:00100000:2.0:1788837943.870843:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837943.870877:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837943.870912:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837943.870970:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116371968 00000100:00100000:3.0:1788837943.870980:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116371968 00000100:00100000:3.0:1788837943.871046:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116371840 00000100:00100000:3.0:1788837943.871049:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116371840 00000100:00100000:3.0:1788837943.871068:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1033 00000100:00100000:3.0:1788837943.871078:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116371968:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788837943.871220:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1039 00000100:00100000:1.0:1788837943.871227:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1875729116371840:12345-192.168.203.30@tcp:400:kworker.0 00000020:00080000:1.0:1788837943.871233:0:66255:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.30@tcp 00000100:00100000:3.0:1788837943.877340:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116371968:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 6252us (6486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837943.877357:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1033 00000100:00080000:3.0:1788837943.877413:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837943.877925:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1875729116371840:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 6693us (7009us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788837943.877936:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1039 00000100:00100000:2.0:1788837943.880240:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837943.880312:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116372224 00000100:00100000:2.0:1788837943.880322:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116372224 00000100:00100000:2.0:1788837943.880700:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116372096 00000100:00100000:2.0:1788837943.880704:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116372096 00000100:00100000:0.0:1788837943.880750:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2415 00000100:00100000:0.0:1788837943.880762:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116372224:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837943.880871:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116372224:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 111us (9991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837943.880880:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2415 00000100:00080000:1.0:1788837943.881029:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837943.881034:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837943.881284:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2416 00000100:00100000:2.0:1788837943.881292:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116372096:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837943.881327:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116372096:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837943.881333:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2416 00000100:00100000:3.0:1788837943.889645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837943.890195:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116372352 00000100:00100000:2.0:1788837943.890208:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116372352 00000100:00100000:2.0:1788837943.890329:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1040 00000100:00100000:2.0:1788837943.890339:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116372352:12345-192.168.203.30@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788837943.890378:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788837943.890471:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116372352:12345-192.168.203.30@tcp:38:ptlrpcd_00_01.0 Request processed in 131us (836us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788837943.890481:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1040 00010000:00010000:0.0:1788837944.253062:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837944.703080:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134950528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837944.703165:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837944.703701:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134950528 00000100:00100000:0.0:1788837944.703710:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134950528 00000100:00100000:0.0:1788837944.703756:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:0.0:1788837944.703771:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134950528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837944.703817:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837944.704057:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134950528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 292us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837944.704081:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:1.0:1788837944.705942:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134950528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837944.706786:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134950656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837944.707410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837944.707686:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134950656 00000100:00100000:3.0:1788837944.707695:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134950656 00000100:00100000:3.0:1788837944.707738:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885 00000100:00100000:3.0:1788837944.707748:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134950656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837944.707781:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837944.707855:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134950656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837944.707862:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885 00000100:00100000:3.0:1788837944.707919:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134950656:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788837945.277081:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837946.300966:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837947.332639:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788837947.778159:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788837947.778171:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff509c61000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788837947.778245:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c61000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788837947.778298:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff509c67800 for lustre-OST0000 00000001:00100000:1.0:1788837947.783872:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788837947.783882:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff640ee8000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788837947.785560:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788837947.785587:0:75678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411434 is committed 00000020:00000080:2.0:1788837947.785592:0:75678:0:(genops.c:885:class_export_put()) final put ffff8ff604964800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788837947.785882:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640ee8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788837947.785956:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604964800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788837947.785989:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff640eeb000 for lustre-OST0001 00000020:00000080:0.0:1788837947.785994:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff604961000 for lustre-MDT0001 00010000:00010000:0.0:1788837948.349595:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788837948.797143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837948.797150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788837948.797154:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837948.797161:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3337 00000100:00080000:2.0:1788837948.797168:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788837948.797176:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837948.797198:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134950784:0@lo:400:kworker.0 00000100:00100000:2.0:1788837948.797205:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd5880 x1875729134950912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1788837948.797260:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729134950784 offset 0 length 224: 4 00000100:00080000:2.0:1788837948.797267:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837948.797271:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788837948.797273:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837948.797278:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3337 00000100:00080000:2.0:1788837948.797282:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788837948.797287:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788837948.797299:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd5180 x1875729134951168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837948.797314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837948.797318:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788837948.797320:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837948.797324:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3337 00000100:00080000:2.0:1788837948.797326:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788837948.797331:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837948.797348:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134951296:0@lo:400:kworker.0 00000100:00100000:2.0:1788837948.797356:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd5500 x1875729134951424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837948.797391:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788837948.797401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1788837948.797419:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1788837948.797420:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788837948.797424:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788837948.797429:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729134951040:0@lo:400:kworker.0 00000100:00080000:2.0:1788837948.797430:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3337 00000100:00080000:2.0:1788837948.797436:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788837948.797441:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788837948.797458:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd6a00 x1875729134951808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837948.797462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837948.797493:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134951296 00000100:00100000:1.0:1788837948.797502:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134951296 00000100:00100000:1.0:1788837948.797554:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134951040 00000100:00100000:1.0:1788837948.797557:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134951040 00000100:00100000:1.0:1788837948.797593:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1788837948.797601:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134951296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837948.797649:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134951296:12345-0@lo:400:kworker.0 Request processed in 49us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837948.797670:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1788837948.797688:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1788837948.797696:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729134951040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837948.797701:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134951552:0@lo:400:kworker.0 00000100:00080000:2.0:1788837948.798188:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837948.798197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837948.798201:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134951680:0@lo:400:kworker.0 00000100:00100000:3.0:1788837948.798241:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134951552 00000100:00100000:2.0:1788837948.798244:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837948.798252:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134951552 00000100:00080000:2.0:1788837948.798277:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837948.798285:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134951680 00000100:00100000:3.0:1788837948.798288:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134951680 00000100:00100000:2.0:1788837948.798291:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:2.0:1788837948.798298:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134951552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837948.798308:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418 00000100:00100000:3.0:1788837948.798314:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134951680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837948.798350:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134951552:12345-0@lo:400:kworker.0 Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837948.798365:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134951680:12345-0@lo:400:kworker.0 Request processed in 44us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837948.798724:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00000100:00100000:2.0:1788837948.798779:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134951680:0@lo:400:kworker.0 00000100:00080000:2.0:1788837948.798848:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837948.798873:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134951552:0@lo:400:kworker.0 00000100:00100000:2.0:1788837948.798925:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729134951040:0@lo:400:kworker.0 00000100:00100000:2.0:1788837948.798936:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134951296:0@lo:400:kworker.0 00000100:00100000:1.0:1788837948.800073:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729134951040:12345-0@lo:400:kworker.0 Request processed in 2372us (2605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837948.800085:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1788837948.800197:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134950912:0@lo:38:kworker.0 00000100:00100000:0.0:1788837948.800261:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837948.800290:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134951168:0@lo:38:kworker.0 00000100:00100000:0.0:1788837948.800312:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837948.800353:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134951424:0@lo:38:kworker.0 00000100:00100000:0.0:1788837948.800379:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837948.800394:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134951808:0@lo:38:kworker.0 00000100:00100000:0.0:1788837948.800412:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837948.800450:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134950912 00000100:00100000:0.0:1788837948.800457:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134950912 00000100:00100000:0.0:1788837948.800487:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134951168 00000100:00100000:0.0:1788837948.800490:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134951168 00000100:00100000:0.0:1788837948.800504:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134951808 00000100:00100000:0.0:1788837948.800507:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134951808 00000100:00100000:0.0:1788837948.800521:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1788837948.800527:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729134950912:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788837948.800548:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788837948.801446:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1788837948.801455:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134951168:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788837948.801470:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788837948.801506:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729134950912:12345-0@lo:38:kworker.0 Request processed in 977us (1244us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837948.801513:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1788837948.801532:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1788837948.801537:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729134951808:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788837948.801547:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788837948.801636:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729134951808:12345-0@lo:38:kworker.0 Request processed in 33us (1157us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837948.801644:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:0.0:1788837948.802090:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837948.802097:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788837948.802101:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134950912:0@lo:38:kworker.0 00000100:00080000:0.0:1788837948.802114:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837948.802117:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788837948.802120:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134951808:0@lo:38:kworker.0 00000100:00100000:3.0:1788837948.802462:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418 00000100:00100000:1.0:1788837948.803053:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134951424 00000100:00100000:1.0:1788837948.803064:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134951424 00000100:00100000:1.0:1788837948.803114:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:1.0:1788837948.803120:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134951424:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788837948.803140:0:8471:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837948.803220:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134951424:12345-0@lo:38:kworker.0 Request processed in 98us (2839us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837948.803227:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00100000:2.0:1788837948.803371:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134951168:12345-0@lo:38:kworker.0 Request processed in 1913us (3056us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788837948.803379:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00080000:3.0:1788837948.803617:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837948.803624:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837948.803628:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134951168:0@lo:38:kworker.0 00000100:00080000:3.0:1788837948.803640:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837948.803644:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837948.803646:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134951424:0@lo:38:kworker.0 00000400:00000100:0.0:1788837948.994325:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116372480 offset 0 length 224: 4 00000100:00100000:0.0:1788837948.994375:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837948.994418:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837948.994452:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837948.994490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837948.994523:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116372864 00000100:00100000:0.0:1788837948.994532:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116372864 00000100:00100000:0.0:1788837948.994590:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116372992 00000100:00100000:0.0:1788837948.994593:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116372992 00000100:00100000:0.0:1788837948.994616:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2419 00000100:00100000:0.0:1788837948.994624:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116372864:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837948.994707:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116372864:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 82us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837948.994715:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2419 00000100:00100000:0.0:1788837948.994733:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2420 00000100:00100000:0.0:1788837948.994738:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116372992:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837948.994761:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116372992:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837948.994766:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2420 00000100:00100000:3.0:1788837948.995184:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116372736 00000100:00100000:3.0:1788837948.995189:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116372736 00000100:00100000:3.0:1788837948.995223:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116372608 00000100:00100000:3.0:1788837948.995225:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116372608 00000100:00100000:3.0:1788837948.995239:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1036 00000100:00100000:3.0:1788837948.995246:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116372736:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837948.995282:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116372736:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837948.995288:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1036 00000100:00100000:3.0:1788837948.995301:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1044 00000100:00100000:3.0:1788837948.995305:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116372608:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:3.0:1788837948.995324:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837948.995371:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116372608:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 63us (917us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837948.995377:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1044 00000100:00080000:2.0:1788837948.996307:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788837948.996314:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837948.996316:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788837949.374113:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837949.821257:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837949.821273:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff501afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134951936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837949.821348:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837949.821398:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134951936 00000100:00100000:1.0:1788837949.821406:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134951936 00000100:00100000:1.0:1788837949.821453:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:1.0:1788837949.821461:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134951936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788837949.821489:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837949.821531:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134951936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837949.821538:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:1.0:1788837949.821600:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff501afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134951936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837949.821965:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff501afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134952064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837949.821997:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837949.822183:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134952064 00000100:00100000:3.0:1788837949.822188:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134952064 00000100:00100000:3.0:1788837949.822234:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:3.0:1788837949.822242:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134952064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788837949.822260:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837949.822306:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134952064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837949.822313:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00100000:0.0:1788837949.822436:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff501afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134952064:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788837950.399857:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837951.421020:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837952.444980:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837953.469754:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788837953.917309:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837953.917317:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837953.917322:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837953.917333:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3342 00000100:00080000:3.0:1788837953.917339:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788837953.917346:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788837953.917372:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640e57480 x1875729134952320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837953.917416:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837953.917420:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837953.917421:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837953.917425:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3342 00000100:00080000:3.0:1788837953.917428:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788837953.917450:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788837953.917464:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640e56300 x1875729134952576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837953.917488:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837953.917493:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837953.917494:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837953.917498:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3342 00000100:00080000:3.0:1788837953.917501:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788837953.917505:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788837953.917516:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640e56d80 x1875729134952832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837953.917536:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837953.917539:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837953.917541:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837953.917544:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3342 00000100:00080000:3.0:1788837953.917547:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788837953.917550:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788837953.917574:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640e56a00 x1875729134953216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837953.917879:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134952320:0@lo:38:kworker.0 00000100:00100000:1.0:1788837953.917954:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837953.917996:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134952576:0@lo:38:kworker.0 00000100:00100000:1.0:1788837953.918019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837953.918033:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134952832:0@lo:38:kworker.0 00000100:00100000:1.0:1788837953.918071:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837953.918089:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134953216:0@lo:38:kworker.0 00000100:00100000:1.0:1788837953.918109:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837953.918148:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134952832 00000100:00100000:1.0:1788837953.918157:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134952832 00000100:00100000:1.0:1788837953.918194:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:1.0:1788837953.918200:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134952832:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788837953.918220:0:37907:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837953.918261:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134952832:12345-0@lo:38:kworker.0 Request processed in 60us (190us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837953.918269:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00080000:1.0:1788837953.918323:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788837953.918328:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788837953.918332:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134952832:0@lo:38:kworker.0 00000100:00100000:3.0:1788837953.918419:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134952320 00000100:00100000:3.0:1788837953.918423:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134952320 00000100:00100000:3.0:1788837953.918453:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134952576 00000100:00100000:3.0:1788837953.918456:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134952576 00000100:00100000:3.0:1788837953.918468:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134953216 00000100:00100000:3.0:1788837953.918471:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134953216 00000100:00100000:3.0:1788837953.918488:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1788837953.918506:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134952320:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788837953.918518:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837953.918553:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134952320:12345-0@lo:38:kworker.0 Request processed in 46us (599us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837953.918559:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1788837953.918573:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1788837953.918577:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134952576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788837953.918586:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837953.918608:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134952576:12345-0@lo:38:kworker.0 Request processed in 30us (589us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837953.918614:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1788837953.918624:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1788837953.918628:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134953216:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788837953.918637:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837953.918657:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134953216:12345-0@lo:38:kworker.0 Request processed in 28us (547us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837953.918663:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00080000:3.0:1788837953.918690:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837953.918694:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837953.918698:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134952320:0@lo:38:kworker.0 00000100:00080000:3.0:1788837953.918706:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837953.918709:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837953.918712:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134952576:0@lo:38:kworker.0 00000100:00080000:3.0:1788837953.918719:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837953.918728:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837953.918731:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134953216:0@lo:38:kworker.0 00000100:00100000:2.0:1788837953.919004:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff501afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134952192:0@lo:400:kworker.0 00000400:00000100:2.0:1788837953.919036:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729134952192 offset 0 length 224: 4 00000100:00100000:2.0:1788837953.919081:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134953088:0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919107:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837953.919131:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837953.919138:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134952448:0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837953.919188:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729134952704:0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919211:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837953.919231:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837953.919237:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134952960:0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919260:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837953.919289:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134952448 00000100:00100000:2.0:1788837953.919293:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134952448 00000100:00100000:2.0:1788837953.919345:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134952704 00000100:00100000:2.0:1788837953.919348:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134952704 00000100:00100000:2.0:1788837953.919363:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1788837953.919369:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134952448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919422:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134952448:12345-0@lo:400:kworker.0 Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837953.919429:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1788837953.919455:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1788837953.919460:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729134952704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919500:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729134952704:12345-0@lo:400:kworker.0 Request processed in 38us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837953.919506:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1788837953.919533:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134953088 00000100:00100000:2.0:1788837953.919536:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134953088 00000100:00100000:2.0:1788837953.919578:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134952960 00000100:00100000:2.0:1788837953.919581:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134952960 00000100:00100000:2.0:1788837953.919600:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:2.0:1788837953.919606:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134953088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919638:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134953088:12345-0@lo:400:kworker.0 Request processed in 32us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837953.919644:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:2.0:1788837953.919654:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:2.0:1788837953.919660:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134952960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919686:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134952960:12345-0@lo:400:kworker.0 Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837953.919691:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00080000:2.0:1788837953.919709:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788837953.919713:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837953.919716:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837953.919753:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134952960:0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919764:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729134952704:0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919790:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134952448:0@lo:400:kworker.0 00000100:00100000:2.0:1788837953.919826:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134953088:0@lo:400:kworker.0 00000100:00100000:0.0:1788837954.113554:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:0.0:1788837954.113599:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116373120 offset 0 length 224: 4 00000100:00100000:2.0:1788837954.113684:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116373376 00000100:00100000:2.0:1788837954.113694:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116373376 00000100:00100000:2.0:1788837954.113767:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1039 00000100:00100000:2.0:1788837954.113784:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116373376:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837954.113919:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116373376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 144us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837954.113927:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1039 00000100:00080000:0.0:1788837954.114153:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837954.114649:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837954.114678:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837954.114706:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837954.114732:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116373504 00000100:00100000:1.0:1788837954.114754:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116373504 00000100:00100000:2.0:1788837954.114784:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116373248 00000100:00100000:2.0:1788837954.114789:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116373248 00000100:00100000:1.0:1788837954.114840:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116373632 00000100:00100000:1.0:1788837954.114844:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116373632 00000100:00100000:3.0:1788837954.114853:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5912 00000100:00100000:3.0:1788837954.114867:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2403:x1875729116373504:12345-192.168.203.30@tcp:9:kworker.0 00000100:00100000:1.0:1788837954.114876:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5913 00000100:00100000:1.0:1788837954.114888:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2403:x1875729116373632:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:3.0:1788837954.114893:0:26213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7c1c 00000020:00000080:1.0:1788837954.114905:0:8462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc778b 00000100:00080000:3.0:1788837954.114906:0:26213:0:(import.c:65:import_set_state_nolock()) ffff8ff6104dd800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788837954.114928:0:8462:0:(import.c:65:import_set_state_nolock()) ffff8ff6048e2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788837954.114958:0:26213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000001:00000004:1.0:1788837954.114981:0:8462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:1.0:1788837954.115139:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+2:2403:x1875729116373632:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 253us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837954.115147:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5913 00010000:00010000:1.0:1788837954.115169:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837954.115252:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837954.115358:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+2:2403:x1875729116373504:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 495us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837954.115366:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5912 00000100:00080000:0.0:1788837954.115447:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837954.115451:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837954.123761:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1048 00000100:00100000:2.0:1788837954.123783:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116373248:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:2.0:1788837954.123833:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788837954.124416:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116373248:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 640us (9765us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788837954.124425:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1048 00010000:00010000:2.0:1788837954.494523:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837954.943226:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837954.943246:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134953344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837954.944450:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837954.944776:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134953344 00000100:00100000:0.0:1788837954.944786:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134953344 00000100:00100000:0.0:1788837954.944864:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:0.0:1788837954.944874:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134953344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837954.944908:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837954.944956:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134953344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837954.944978:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00100000:0.0:1788837954.945026:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134953344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837954.955446:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134953472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837954.955519:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837954.955641:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134953472 00000100:00100000:2.0:1788837954.955649:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134953472 00000100:00100000:2.0:1788837954.955704:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:2.0:1788837954.955713:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134953472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837954.955744:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837954.955828:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134953472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837954.955836:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00100000:0.0:1788837954.956126:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134953472:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788837955.517780:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837956.548614:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837957.565481:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837958.598549:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788837959.043149:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837959.043157:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837959.043160:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837959.043169:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3347 00000100:00080000:1.0:1788837959.043174:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788837959.043180:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837959.043204:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff604231f80 x1875729134953728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837959.043254:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837959.043257:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837959.043259:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837959.043263:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3347 00000100:00080000:1.0:1788837959.043281:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788837959.043285:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837959.043297:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff604230700 x1875729134953984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837959.043312:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837959.043315:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837959.043317:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837959.043321:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3347 00000100:00080000:1.0:1788837959.043323:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788837959.043326:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837959.043335:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a8ad80 x1875729134954240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837959.043353:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837959.043357:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837959.043358:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837959.043362:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3347 00000100:00080000:1.0:1788837959.043364:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788837959.043367:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837959.043376:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a8bb80 x1875729134954624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788837959.043417:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134953600:0@lo:400:kworker.0 00000400:00000100:1.0:1788837959.043468:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729134953600 offset 0 length 224: 4 00000100:00100000:1.0:1788837959.043503:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134954496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837959.043534:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837959.043871:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837959.043880:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134954368:0@lo:400:kworker.0 00000100:00100000:1.0:1788837959.043907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837959.043939:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134953856:0@lo:400:kworker.0 00000100:00100000:1.0:1788837959.043964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837959.043984:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788837959.043988:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729134954112:0@lo:400:kworker.0 00000100:00100000:1.0:1788837959.044007:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837959.044037:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134954496 00000100:00100000:1.0:1788837959.044045:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134954496 00000100:00100000:1.0:1788837959.044108:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134954368 00000100:00100000:1.0:1788837959.044112:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134954368 00000100:00100000:1.0:1788837959.044136:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1788837959.044145:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134954496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837959.044201:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134954496:12345-0@lo:400:kworker.0 Request processed in 58us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837959.044208:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1788837959.044224:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424 00000100:00100000:1.0:1788837959.044230:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134954368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837959.044257:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134954368:12345-0@lo:400:kworker.0 Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837959.044285:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424 00000100:00100000:1.0:1788837959.044307:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134953856 00000100:00100000:1.0:1788837959.044311:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134953856 00000100:00100000:2.0:1788837959.044318:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134954368:0@lo:400:kworker.0 00000100:00100000:1.0:1788837959.044338:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134954112 00000100:00100000:1.0:1788837959.044341:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134954112 00000100:00100000:2.0:1788837959.044342:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134954496:0@lo:400:kworker.0 00000100:00100000:1.0:1788837959.044359:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1788837959.044365:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134953856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837959.044409:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134953856:12345-0@lo:400:kworker.0 Request processed in 44us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837959.044415:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1788837959.044427:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1788837959.044432:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729134954112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837959.044460:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729134954112:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837959.044466:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00080000:1.0:1788837959.044484:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837959.044488:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837959.044490:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837959.044495:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729134954112:0@lo:400:kworker.0 00000100:00100000:2.0:1788837959.044504:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134953856:0@lo:400:kworker.0 00000100:00100000:2.0:1788837959.044876:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134953728:0@lo:38:kworker.0 00000100:00100000:2.0:1788837959.044914:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837959.044944:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134953984:0@lo:38:kworker.0 00000100:00100000:2.0:1788837959.044966:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837959.044984:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134954240:0@lo:38:kworker.0 00000100:00100000:2.0:1788837959.045010:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837959.045026:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134954624:0@lo:38:kworker.0 00000100:00100000:2.0:1788837959.045045:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837959.045088:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134953728 00000100:00100000:2.0:1788837959.045092:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134953728 00000100:00100000:2.0:1788837959.045113:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134953984 00000100:00100000:2.0:1788837959.045116:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134953984 00000100:00100000:2.0:1788837959.045126:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134954624 00000100:00100000:2.0:1788837959.045128:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134954624 00000100:00100000:2.0:1788837959.045143:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1788837959.045149:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729134953728:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788837959.045168:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788837959.045204:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729134953728:12345-0@lo:38:kworker.0 Request processed in 54us (289us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788837959.045210:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1788837959.045224:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1788837959.045228:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729134953984:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788837959.045247:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837959.045335:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:1.0:1788837959.045342:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729134954624:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788837959.045352:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837959.045383:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729134954624:12345-0@lo:38:kworker.0 Request processed in 41us (336us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788837959.045384:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729134953984:12345-0@lo:38:kworker.0 Request processed in 155us (417us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837959.045389:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1788837959.045392:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00080000:2.0:1788837959.045420:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837959.045431:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788837959.045434:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134953728:0@lo:38:kworker.0 00000100:00080000:2.0:1788837959.045445:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837959.045448:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788837959.045450:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134953984:0@lo:38:kworker.0 00000100:00080000:2.0:1788837959.045458:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788837959.045462:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788837959.045464:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134954624:0@lo:38:kworker.0 00000100:00100000:0.0:1788837959.045673:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134954240 00000100:00100000:0.0:1788837959.045678:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134954240 00000100:00100000:0.0:1788837959.045714:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:0.0:1788837959.045720:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134954240:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788837959.045732:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788837959.045774:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134954240:12345-0@lo:38:kworker.0 Request processed in 53us (762us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837959.045781:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00080000:0.0:1788837959.045830:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788837959.045834:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788837959.045837:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134954240:0@lo:38:kworker.0 00000400:00000100:2.0:1788837959.249254:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116373760 offset 0 length 520: 4 00000100:00100000:2.0:1788837959.249318:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837959.249368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837959.249405:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116373888 00000100:00100000:2.0:1788837959.249416:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116373888 00000100:00100000:2.0:1788837959.249461:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116374016 00000100:00100000:2.0:1788837959.249465:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116374016 00000100:00100000:2.0:1788837959.249513:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1042 00000100:00100000:2.0:1788837959.249525:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116374016:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837959.249637:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116374016:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 114us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837959.249645:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1042 00000100:00100000:2.0:1788837959.249682:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1052 00000100:00100000:2.0:1788837959.249687:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116373888:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:2.0:1788837959.249710:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788837959.249738:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116373888:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 50us (421us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788837959.249745:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1052 00000100:00080000:2.0:1788837959.249766:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788837959.612965:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788837960.062377:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837943/real 1788837943] req@ffff8ff626a8a680 x1875729134948864/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788837959 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000001:00100000:3.0:1788837960.063346:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:3.0:1788837960.063353:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff6104df800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:2.0:1788837960.064568:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104df800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-OST0000 00000020:00000080:2.0:1788837960.064618:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6104dd800 for lustre-OST0000 00000100:00100000:3.0:1788837960.067031:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134954752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837960.067105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:3.0:1788837960.068995:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:3.0:1788837960.069005:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff6048e5000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:2.0:1788837960.069149:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6048e5000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-OST0001 00000020:00000080:2.0:1788837960.069288:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6048e2800 for lustre-OST0001 00000100:00100000:3.0:1788837960.070185:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837960.070209:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134954880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837960.070296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837960.070477:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134954752 00000100:00100000:2.0:1788837960.070486:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134954752 00000100:00100000:2.0:1788837960.070642:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134954880 00000100:00100000:2.0:1788837960.070647:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134954880 00000100:00100000:0.0:1788837960.070687:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:0.0:1788837960.070698:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134954752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837960.070731:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837960.070777:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134954752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837960.070784:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00100000:0.0:1788837960.070837:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:0.0:1788837960.070846:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134954880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837960.070863:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837960.070877:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134954752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837960.070907:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134954880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837960.070911:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134954880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837960.070918:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00100000:1.0:1788837960.101613:0:3644:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8ff626a8a680 x1875729134948864/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788837959 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788837960.101628:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788837960.101632:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788837960.113031:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788837960.113038:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788837960.113048:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff626a8a680 x1875729134948864/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788837959 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837960.113063:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff609dd5f80 x1875729134950784/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788837964 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837960.113662:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff501afc000 x1875729134952192/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788837969 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837960.113681:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff604230e00 x1875729134953600/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788837975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788837960.113690:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788837960.113693:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788837960.113694:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788837960.113696:0:3644:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1788837960.113871:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff501afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134952192:0@lo:400:kworker.0 00000100:00100000:0.0:1788837960.113972:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134950784:0@lo:400:kworker.0 00000100:00100000:0.0:1788837960.113998:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134953600:0@lo:400:kworker.0 00000100:00100000:0.0:1788837960.114003:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134948864:0@lo:400:kworker.0 00000100:00080000:1.0:1788837960.114204:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837960.114210:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788837960.114213:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837960.114219:0:27607:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3120 00000100:00080000:1.0:1788837960.114226:0:27607:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837960.114255:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff632fce680 x1875729134955008/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837960.114292:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837960.114308:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837960.114310:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837960.114314:0:27607:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3353 00000100:00080000:1.0:1788837960.114317:0:27607:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788837960.114321:0:27607:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837960.114339:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd2f480 x1875729134955136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788837960.114403:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729134955008:0@lo:250:kworker.0 00000100:00100000:3.0:1788837960.114410:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134955264:0@lo:400:kworker.0 00000400:00000100:0.0:1788837960.114455:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729134955008 offset 0 length 520: 4 00000100:00080000:1.0:1788837960.114469:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837960.114478:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837960.114480:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837960.114484:0:27607:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3353 00000100:00080000:1.0:1788837960.114487:0:27607:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788837960.114491:0:27607:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837960.114505:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639542300 x1875729134955392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837960.114522:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837960.114525:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837960.114526:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837960.114529:0:27607:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3353 00000100:00080000:1.0:1788837960.114531:0:27607:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788837960.114534:0:27607:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837960.114545:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639541500 x1875729134955648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837960.114554:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788837960.114563:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788837960.114564:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788837960.117682:0:27607:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3353 00000100:00080000:1.0:1788837960.117690:0:27607:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788837960.117698:0:27607:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837960.117753:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639542d80 x1875729134955776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837960.118720:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837960.118938:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837960.118953:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729134955520:0@lo:400:kworker.0 00000100:00100000:3.0:1788837960.119003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837960.119523:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134955136:0@lo:38:kworker.0 00000100:00100000:3.0:1788837960.122256:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837960.125418:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134955264 00000100:00100000:1.0:1788837960.125431:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134955264 00000100:00100000:1.0:1788837960.125500:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134955520 00000100:00100000:1.0:1788837960.125503:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134955520 00000100:00100000:1.0:1788837960.125531:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1788837960.125542:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134955264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837960.125768:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1788837960.125779:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729134955520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837960.125895:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729134955520:12345-0@lo:400:kworker.0 Request processed in 119us (6890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837960.126181:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1788837960.126347:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134955264:12345-0@lo:400:kworker.0 Request processed in 805us (7628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837960.126355:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1788837960.126857:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134955136 00000100:00100000:1.0:1788837960.126864:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134955136 00000100:00100000:1.0:1788837960.126900:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1788837960.126907:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134955136:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788837960.126928:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837960.127046:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729134955520:0@lo:400:kworker.0 00000100:00100000:1.0:1788837960.127701:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134955136:12345-0@lo:38:kworker.0 Request processed in 790us (5451us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837960.127711:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1788837960.127853:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134955264:0@lo:400:kworker.0 00000100:00080000:3.0:1788837960.127902:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837960.127908:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837960.127912:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134955136:0@lo:38:kworker.0 00000100:00100000:3.0:1788837960.127931:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134955392:0@lo:38:kworker.0 00000100:00100000:3.0:1788837960.128205:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837960.128245:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134955648:0@lo:38:kworker.0 00000100:00100000:3.0:1788837960.128287:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837960.128312:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134955776:0@lo:38:kworker.0 00000100:00100000:3.0:1788837960.128337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837960.128427:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134955648 00000100:00100000:1.0:1788837960.128434:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134955648 00000100:00100000:1.0:1788837960.128470:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:1.0:1788837960.128485:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134955648:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788837960.128503:0:37907:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837960.128539:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134955648:12345-0@lo:38:kworker.0 Request processed in 54us (251us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837960.128546:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00100000:1.0:1788837960.128564:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134955392 00000100:00100000:0.0:1788837960.128667:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134955776 00000100:00100000:0.0:1788837960.128671:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134955776 00000100:00100000:0.0:1788837960.128694:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1788837960.128699:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134955776:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788837960.128709:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788837960.128835:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134955776:12345-0@lo:38:kworker.0 Request processed in 134us (496us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837960.128848:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1788837960.128993:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134955392 00000100:00080000:3.0:1788837960.129994:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837960.130005:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837960.130010:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134955648:0@lo:38:kworker.0 00000100:00080000:3.0:1788837960.130023:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837960.130027:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837960.130029:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134955776:0@lo:38:kworker.0 00000100:00100000:1.0:1788837960.130122:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:1.0:1788837960.130129:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134955392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788837960.130149:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837960.130224:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134955392:12345-0@lo:38:kworker.0 Request processed in 94us (2019us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837960.130231:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00080000:3.0:1788837960.130363:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837960.130382:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837960.130385:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134955392:0@lo:38:kworker.0 00010000:00010000:2.0:1788837960.637949:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837961.679430:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837962.685710:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837963.708962:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837964.352074:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837964.352374:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837964.353863:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116374272 00000100:00100000:1.0:1788837964.353877:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116374272 00000100:00100000:1.0:1788837964.353949:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116374144 00000100:00100000:1.0:1788837964.353953:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116374144 00000100:00100000:1.0:1788837964.353978:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1045 00000100:00100000:1.0:1788837964.353992:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116374272:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788837964.354766:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116374272:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 774us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837964.354776:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1045 00000100:00100000:1.0:1788837964.354824:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1056 00000100:00100000:1.0:1788837964.354829:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116374144:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:1.0:1788837964.354849:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788837964.354909:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116374144:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 78us (2535us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788837964.354917:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1056 00000100:00080000:0.0:1788837964.357156:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788837964.735491:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837965.187243:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134955904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837965.187333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837965.187403:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134955904 00000100:00100000:3.0:1788837965.187410:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134955904 00000100:00100000:3.0:1788837965.187473:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:3.0:1788837965.187484:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134955904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837965.187518:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837965.187570:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134955904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837965.187577:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00080000:3.0:1788837965.187601:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837965.187645:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134955904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837965.189054:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788837965.189069:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134956032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837965.189131:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837965.189174:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134956032 00000100:00100000:2.0:1788837965.189179:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134956032 00000100:00100000:2.0:1788837965.189223:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:2.0:1788837965.189244:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134956032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837965.189274:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837965.189318:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134956032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837965.189339:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00080000:2.0:1788837965.189359:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837965.189391:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134956032:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788837965.200322:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837965.200330:0:63434:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788837965.200333:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837965.200337:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837965.200341:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837965.200349:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3354 00000100:00080000:3.0:1788837965.200353:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788837965.200361:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788837965.200400:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640e55f80 x1875729134956160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837965.200469:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837965.200473:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837965.200475:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837965.200479:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3354 00000100:00080000:3.0:1788837965.200482:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788837965.200486:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788837965.200501:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640e54000 x1875729134956416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837965.200518:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837965.200521:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837965.200523:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837965.200527:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3354 00000100:00080000:3.0:1788837965.200529:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788837965.200532:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788837965.200543:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640e55c00 x1875729134956672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788837965.200553:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788837965.200556:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788837965.200558:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788837965.200561:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3354 00000100:00080000:3.0:1788837965.200563:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788837965.200566:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788837965.200575:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640e54a80 x1875729134956800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837965.200610:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134956288:0@lo:400:kworker.0 00000100:00100000:3.0:1788837965.200693:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837965.200744:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837965.201166:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729134956544:0@lo:400:kworker.0 00000100:00100000:3.0:1788837965.201197:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837965.201242:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134956160:0@lo:38:kworker.0 00000100:00100000:3.0:1788837965.201268:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837965.201287:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134956416:0@lo:38:kworker.0 00000100:00100000:3.0:1788837965.201309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837965.201325:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134956672:0@lo:38:kworker.0 00000100:00100000:3.0:1788837965.201349:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837965.201366:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134956800:0@lo:38:kworker.0 00000100:00100000:3.0:1788837965.201384:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837965.201416:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134956288 00000100:00100000:3.0:1788837965.201422:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134956288 00000100:00100000:3.0:1788837965.201473:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134956544 00000100:00100000:3.0:1788837965.201476:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134956544 00000100:00100000:3.0:1788837965.201491:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134956160 00000100:00100000:3.0:1788837965.201493:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134956160 00000100:00100000:3.0:1788837965.201502:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134956416 00000100:00100000:3.0:1788837965.201505:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134956416 00000100:00100000:3.0:1788837965.201511:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134956800 00000100:00100000:3.0:1788837965.201513:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134956800 00000100:00100000:3.0:1788837965.201525:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1788837965.201533:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134956288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837965.201585:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134956288:12345-0@lo:400:kworker.0 Request processed in 52us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837965.201600:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1788837965.201618:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1788837965.201625:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729134956544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837965.201667:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729134956544:12345-0@lo:400:kworker.0 Request processed in 43us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837965.201673:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1788837965.201686:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1788837965.201690:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134956160:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788837965.201713:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837965.201745:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134956160:12345-0@lo:38:kworker.0 Request processed in 53us (476us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837965.202428:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1788837965.202446:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1788837965.202451:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134956416:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788837965.202464:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837965.202505:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134956416:12345-0@lo:38:kworker.0 Request processed in 53us (1195us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837965.202511:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1788837965.202523:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1788837965.202528:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134956800:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788837965.202537:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837965.202563:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134956800:12345-0@lo:38:kworker.0 Request processed in 34us (1178us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837965.202569:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1788837965.202627:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729134956544:0@lo:400:kworker.0 00000100:00080000:2.0:1788837965.205199:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837965.207490:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134956288:0@lo:400:kworker.0 00000100:00080000:3.0:1788837965.207566:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837965.207572:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837965.207575:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134956160:0@lo:38:kworker.0 00000100:00080000:3.0:1788837965.207588:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837965.207591:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837965.207593:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134956416:0@lo:38:kworker.0 00000100:00080000:3.0:1788837965.207603:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837965.207606:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837965.207608:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134956800:0@lo:38:kworker.0 00000100:00100000:0.0:1788837965.209447:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134956672 00000100:00100000:0.0:1788837965.209460:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134956672 00000100:00100000:0.0:1788837965.209507:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:0.0:1788837965.209515:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134956672:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788837965.209538:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788837965.209642:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134956672:12345-0@lo:38:kworker.0 Request processed in 119us (8284us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837965.209650:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00080000:3.0:1788837965.209942:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837965.209949:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837965.209953:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134956672:0@lo:38:kworker.0 00010000:00010000:2.0:1788837965.759005:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837966.780920:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837967.806837:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788837968.054454:0:85159:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788837968.054462:0:85159:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788837968.054463:0:85159:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788837968.055511:0:85159:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ff604fe2800 00000020:01000004:3.0:1788837968.055538:0:85159:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788837968.055557:0:85159:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788837968.055574:0:85159:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ff6271ccd28) 00000020:00000080:3.0:1788837968.055593:0:85159:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788837968.226549:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788837968.234496:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788837968.235542:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788837968.236255:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788837968.236538:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788837968.236826:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788837968.237220:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788837968.237472:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788837968.237698:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788837968.238124:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788837968.239417:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788837968.239732:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788837968.241665:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788837968.242286:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788837968.245779:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788837968.246934:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.256862:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788837968.257566:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.259421:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.259942:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.260280:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.260540:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.261149:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.261374:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.261602:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.262167:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.262534:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.263125:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.263374:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.264283:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.264522:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.265149:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.266186:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.266784:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.267263:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.268419:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.268737:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.269745:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.270367:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.270634:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.274852:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.275367:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.275582:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.275828:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.276245:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788837968.276508:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.276732:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788837968.278618:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788837968.279340:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788837968.279751:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788837968.280766:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788837968.281312:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788837968.281602:0:85159:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788837968.282515:0:85159:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788837968.283938:0:85159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788837968.283949:0:85159:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788837968.283976:0:85159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc7d34 00000020:01000004:1.0:1788837968.283996:0:85159:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788837968.284011:0:85159:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788837968.284018:0:85159:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff604fe2800 from MGS 00000020:01000004:1.0:1788837968.284022:0:85159:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788837968.284037:0:85159:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ff503ca4d28) 00000020:00000080:1.0:1788837968.284052:0:85159:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1788837968.284117:0:85159:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff604fe2800 from MGS, refs=2 00080000:01000000:1.0:1788837968.284122:0:85159:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788837968.284126:0:85159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc7d42 00010000:00010000:1.0:1788837968.284281:0:85159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1788837968.294475:0:85159:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788837968.305078:0:85163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788837968.305159:0:85159:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788837968.305238:0:85159:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788837968.305888:0:85159:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788837968.306158:0:85159:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788837968.306346:0:85159:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788837968.306352:0:85159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788837968.315509:0:85159:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788837968.315525:0:85159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788837968.316215:0:85159:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788837968.316225:0:85159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788837968.317485:0:85159:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788837968.317514:0:85159:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788837968.317516:0:85159:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788837968.317520:0:85159:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788837968.317527:0:85159:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 55, was 0): CONNECTING 00000100:00100000:1.0:1788837968.317533:0:85159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00010000:00010000:2.0:1788837968.829103:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837969.475933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837969.476938:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116374656 00000100:00100000:3.0:1788837969.476958:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116374656 00000100:00080000:2.0:1788837969.477259:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837969.477576:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1048 00000100:00100000:3.0:1788837969.477589:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116374656:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837969.477823:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116374656:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 210us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837969.477832:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1048 00000100:00100000:2.0:1788837969.477946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837969.478508:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116374400 00000100:00100000:2.0:1788837969.478517:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116374400 00000100:00100000:1.0:1788837969.478544:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837969.478571:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1788837969.478579:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505a7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1875729116374400:12345-192.168.203.30@tcp:250:kworker.0 00010000:00080000:2.0:1788837969.478609:0:85165:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4043f878-3455-4729-a2a8-e06e8394cc00@192.168.203.30@tcp t0 exp 0000000000000000 cur 3363 last 0 00000020:00000080:2.0:1788837969.478664:0:85165:0:(genops.c:1385:class_connect()) connect: client 4043f878-3455-4729-a2a8-e06e8394cc00, cookie 0x88da08396ccc7d49 00000100:00080000:2.0:1788837969.478885:0:85165:0:(import.c:65:import_set_state_nolock()) ffff8ff509c60800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837969.478934:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505a7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+5:2403:x1875729116374400:12345-192.168.203.30@tcp:250:kworker.0 Request processed in 354us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837969.478942:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:0.0:1788837969.513122:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116374528 00000100:00100000:0.0:1788837969.513145:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116374528 00000100:00100000:0.0:1788837969.513260:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1060 00000100:00100000:0.0:1788837969.513271:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116374528:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:0.0:1788837969.513303:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788837969.513406:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116374528:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 135us (34873us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788837969.513413:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1060 00010000:00010000:2.0:1788837969.855970:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788837970.301423:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837970.301442:0:63434:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788837970.301445:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837970.301449:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788837970.301455:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837970.301466:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3359 00000100:00080000:2.0:1788837970.301473:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788837970.301483:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788837970.301516:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff604231500 x1875729134957184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837970.301570:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837970.301573:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788837970.301575:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837970.301579:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3359 00000100:00080000:2.0:1788837970.301581:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788837970.301585:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788837970.301753:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134957312:0@lo:400:kworker.0 00000100:00100000:0.0:1788837970.301903:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837970.301993:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134957312 00000100:00100000:0.0:1788837970.302004:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134957312 00000100:00100000:0.0:1788837970.302096:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1788837970.302108:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134957312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837970.302174:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134957312:12345-0@lo:400:kworker.0 Request processed in 67us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.302182:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1788837970.302252:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134957312:0@lo:400:kworker.0 00000100:00100000:0.0:1788837970.302311:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134957056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837970.302343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837970.302366:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788837970.302372:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134956928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837970.302396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837970.302444:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134957056 00000100:00100000:0.0:1788837970.302448:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134957056 00000100:00100000:0.0:1788837970.302476:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134956928 00000100:00100000:0.0:1788837970.302479:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134956928 00000100:00100000:0.0:1788837970.302497:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:0.0:1788837970.302504:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134957056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837970.302531:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837970.302571:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134957056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.302578:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:0.0:1788837970.302591:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:0.0:1788837970.302597:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134956928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788837970.302881:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837970.302911:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134956928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 314us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.302918:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00080000:0.0:1788837970.302935:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837970.303013:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a8a680 x1875729134957440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837970.303159:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837970.303163:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788837970.303165:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837970.303170:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3359 00000100:00080000:2.0:1788837970.303173:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788837970.303177:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788837970.303206:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a8bb80 x1875729134957696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837970.303216:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837970.303219:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788837970.303221:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788837970.303224:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3359 00000100:00080000:2.0:1788837970.303226:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788837970.303230:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788837970.303243:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a89500 x1875729134957824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788837970.303273:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134957568:0@lo:400:kworker.0 00000100:00100000:2.0:1788837970.303306:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.303371:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134956928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837970.303387:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134957056:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788837970.303487:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837970.303490:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837970.303559:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788837960/real 1788837960] req@ffff8ff632fce680 x1875729134955008/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788837970 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837970.303579:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ff632fce680 x1875729134955008/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788837970 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788837970.303593:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134957184:0@lo:38:kworker.0 00000100:00100000:3.0:1788837970.303638:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.303666:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134957440:0@lo:38:kworker.0 00000100:00100000:3.0:1788837970.303689:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.303709:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134957696:0@lo:38:kworker.0 00000100:00100000:3.0:1788837970.303734:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.303754:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134957824:0@lo:38:kworker.0 00000100:00100000:3.0:1788837970.303777:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788837970.303793:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837970.303824:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788837970.303830:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729134955008:0@lo:250:kworker.0 00000100:00100000:3.0:1788837970.303867:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134957696 00000100:00100000:3.0:1788837970.303872:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134957696 00000100:00100000:3.0:1788837970.303898:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:3.0:1788837970.303904:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134957696:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788837970.303923:0:37907:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837970.303972:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134957696:12345-0@lo:38:kworker.0 Request processed in 67us (237us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837970.303979:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:3.0:1788837970.304004:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134957568 00000100:00100000:3.0:1788837970.304008:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134957568 00000100:00100000:3.0:1788837970.304051:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134957184 00000100:00100000:3.0:1788837970.304055:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134957184 00000100:00100000:3.0:1788837970.304070:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134957440 00000100:00100000:3.0:1788837970.304266:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134957440 00000100:00100000:3.0:1788837970.304282:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134957824 00000100:00100000:3.0:1788837970.304285:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134957824 00000100:00100000:3.0:1788837970.304296:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1788837970.304303:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134957568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837970.304348:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134957568:12345-0@lo:400:kworker.0 Request processed in 46us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.304356:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1788837970.304369:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1788837970.304374:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134957184:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788837970.304385:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837970.304409:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134957184:12345-0@lo:38:kworker.0 Request processed in 33us (771us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837970.304415:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1788837970.304661:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1788837970.304666:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134957440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788837970.304676:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837970.304703:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134957440:12345-0@lo:38:kworker.0 Request processed in 36us (1013us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837970.304709:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1788837970.304720:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1788837970.304724:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134957824:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788837970.304732:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788837970.304755:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134957824:12345-0@lo:38:kworker.0 Request processed in 30us (978us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788837970.304761:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1788837970.304830:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134957568:0@lo:400:kworker.0 00000100:00080000:3.0:1788837970.304871:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837970.304876:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837970.304880:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134957184:0@lo:38:kworker.0 00000100:00080000:3.0:1788837970.304889:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837970.304892:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837970.304896:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134957440:0@lo:38:kworker.0 00000100:00080000:3.0:1788837970.304905:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837970.304909:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788837970.304912:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134957696:0@lo:38:kworker.0 00000100:00080000:3.0:1788837970.304926:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837970.304930:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 10000000:01000000:1.0:1788837970.305010:0:85159:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1788837970.305031:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607460c00/0x88da08396ccc79fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7a01 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305045:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607460c00/0x88da08396ccc79fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7a01 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.305053:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788837970.305066:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305075:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607460c00/0x88da08396ccc79fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7a01 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.305091:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc7959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7960 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305099:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc7959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7960 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.305125:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837970.305129:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305133:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc7959 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7960 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.305143:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f000/0x88da08396ccc7975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc797c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305150:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f000/0x88da08396ccc7975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc797c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.305155:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837970.305158:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305161:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f000/0x88da08396ccc7975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc797c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.305169:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5e00/0x88da08396ccc799f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc79a6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305175:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5e00/0x88da08396ccc799f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc79a6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.305180:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837970.305183:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305199:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5e00/0x88da08396ccc799f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc79a6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.305208:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff6421c6c00/0x88da08396ccc79b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc79bb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305224:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff6421c6c00/0x88da08396ccc79b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc79bb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.305229:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837970.305241:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305245:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff6421c6c00/0x88da08396ccc79b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc79bb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.305255:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f200/0x88da08396ccc79d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc79d7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305262:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f200/0x88da08396ccc79d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc79d7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.305267:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837970.305270:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305273:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f200/0x88da08396ccc79d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc79d7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.305281:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607461000/0x88da08396ccc79de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc79e5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305286:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607461000/0x88da08396ccc79de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc79e5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.305291:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837970.305295:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305298:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607461000/0x88da08396ccc79de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc79e5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.305316:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc7a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7a0f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305324:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc7a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7a0f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.305329:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837970.305332:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305335:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc7a08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7a0f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.305346:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e400/0x88da08396ccc7967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc796e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305352:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e400/0x88da08396ccc7967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc796e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.305356:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837970.305359:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305363:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e400/0x88da08396ccc7967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc796e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788837970.305376:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:1.0:1788837970.305378:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5a00/0x88da08396ccc7983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc798a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788837970.305389:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 10000000:00010000:1.0:1788837970.305394:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5a00/0x88da08396ccc7983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc798a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788837970.305404:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 10000000:01000000:1.0:1788837970.305405:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00080000:2.0:1788837970.305414:0:63434:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3354 00010000:00010000:1.0:1788837970.305420:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:2.0:1788837970.305421:0:63434:0:(import.c:589:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 5s 00010000:00010000:1.0:1788837970.305429:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff6082a5a00/0x88da08396ccc7983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc798a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788837970.305442:0:63434:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00010000:00010000:1.0:1788837970.305453:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4400/0x88da08396ccc7991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7998 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305462:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4400/0x88da08396ccc7991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7998 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.305470:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a89180 x1875729134957952/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:1.0:1788837970.305472:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837970.305483:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305489:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4400/0x88da08396ccc7991 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7998 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.305516:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff6421c6e00/0x88da08396ccc79c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc79c9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305523:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff6421c6e00/0x88da08396ccc79c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc79c9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.305529:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837970.305534:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305538:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff6421c6e00/0x88da08396ccc79c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc79c9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.305546:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4a00/0x88da08396ccc79ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc79f3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.305552:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4a00/0x88da08396ccc79ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc79f3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837970.305565:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134957824:0@lo:38:kworker.0 10000000:01000000:1.0:1788837970.305581:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788837970.305587:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.305592:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff6082a4a00/0x88da08396ccc79ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc79f3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788837970.305609:0:85159:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 56, was 0): CONNECTING 00000100:00080000:1.0:1788837970.305614:0:85159:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1788837970.305670:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729134957952:0@lo:250:kworker.0 00000100:00100000:3.0:1788837970.305713:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788837970.305895:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837970.306051:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134957952 00000100:00100000:2.0:1788837970.306059:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134957952 00000100:00100000:2.0:1788837970.306104:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788837970.306111:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3642:x1875729134957952:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1788837970.306133:0:85167:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo t0 exp 0000000000000000 cur 3364 last 0 00000020:00000080:2.0:1788837970.306168:0:85167:0:(genops.c:1385:class_connect()) connect: client 57943c9a-ca27-46d8-8845-5d2bce640e45, cookie 0x88da08396ccc7d50 00000100:00080000:2.0:1788837970.306344:0:85167:0:(import.c:65:import_set_state_nolock()) ffff8ff509c60000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837970.306409:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+5:3642:x1875729134957952:12345-0@lo:250:kworker.0 Request processed in 297us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.306417:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788837970.306858:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 10000000:01000000:3.0:1788837970.306871:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:3.0:1788837970.306875:0:3642:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x88da08396ccc7d50 00000100:00080000:3.0:1788837970.317212:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:3.0:1788837970.317235:0:3642:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:3.0:1788837970.323030:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729134957952:0@lo:250:kworker.0 00000100:00080000:1.0:1788837970.323176:0:85159:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:1.0:1788837970.323203:0:85159:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788837970.323265:0:85159:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788837970.323273:0:85159:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788837970.323420:0:85159:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788837970.323470:0:85159:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788837970.323476:0:85159:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788837970.323478:0:85159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788837970.323479:0:85159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837970.323480:0:85159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837970.323482:0:85159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837970.323484:0:85159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837970.323485:0:85159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837970.323487:0:85159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788837970.323490:0:85159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837970.323491:0:85159:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788837970.323494:0:85159:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788837970.323496:0:85159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788837970.323498:0:85159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788837970.323499:0:85159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788837970.323500:0:85159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788837970.323501:0:85159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788837970.323502:0:85159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788837970.323503:0:85159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788837970.323504:0:85159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788837970.323505:0:85159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788837970.323506:0:85159:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788837970.323544:0:85159:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788837970.323576:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff609240e40 going to sleep for 0 seconds 00000100:00100000:1.0:1788837970.323583:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134958080:0@lo:253:mount.lustre.0 00000020:00080000:1.0:1788837970.323598:0:85159:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:1.0:1788837970.323619:0:85159:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff604fe2800 from lustre-MDT0000 10000000:01000000:1.0:1788837970.323643:0:85159:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788837970.323647:0:85159:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788837970.323657:0:85159:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ff604fe2800 10000000:01000000:1.0:1788837970.323661:0:85159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788837970.323666:0:85159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ff604fe2800 10000000:01000000:1.0:1788837970.323732:0:85159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788837970.323738:0:85159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff604fe2800 from 1 10000000:01000000:1.0:1788837970.323741:0:85159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788837970.323781:0:85159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.323844:0:85159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.323856:0:85159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837970.323866:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff609240d80 going to sleep for 0 seconds 00000100:00100000:1.0:1788837970.323870:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134958208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837970.323879:0:85159:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.323887:0:85159:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.323905:0:85159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.323915:0:85159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.323923:0:85159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.323930:0:85159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712da00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788837970.323934:0:85159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.323942:0:85159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.323950:0:85159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.323956:0:85159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837970.323960:0:85159:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788837970.323968:0:85159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.323974:0:85159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc7d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.323996:0:85159:0:(mgc_request.c:1817:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:1.0:1788837970.323999:0:85159:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:2.0:1788837970.324457:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level EVICTED/10 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788837970.324464:0:63434:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1788837970.325113:0:85168:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.203.130@tcp to MGS@0@lo 00000100:00100000:0.0:1788837970.325118:0:85168:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788837970.325121:0:85168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:0.0:1788837970.325140:0:85168:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1788837970.325148:0:85168:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from RECOVER to FULL 10000000:01000000:0.0:1788837970.325149:0:85168:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788837970.325185:0:85168:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:0.0:1788837970.325197:0:85168:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) MGC192.168.203.130@tcp: Connection restored to 0@lo (at 0@lo) 10000000:01000000:1.0:1788837970.325456:0:85159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff604fe2800 from 1 10000000:01000000:1.0:1788837970.325460:0:85159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788837970.325492:0:85159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.325503:0:85159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.325511:0:85159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837970.325531:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134958336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788837970.325641:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837970.325698:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff609240d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837970.325854:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134958336 00000100:00100000:2.0:1788837970.325866:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134958336 00000100:00100000:2.0:1788837970.325936:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788837970.325957:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+5:85159:x1875729134958336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837970.325976:0:85166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837970.325996:0:85166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4800/0x88da08396ccc7d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7d5e expref: -99 pid: 85166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.326022:0:85166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4800/0x88da08396ccc7d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7d5e expref: 6 pid: 85166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.326046:0:85166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4800/0x88da08396ccc7d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7d5e expref: 6 pid: 85166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.326057:0:85166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4800, rc 0) 00000100:00100000:2.0:1788837970.326116:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+6:85159:x1875729134958336:12345-0@lo:101:mount.lustre.0 Request processed in 161us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.326123:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:3.0:1788837970.326385:0:63434:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.130@tcp 10000000:01000000:3.0:1788837970.326409:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788837970.326413:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788837970.326415:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788837970.326416:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837970.326417:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837970.326419:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837970.326420:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837970.326422:0:63434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837970.326433:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837970.326435:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788837970.326475:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788837970.326484:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788837970.326486:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788837970.326487:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837970.326488:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837970.326489:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837970.326491:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837970.326492:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837970.326493:0:63434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837970.326495:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837970.326496:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788837970.326509:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788837970.326514:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1788837970.326523:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788837970.326524:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788837970.326525:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837970.326526:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837970.326527:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837970.326529:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837970.326530:0:63434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788837970.326531:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837970.326533:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788837970.326559:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788837970.326612:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837970.326626:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134958720:0@lo:253:kworker.0 00000100:00100000:3.0:1788837970.326837:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.326894:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134958720 00000100:00100000:3.0:1788837970.326899:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134958720 00000100:00100000:3.0:1788837970.326928:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788837970.326936:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+6:3644:x1875729134958720:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788837970.326972:0:85165:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1788837970.327304:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134958592:0@lo:253:kworker.0 00000100:00100000:2.0:1788837970.327348:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.327370:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837970.327375:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134958464:0@lo:253:kworker.0 00000100:00100000:2.0:1788837970.327406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.327445:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134958592 00000100:00100000:2.0:1788837970.327449:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134958592 00000100:00100000:2.0:1788837970.327469:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134958464 00000100:00100000:2.0:1788837970.327472:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134958464 00000100:00100000:2.0:1788837970.327483:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788837970.327489:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505a7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3646:x1875729134958592:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788837970.327507:0:85166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1788837970.328028:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134958336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837970.328061:0:85159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.328082:0:85159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.328103:0:85159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788837970.328111:0:85159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.328119:0:85159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.328127:0:85159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788837970.328133:0:85159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788837970.328146:0:85159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ff604fe2800 10000000:01000000:1.0:1788837970.328151:0:85159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788837970.328155:0:85159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788837970.328158:0:85159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788837970.328187:0:85159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.328205:0:85159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.328213:0:85159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837970.328228:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134958848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788837970.328258:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837970.328276:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff609240d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788837970.328301:0:85167:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1788837970.328308:0:85167:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1788837970.329022:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134958848 00000100:00100000:0.0:1788837970.329031:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134958848 10000000:01000000:3.0:1788837970.329321:0:85169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788837970.329497:0:85165:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 105 00000100:00100000:1.0:1788837970.330574:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788837970.330589:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+9:3646:x1875729134958464:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788837970.330635:0:85170:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788837970.332663:0:85171:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788837970.332681:0:85171:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788837970.332685:0:85171:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788837970.332688:0:85171:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788837970.332950:0:85171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788837970.333335:0:85165:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788837970.333368:0:85165:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788837970.337177:0:85165:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788837970.337208:0:85165:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788837970.337443:0:85166:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788837970.338579:0:85169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788837970.338588:0:85169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788837970.338623:0:85169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.338646:0:85169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788837970.338676:0:85169:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000089725s 00010000:00010000:3.0:1788837970.338682:0:85169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.338690:0:85169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.338714:0:85169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.338724:0:85169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.338731:0:85169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788837970.338735:0:85169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.338745:0:85169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.338762:0:85169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.338770:0:85169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.338777:0:85169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7d73 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837970.338988:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:3644:x1875729134958720:12345-0@lo:253:kworker.0 Request processed in 12046us (12146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.339006:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788837970.339162:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788837970.339180:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:85159:x1875729134958848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837970.339212:0:85165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837970.339234:0:85165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8000/0x88da08396ccc7d7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7d6c expref: -99 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.339271:0:85165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8000/0x88da08396ccc7d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7d6c expref: 9 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.339282:0:85165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8000/0x88da08396ccc7d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7d6c expref: 9 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.339290:0:85165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8000, rc 0) 00000100:00100000:0.0:1788837970.339341:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:85159:x1875729134958848:12345-0@lo:101:mount.lustre.0 Request processed in 169us (11082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.339349:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788837970.339874:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134958848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837970.339900:0:85159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.339911:0:85159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837970.340367:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134958976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837970.340416:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.340467:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788837970.340515:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134958976 00000100:00100000:1.0:1788837970.340522:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134958976 00000100:00100000:1.0:1788837970.340579:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837970.340588:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:85159:x1875729134958976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837970.341016:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85159:x1875729134958976:12345-0@lo:501:mount.lustre.0 Request processed in 428us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837970.341024:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788837970.341221:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134958976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837970.341258:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134959104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788837970.341303:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837970.341319:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff609240180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837970.341338:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134959104 00000100:00100000:1.0:1788837970.341343:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134959104 00000100:00100000:1.0:1788837970.341359:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788837970.341366:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85159:x1875729134959104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788837970.344422:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85159:x1875729134959104:12345-0@lo:503:mount.lustre.0 Request processed in 3041us (3104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837970.344449:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788837970.345763:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134959104:0@lo:503:mount.lustre.0 20000000:01000000:1.0:1788837970.348872:0:85166:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788837970.348888:0:85166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788837970.349303:0:85170:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788837970.349876:0:85169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788837970.349883:0:85169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788837970.349913:0:85169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.349935:0:85169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788837970.349956:0:85169:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000089725s 00010000:00010000:3.0:1788837970.349962:0:85169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.349969:0:85169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.349975:0:85169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.349982:0:85169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.349989:0:85169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788837970.349994:0:85169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.350023:0:85169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.350047:0:85169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.350057:0:85169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.350063:0:85169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7d81 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837970.350692:0:85172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85172:1875729134959232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837970.350829:0:85172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837970.350873:0:85172:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff609240600 going to sleep for 11 seconds 00000020:01000004:2.0:1788837970.353586:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788837970.353594:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788837970.353596:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788837970.353603:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788837970.353605:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788837970.353608:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788837970.353610:0:3644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788837970.353612:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788837970.353614:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788837970.353621:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134958720:0@lo:253:kworker.0 00000100:00100000:3.0:1788837970.354563:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134959232 00000100:00100000:3.0:1788837970.354575:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134959232 00000100:00100000:3.0:1788837970.354646:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788837970.354658:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85172:x1875729134959232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837970.356607:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85172:x1875729134959232:12345-0@lo:502:llog_process_th.0 Request processed in 1933us (5761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.356622:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788837970.356925:0:85172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85172:1875729134959232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788837970.356987:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837970.357004:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837970.357007:0:85172:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788837970.357014:0:85172:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788837970.357017:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837970.357060:0:85172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ff503ca3370) 00000020:00000080:1.0:1788837970.357374:0:85172:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1788837970.357384:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788837970.357503:0:85172:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788837970.357512:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc7d8f 00000020:00000080:1.0:1788837970.358018:0:85172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788837970.358025:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837970.358030:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837970.358032:0:85172:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788837970.358228:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788837970.358235:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837970.358236:0:85172:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788837970.358240:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837970.358251:0:85172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ff503ca19b8) 00000020:00000080:1.0:1788837970.358267:0:85172:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1788837970.358273:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788837970.358275:0:85172:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788837970.358278:0:85172:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788837970.358286:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788837970.358351:0:85172:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff604fe2800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788837970.358367:0:85172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ff503ca0000) 00000020:00000080:1.0:1788837970.358378:0:85172:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1788837970.358457:0:85172:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788837970.358465:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc7da4 00000020:00000080:1.0:1788837970.358574:0:85172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788837970.358581:0:85172:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788837970.358586:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88da08396ccc7dab 00080000:01000000:1.0:1788837970.358592:0:85172:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788837970.358595:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc7db2 00000100:00100000:0.0:1788837970.360870:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505a7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:3646:x1875729134958592:12345-0@lo:253:kworker.0 Request processed in 33369us (33510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.360885:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:0.0:1788837970.362064:0:85170:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788837970.362085:0:85170:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788837970.362751:0:85169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788837970.362759:0:85169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788837970.362790:0:85169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.362835:0:85169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788837970.362848:0:85169:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000090130s 00010000:00010000:2.0:1788837970.362854:0:85169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.362862:0:85169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.362870:0:85169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.362879:0:85169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.362887:0:85169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837970.362891:0:85169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.362900:0:85169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.362915:0:85169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.362923:0:85169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.362952:0:85169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc7db9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837970.363346:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3646:x1875729134958464:12345-0@lo:253:kworker.0 Request processed in 32756us (35934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.363357:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1788837970.374983:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788837970.374993:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788837970.374995:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837970.374996:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837970.374997:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837970.375001:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837970.375003:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837970.375005:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837970.375007:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788837970.375015:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134958592:0@lo:253:kworker.0 00000020:01000004:3.0:1788837970.375067:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788837970.375087:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788837970.375088:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788837970.375090:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788837970.375091:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788837970.375092:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788837970.375093:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788837970.375095:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788837970.375096:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788837970.375099:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134958464:0@lo:253:kworker.0 00010000:00010000:3.0:1788837970.500960:0:85172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788837970.501109:0:85172:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: fdcf066d-ff07-4b2e-96ab-52415ed6bf72 idx: 0 lr: 0 srv lr: 98784247808 lx: 0 gen 23 00000001:00080000:3.0:1788837970.501150:0:85172:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 22 00000001:00000004:3.0:1788837970.501172:0:85172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:3.0:1788837970.501282:0:85172:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788837970.501349:0:85172:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff62ccd36c0: xid 1875729116366080, transno 98784247809, client gen 23, slot idx 0 00000020:00000080:3.0:1788837970.501773:0:85172:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ff6271cb370) 00000020:00000080:3.0:1788837970.501793:0:85172:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1788837970.501895:0:85172:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788837970.501901:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc7dd5 00000020:00000080:1.0:1788837970.506646:0:85172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788837970.523954:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88da08396ccc7ddc 00000020:00000080:2.0:1788837970.524705:0:85172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788837970.524722:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837970.524730:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.524733:0:85172:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788837970.524737:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788837970.524740:0:85172:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788837970.524742:0:85172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788837970.524743:0:85172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788837970.524745:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788837970.524747:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.524749:0:85172:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788837970.524752:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837970.524758:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.524759:0:85172:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788837970.524764:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788837970.524842:0:85172:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788837970.524860:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837970.524864:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.524866:0:85172:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788837970.524868:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837970.524872:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.524873:0:85172:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788837970.524877:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788837970.524883:0:85172:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:2.0:1788837970.524915:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788837970.524934:0:85172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ff610240000) 00000020:00000080:2.0:1788837970.525272:0:85172:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788837970.525287:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788837970.525367:0:85172:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788837970.525374:0:85172:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788837970.525381:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc7dea 00010000:00080000:2.0:1788837970.525418:0:85172:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff608213000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788837970.538062:0:85172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1788837970.547550:0:85172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788837970.547578:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788837970.548302:0:85172:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788837970.548338:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc7df1 00000100:00080000:0.0:1788837970.548354:0:85172:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788837970.549333:0:85172:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ff608213000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788837970.549736:0:85172:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff624ebce00 x1875729134959360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837970.549857:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134959360:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788837970.550032:0:85172:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788837970.550469:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.550820:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788837970.550832:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134959488:0@lo:400:kworker.0 00000100:00100000:2.0:1788837970.550874:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.550910:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134959488 00000100:00100000:2.0:1788837970.550918:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134959488 00000100:00100000:0.0:1788837970.551014:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134959360 00000100:00100000:0.0:1788837970.551018:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134959360 00000100:00100000:0.0:1788837970.551057:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:0.0:1788837970.551065:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134959360:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788837970.551468:0:23765:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3364 last 0 00000020:00000080:0.0:1788837970.551509:0:23765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc7df8 00000004:00100000:0.0:1788837970.551527:0:23765:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788837970.551783:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788837970.551793:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3643:x1875729134959488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837970.551886:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3643:x1875729134959488:12345-0@lo:400:kworker.0 Request processed in 95us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.551894:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788837970.552314:0:23765:0:(import.c:65:import_set_state_nolock()) ffff8ff6057c3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837970.552505:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134959488:0@lo:400:kworker.0 00000020:01000000:1.0:1788837970.552856:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837970.552887:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837970.552890:0:85172:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788837970.552894:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788837970.552911:0:85172:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788837970.552913:0:85172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788837970.552915:0:85172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788837970.552917:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788837970.552920:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837970.552922:0:85172:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788837970.552926:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788837970.552931:0:85172:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788837970.552935:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837970.552936:0:85172:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000100:00100000:0.0:1788837970.553250:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729134959360:12345-0@lo:38:llog_process_th.0 Request processed in 2183us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.553260:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000020:00000080:1.0:1788837970.553309:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788837970.553313:0:85172:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:1.0:1788837970.553343:0:85172:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788837970.553346:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837970.553380:0:85172:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ff502723370) 00000020:00000080:1.0:1788837970.553406:0:85172:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788837970.553413:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788837970.553508:0:85172:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788837970.553516:0:85172:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788837970.553524:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc7e06 00010000:00080000:1.0:1788837970.553558:0:85172:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff6048e0000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788837970.553879:0:85172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:0.0:1788837970.555681:0:85172:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788837970.555716:0:85172:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788837970.556472:0:85172:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:0.0:1788837970.557473:0:85172:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837970.557506:0:85172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:1.0:1788837970.558960:0:85172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:1.0:1788837970.560545:0:85178:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:1.0:1788837970.560553:0:85178:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788837970.561357:0:85178:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:1.0:1788837970.562462:0:85178:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788837970.563906:0:85178:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:1.0:1788837970.563913:0:85178:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788837970.564445:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837970.564463:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1788837970.564476:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788837970.564484:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788837970.564488:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff608213000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788837970.564523:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134959360:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1788837970.564689:0:85172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788837970.564705:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788837970.564764:0:85172:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788837970.564793:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc7e0d 00000100:00080000:2.0:1788837970.564823:0:85172:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837970.564831:0:85172:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff6048e0000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788837970.564878:0:85172:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a89180 x1875729134959616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837970.564904:0:85172:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788837970.565398:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788837970.565405:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837970.565419:0:85172:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788837970.565424:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788837970.565427:0:85172:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788837970.565428:0:85172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788837970.565430:0:85172:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788837970.565432:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788837970.565435:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837970.565436:0:85172:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788837970.565439:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788837970.565444:0:85172:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788837970.565447:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788837970.565448:0:85172:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788837970.565451:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788837970.565455:0:85172:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:1.0:1788837970.565486:0:85172:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788837970.565489:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788837970.565504:0:85172:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ff502720000) 00000020:00000080:1.0:1788837970.565523:0:85172:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788837970.565528:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788837970.565622:0:85172:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788837970.565630:0:85172:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788837970.565638:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc7e1b 00010000:00080000:1.0:1788837970.565689:0:85172:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff640eeb800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788837970.565956:0:85172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1788837970.566042:0:85172:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788837970.566062:0:85172:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788837970.566909:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134959616:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788837970.567022:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.567507:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134959616 00000100:00100000:2.0:1788837970.567525:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134959616 00000100:00100000:2.0:1788837970.567570:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5914 00000100:00100000:2.0:1788837970.567580:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3642:x1875729134959616:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788837970.567625:0:26220:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3364 last 0 00000020:00000080:2.0:1788837970.567660:0:26220:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc7e22 00002000:00100000:2.0:1788837970.567689:0:26220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ff62ceaa800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788837970.567693:0:26220:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788837970.567696:0:26220:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788837970.567790:0:26220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788837970.567840:0:26220:0:(import.c:65:import_set_state_nolock()) ffff8ff62ceab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837970.567906:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729134959616:12345-0@lo:8:llog_process_th.0 Request processed in 326us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.567913:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5914 00000100:00100000:2.0:1788837970.567945:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134959744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788837970.567983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.568018:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134959744 00000100:00100000:2.0:1788837970.568021:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134959744 00000100:00100000:2.0:1788837970.568053:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:2.0:1788837970.568060:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729134959744:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837970.568370:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837970.568381:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788837970.568389:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788837970.568395:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788837970.568398:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6048e0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788837970.568414:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788837970.568421:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134959616:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788837970.568769:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134959872:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788837970.568853:0:85178:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788837970.568927:0:85178:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3364588128340ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788837970.568934:0:85178:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788837970.569051:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837970.569281:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134959872 00000100:00100000:0.0:1788837970.569289:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134959872 00000100:00100000:0.0:1788837970.569346:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:0.0:1788837970.569354:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729134959872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837970.569375:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837970.569420:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729134959872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.569441:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00080000:0.0:1788837970.569465:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837970.569757:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134959872:0@lo:13:osp-pre-0-0.0 00000004:00000024:2.0:1788837970.570515:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788837970.570576:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729134959744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2515us (2591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.570654:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000040:00080000:1.0:1788837970.570897:0:85172:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000100:00100000:2.0:1788837970.571134:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134959744:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788837970.573740:0:85172:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788837970.573776:0:85172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:1.0:1788837970.574305:0:85172:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:1.0:1788837970.575311:0:85180:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:1.0:1788837970.575319:0:85180:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788837970.577059:0:85172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788837970.577141:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788837970.577221:0:85172:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788837970.577256:0:85172:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc7e29 00000100:00080000:2.0:1788837970.577269:0:85172:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788837970.577276:0:85172:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ff640eeb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788837970.577324:0:85172:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a8bb80 x1875729134960000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788837970.577352:0:85172:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788837970.577420:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837970.577424:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.577426:0:85172:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788837970.577430:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837970.577434:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.577436:0:85172:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788837970.577438:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788837970.577441:0:85172:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788837970.577443:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837970.577445:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.577446:0:85172:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788837970.577449:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837970.577451:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.577452:0:85172:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788837970.577456:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788837970.577495:0:85172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85172:1875729134960128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837970.577612:0:85172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.577661:0:85172:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788837970.577757:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134960128 00000100:00100000:0.0:1788837970.577766:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134960128 00000100:00100000:0.0:1788837970.577846:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837970.577857:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:85172:x1875729134960128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837970.578013:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:85172:x1875729134960128:12345-0@lo:502:llog_process_th.0 Request processed in 157us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.578022:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788837970.578068:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134960000:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788837970.578115:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837970.578142:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134960000 00000100:00100000:0.0:1788837970.578146:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134960000 00000100:00100000:0.0:1788837970.578168:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5915 00000100:00100000:0.0:1788837970.578173:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3642:x1875729134960000:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788837970.578208:0:20253:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3364 last 0 00000020:00000080:0.0:1788837970.578242:0:20253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc7e30 00002000:00100000:0.0:1788837970.578260:0:20253:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ff6057c6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788837970.578265:0:20253:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788837970.578268:0:20253:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788837970.578353:0:20253:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788837970.578382:0:20253:0:(import.c:65:import_set_state_nolock()) ffff8ff6057c0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837970.578418:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729134960000:12345-0@lo:8:llog_process_th.0 Request processed in 244us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.578424:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5915 00000100:00100000:0.0:1788837970.578474:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788837970.578484:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788837970.578493:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788837970.578498:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788837970.578500:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff640eeb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788837970.578509:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788837970.578515:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134960000:0@lo:8:llog_process_th.0 00000040:00080000:1.0:1788837970.578828:0:85180:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 3 count 2 00000040:00080000:1.0:1788837970.578857:0:85180:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:1.0:1788837970.578861:0:85180:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1788837970.578882:0:85180:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788837970.578931:0:85180:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3364598132480ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788837970.578948:0:85180:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788837970.579322:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134960384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788837970.579362:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837970.579386:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837970.579391:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134960256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788837970.579414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.579551:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134960384 00000100:00100000:2.0:1788837970.579557:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134960384 00000100:00100000:2.0:1788837970.579611:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:2.0:1788837970.579619:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134960384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837970.579638:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837970.579692:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134960384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.579699:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00080000:2.0:1788837970.579768:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837970.579822:0:85172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85172:1875729134960128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837970.579861:0:85172:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837970.579868:0:85172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.579871:0:85172:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788837970.579875:0:85172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788837970.579970:0:85159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788837970.579995:0:85159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788837970.580015:0:85159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.580026:0:85159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837970.580046:0:85159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff604fe2800 from 1 10000000:01000000:2.0:1788837970.580050:0:85159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788837970.580090:0:85159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.580098:0:85159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.580108:0:85159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.580123:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134960512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788837970.580168:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.580215:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7540 going to sleep for 11 seconds 00000100:00100000:2.0:1788837970.580241:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134960512 00000100:00100000:2.0:1788837970.580245:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134960512 00000100:00100000:2.0:1788837970.580284:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837970.580291:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:85159:x1875729134960512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837970.580302:0:85167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837970.580316:0:85167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc7e3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7e37 expref: -99 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.580341:0:85167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc7e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7e37 expref: 9 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.580352:0:85167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc7e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7e37 expref: 9 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.580361:0:85167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4600, rc 0) 00000100:00100000:2.0:1788837970.580392:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:85159:x1875729134960512:12345-0@lo:101:mount.lustre.0 Request processed in 100us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.580398:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788837970.580431:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134960512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837970.580443:0:85159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.580452:0:85159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.581088:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134960640:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788837970.581147:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.581168:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7540 going to sleep for 11 seconds 00000004:00080000:2.0:1788837970.581280:0:85160:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788837970.581521:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134960640 00000100:00100000:2.0:1788837970.581527:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134960640 00000100:00100000:2.0:1788837970.581563:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788837970.581571:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:85159:x1875729134960640:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788837970.581590:0:85166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788837970.581611:0:85166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788837970.581615:0:85166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788837970.581618:0:85166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788837970.581621:0:85166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 108 00000100:00100000:2.0:1788837970.581711:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:85159:x1875729134960640:12345-0@lo:256:mount.lustre.0 Request processed in 140us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.581720:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788837970.581832:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134960640:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788837970.582280:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134960384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837970.584043:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134960256 00000100:00100000:1.0:1788837970.584057:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134960256 10000000:01000000:2.0:1788837970.584550:0:85159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:1.0:1788837970.584718:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5916 00000100:00100000:1.0:1788837970.584730:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134960256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788837970.584769:0:26207:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:674 count 1 00000100:00100000:1.0:1788837970.585354:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134960256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 625us (5937us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788837970.585362:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5916 00010000:00010000:2.0:1788837970.585596:0:85159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.585611:0:85159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837970.585620:0:85159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff604fe2800 from 1 10000000:01000000:2.0:1788837970.585624:0:85159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837970.585670:0:85159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.585678:0:85159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.585701:0:85159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.585726:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134960768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788837970.585882:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.585923:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7540 going to sleep for 11 seconds 00000004:00080000:0.0:1788837970.586121:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ff639540e00, transno 0 00000004:00080000:0.0:1788837970.586129:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ff639540e00/1, rc -2, transno 0 00000100:00100000:0.0:1788837970.586152:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134960256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788837970.586604:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134960768 00000100:00100000:2.0:1788837970.586613:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134960768 00000100:00100000:2.0:1788837970.586657:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788837970.586665:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:85159:x1875729134960768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788837970.586681:0:85167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837970.586700:0:85167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5400/0x88da08396ccc7e4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7e45 expref: -99 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.586727:0:85167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5400/0x88da08396ccc7e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7e45 expref: 10 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.586739:0:85167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5400/0x88da08396ccc7e4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7e45 expref: 10 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.586749:0:85167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5400, rc 0) 00000100:00100000:2.0:1788837970.586830:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85159:x1875729134960768:12345-0@lo:101:mount.lustre.0 Request processed in 165us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.586838:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:3.0:1788837970.587543:0:85180:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1788837970.587569:0:85180:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1788837970.587860:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134960768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788837970.587883:0:85159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.587895:0:85159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837970.587998:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134960896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837970.588048:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837970.588250:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558000 going to sleep for 11 seconds 00000100:00100000:2.0:1788837970.588406:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134960896 00000100:00100000:2.0:1788837970.588414:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134960896 00000100:00100000:2.0:1788837970.588457:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788837970.588467:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85159:x1875729134960896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788837970.588663:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85159:x1875729134960896:12345-0@lo:501:mount.lustre.0 Request processed in 197us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.588671:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788837970.588955:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134960896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788837970.588994:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134961024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788837970.589042:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837970.589083:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558000 going to sleep for 11 seconds 00000100:00100000:2.0:1788837970.590133:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134961024 00000100:00100000:2.0:1788837970.590146:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134961024 00000100:00100000:2.0:1788837970.590325:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788837970.590336:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85159:x1875729134961024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788837970.590505:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85159:x1875729134961024:12345-0@lo:503:mount.lustre.0 Request processed in 170us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.590513:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788837970.590721:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134961024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837970.591464:0:85182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85182:1875729134961152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837970.591527:0:85182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.591565:0:85182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837970.591680:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134961152 00000100:00100000:2.0:1788837970.591686:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134961152 00000100:00100000:2.0:1788837970.591727:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788837970.591735:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85182:x1875729134961152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837970.592498:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85182:x1875729134961152:12345-0@lo:502:llog_process_th.0 Request processed in 761us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.592507:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1788837970.593893:0:85160:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788837970.594302:0:85182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85182:1875729134961152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788837970.594775:0:85182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837970.594792:0:85182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.595010:0:85182:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788837970.595022:0:85182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff604fe2800 00000020:00000080:2.0:1788837970.595025:0:85182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788837970.595034:0:85182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788837970.595037:0:85182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.595038:0:85182:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788837970.595041:0:85182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788837970.595044:0:85182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788837970.595045:0:85182:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788837970.595061:0:85182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff604fe2800 00000020:00000080:2.0:1788837970.595063:0:85182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788837970.595344:0:85182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85182:1875729134961280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837970.595443:0:85182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.595531:0:85182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837970.600625:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134961280 00000100:00100000:3.0:1788837970.600644:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134961280 00000100:00100000:2.0:1788837970.600872:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788837970.600887:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85182:x1875729134961280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788837970.601139:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85182:x1875729134961280:12345-0@lo:502:llog_process_th.0 Request processed in 254us (5695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837970.601148:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788837970.601425:0:85182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85182:1875729134961280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788837970.601472:0:85182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788837970.601482:0:85182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788837970.601485:0:85182:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788837970.601491:0:85182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788837970.602818:0:85159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788837970.602866:0:85159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837970.602893:0:85159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.602906:0:85159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837970.602989:0:85159:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788837970.602993:0:85159:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ff604fe2800 10000000:01000000:2.0:1788837970.602996:0:85159:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ff604fe2800 10000000:01000000:2.0:1788837970.603001:0:85159:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788837970.603008:0:85159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff604fe2800 from 1 10000000:01000000:2.0:1788837970.603010:0:85159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837970.603049:0:85159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.603058:0:85159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.603290:0:85159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.603319:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134961408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788837970.603463:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.603514:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788837970.603828:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134961408 00000100:00100000:3.0:1788837970.603837:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134961408 00000100:00100000:3.0:1788837970.603883:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788837970.603892:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:85159:x1875729134961408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788837970.603908:0:85165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837970.603926:0:85165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7e5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7e53 expref: -99 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.603976:0:85165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7e53 expref: 11 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.603989:0:85165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7e53 expref: 11 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.603999:0:85165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f4400, rc 0) 00000100:00100000:3.0:1788837970.604042:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85159:x1875729134961408:12345-0@lo:101:mount.lustre.0 Request processed in 151us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.604050:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788837970.604238:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134961408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788837970.604261:0:85159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.604281:0:85159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837970.604368:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134961536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788837970.604517:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837970.604535:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624ea6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837970.605465:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134961536 00000100:00100000:3.0:1788837970.605475:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134961536 00000100:00100000:3.0:1788837970.605523:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837970.605531:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85159:x1875729134961536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837970.606312:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85159:x1875729134961536:12345-0@lo:501:mount.lustre.0 Request processed in 778us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.606320:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788837970.606411:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134961536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788837970.606468:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134961664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837970.606520:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.606546:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134961664 00000100:00100000:3.0:1788837970.606550:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134961664 00000100:00100000:3.0:1788837970.606577:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788837970.606585:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85159:x1875729134961664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837970.608292:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85159:x1875729134961664:12345-0@lo:503:mount.lustre.0 Request processed in 1699us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.608312:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788837970.608405:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837970.608434:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134961664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788837970.610926:0:85184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85184:1875729134961792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837970.611011:0:85184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.611055:0:85184:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d27480 going to sleep for 11 seconds 00000100:00100000:0.0:1788837970.611114:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134961792 00000100:00100000:0.0:1788837970.611123:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134961792 00000100:00100000:0.0:1788837970.611199:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788837970.611211:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85184:x1875729134961792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837970.611374:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85184:x1875729134961792:12345-0@lo:502:llog_process_th.0 Request processed in 165us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.611384:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788837970.611602:0:85184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85184:1875729134961792:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788837970.611683:0:85184:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788837970.611704:0:85184:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ff6395619b8) 00000020:00000080:1.0:1788837970.611742:0:85184:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788837970.611865:0:85184:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff604fe2800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788837970.611870:0:85184:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff604fe2800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788837970.611873:0:85184:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff604fe2800 4 00010000:00080000:1.0:1788837970.611908:0:85184:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff640eec000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788837970.618126:0:85184:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788837970.618998:0:85184:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788837970.619066:0:85184:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788837970.619084:0:85184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88da08396ccc7e68 00000100:00080000:1.0:1788837970.619098:0:85184:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788837970.619106:0:85184:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff640eec000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788837970.619151:0:85184:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639541f80 x1875729134961920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788837970.621621:0:85184:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788837970.623251:0:85184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85184:1875729134962048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837970.623380:0:85184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.626103:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729134961920:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788837970.626214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.626278:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134961920 00000100:00100000:3.0:1788837970.626288:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134961920 00000100:00100000:3.0:1788837970.626334:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1788837970.626343:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134961920:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788837970.626410:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729134961920:12345-0@lo:38:llog_process_th.0 Request processed in 66us (196us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788837970.626417:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1788837970.626478:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788837970.626488:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff640eec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788837970.626494:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788837970.626497:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729134961920:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788837970.630883:0:85184:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b4bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837970.631011:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134962048 00000100:00100000:3.0:1788837970.631024:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134962048 00000100:00100000:3.0:1788837970.631106:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788837970.631117:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85184:x1875729134962048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788837970.631550:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85184:x1875729134962048:12345-0@lo:502:llog_process_th.0 Request processed in 432us (8166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.631565:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788837970.632934:0:85184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85184:1875729134962048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837970.633039:0:85184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85184:1875729134962176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788837970.633103:0:85184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837970.633155:0:85184:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b4bf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837970.633837:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134962176 00000100:00100000:0.0:1788837970.633848:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134962176 00000100:00100000:0.0:1788837970.633907:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788837970.633917:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85184:x1875729134962176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788837970.634054:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85184:x1875729134962176:12345-0@lo:502:llog_process_th.0 Request processed in 137us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.634062:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788837970.634200:0:85184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:85184:1875729134962176:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788837970.634229:0:85184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788837970.634468:0:85159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788837970.634497:0:85159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788837970.634516:0:85159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837970.634528:0:85159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788837970.634611:0:85159:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788837970.634613:0:85159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837970.634615:0:85159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837970.634617:0:85159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837970.634618:0:85159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837970.634620:0:85159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837970.634621:0:85159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837970.634623:0:85159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837970.634626:0:85159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837970.634628:0:85159:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837970.634633:0:85159:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788837970.634636:0:85159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788837970.634637:0:85159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837970.634639:0:85159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837970.634640:0:85159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837970.634642:0:85159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837970.634643:0:85159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837970.634644:0:85159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837970.634645:0:85159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837970.634646:0:85159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837970.634647:0:85159:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788837970.634677:0:85159:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788837970.634691:0:85159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134962304:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788837970.634740:0:85159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837970.634766:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134962304 00000100:00100000:0.0:1788837970.634771:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134962304 00000100:00100000:0.0:1788837970.634832:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837970.634841:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85159:x1875729134962304:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788837970.634869:0:85166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788837970.634887:0:85166:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788837970.635394:0:85159:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7d80 going to sleep for 11 seconds 20000000:01000000:0.0:1788837970.639488:0:85166:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788837970.639513:0:85166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788837970.640399:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:85159:x1875729134962304:12345-0@lo:253:mount.lustre.0 Request processed in 5552us (5650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837970.640415:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788837970.640505:0:85159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:85159:1875729134962304:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788837970.640524:0:85159:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788837970.640527:0:85159:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788837970.640529:0:85159:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788837970.640531:0:85159:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788837970.640532:0:85159:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788837970.640534:0:85159:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788837970.640535:0:85159:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788837970.640537:0:85159:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788837970.640539:0:85159:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788837970.640541:0:85159:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788837970.640543:0:85159:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788837970.640563:0:85159:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788837970.640946:0:85169:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788837970.640952:0:85169:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788837970.640978:0:85169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.640996:0:85169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc7e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7e37 expref: 10 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.641007:0:85169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.641052:0:85169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc7e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc7e37 expref: 10 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837970.641070:0:85169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc7e3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc7e37 expref: 10 pid: 85167 timeout: 3464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837970.641411:0:85169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85169:1875729134962432:0@lo:104: 00000100:00100000:2.0:1788837970.641461:0:85169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837970.641511:0:85169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837970.643278:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134962432 00000100:00100000:3.0:1788837970.643294:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134962432 00000100:00100000:3.0:1788837970.643359:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788837970.643370:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:85169:x1875729134962432:12345-0@lo:104: 00010000:00010000:3.0:1788837970.643390:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.643493:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788837970.643500:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:85169:x1875729134962432:12345-0@lo:104: Request processed in 132us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.643507:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788837970.643564:0:85169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85169:1875729134962432:0@lo:104: 00010000:00010000:3.0:1788837970.643590:0:85169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.650325:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837970.650348:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.650363:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5e00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788837970.650368:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.650381:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788837970.650389:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837970.650396:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788837970.650782:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.650790:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788837970.650847:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.650855:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5e00/0x88da08396ccc7e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc7e3e expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.650880:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837970.650882:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837970.650894:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837970.650920:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134962560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788837970.651017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837970.651111:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134962560 00000100:00100000:1.0:1788837970.651121:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134962560 00010000:00010000:1.0:1788837970.651158:0:6533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc7e3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc7e37 expref: 11 pid: 85167 timeout: 3464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837970.651218:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:1.0:1788837970.651230:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:3645:x1875729134962560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788837970.651249:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788837970.651257:0:6533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc7e3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc7e37 expref: 11 pid: 85167 timeout: 3464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651270:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc7e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc7e37 expref: 11 pid: 85167 timeout: 3464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651289:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc7e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc7e37 expref: 11 pid: 85167 timeout: 3464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651310:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651319:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788837970.651339:0:6533:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010387406s 00010000:00010000:1.0:1788837970.651344:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651353:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651367:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651373:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651379:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837970.651383:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651391:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651408:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837970.651421:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788837970.651458:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:3645:x1875729134962560:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837970.651467:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:1.0:1788837970.651514:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134962560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788837970.657317:0:85169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.657339:0:85169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837970.657347:0:85169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc7e6f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788837970.694587:0:85159:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:1.0:1788837970.696098:0:85159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788837970.696678:0:85191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788837970.696763:0:85191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788837970.697278:0:85159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788837970.699747:0:85192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85192:1875729134962688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788837970.699878:0:85192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.699940:0:85192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3b40 going to sleep for 11 seconds 00000040:01000000:0.0:1788837970.700585:0:85159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788837970.700632:0:85159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788837970.701152:0:85159:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788837970.701160:0:85159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788837970.701209:0:85159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788837970.702205:0:85159:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788837970.702723:0:85159:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788837970.702754:0:85159:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788837970.702886:0:85159:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788837970.705004:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134962688 00000100:00100000:3.0:1788837970.705024:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134962688 00000100:00100000:3.0:1788837970.705093:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:3.0:1788837970.705104:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85192:x1875729134962688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788837970.705281:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85192:x1875729134962688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 178us (5403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.705290:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:3.0:1788837970.705355:0:85192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85192:1875729134962688:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788837970.705411:0:85192:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788837970.705465:0:85192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85192:1875729134962816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788837970.705514:0:85192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.705548:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134962816 00000100:00100000:3.0:1788837970.705552:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134962816 00000100:00100000:3.0:1788837970.705577:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:3.0:1788837970.705584:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85192:x1875729134962816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788837970.705698:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85192:x1875729134962816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 114us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.705705:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:3.0:1788837970.705725:0:85192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837970.705738:0:85192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85192:1875729134962816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788837970.705830:0:85192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85192:1875729134962944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788837970.705854:0:85192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837970.705874:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134962944 00000100:00100000:3.0:1788837970.705878:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134962944 00000100:00100000:3.0:1788837970.705902:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:3.0:1788837970.705924:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85192:x1875729134962944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788837970.705968:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85192:x1875729134962944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 45us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837970.705974:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00100000:3.0:1788837970.705991:0:85192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837970.706004:0:85192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85192:1875729134962944:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788837970.706045:0:85192:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788837970.708031:0:85192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788837970.708125:0:85192:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788837970.708980:0:85191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788837970.709048:0:85191:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788837970.709054:0:85191:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:2.0:1788837970.709504:0:85190:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:2.0:1788837970.709509:0:85190:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00080000:10000000:1.0:1788837970.711052:0:85159:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00010000:00080000:1.0:1788837970.713590:0:85159:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247809 00010000:00080000:2.0:1788837970.716346:0:85193:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85193 00010000:02000000:2.0:1788837970.716471:0:85193:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:3.0:1788837970.724123:0:85159:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788837970.724160:0:85159:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788837970.724350:0:85159:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788837970.724958:0:85159:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00010000:00080000:2.0:1788837970.737002:0:85193:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788837970.737013:0:85193:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:0.0:1788837970.758283:0:85159:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788837970.759027:0:85159:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788837970.877078:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837971.396772:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837971.396922:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116374784 00000100:00100000:0.0:1788837971.396942:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116374784 00000100:00100000:0.0:1788837971.397011:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:0.0:1788837971.397023:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+5:42411:x1875729116374784:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837971.397046:0:85170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.397091:0:85170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc7e76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbb1 expref: -99 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.397127:0:85170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc7e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbb1 expref: 6 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.397140:0:85170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc7e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbb1 expref: 6 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.397152:0:85170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9800, rc 0) 00000100:00100000:0.0:1788837971.397233:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116374784:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 212us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.397240:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:0.0:1788837971.405971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837971.406222:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116374912 00000100:00100000:3.0:1788837971.406237:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116374912 00000100:00100000:3.0:1788837971.406313:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:3.0:1788837971.406335:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116374912:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788837971.406373:0:85165:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788837971.406405:0:85165:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788837971.406411:0:85165:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788837971.406414:0:85165:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788837971.406418:0:85165:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788837971.406421:0:85165:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 109 00000100:00100000:3.0:1788837971.431211:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116374912:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 Request processed in 24853us (25229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.431232:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:3.0:1788837971.445045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837971.445127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837971.445854:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116375168 00000100:00100000:0.0:1788837971.445869:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116375168 00000100:00100000:0.0:1788837971.445947:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:0.0:1788837971.445959:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116375168:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837971.445981:0:85170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.446005:0:85170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc7e7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbb8 expref: -99 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.446043:0:85170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc7e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbb8 expref: 7 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.446057:0:85170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc7e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbb8 expref: 7 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.446069:0:85170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9e00, rc 0) 00000100:00100000:0.0:1788837971.446163:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+7:42411:x1875729116375168:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 205us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.446170:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:2.0:1788837971.447283:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116375040 00000100:00100000:2.0:1788837971.447292:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116375040 00000100:00100000:2.0:1788837971.447334:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1065 00000100:00100000:2.0:1788837971.447342:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116375040:12345-192.168.203.30@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1788837971.447376:0:66253:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'fdcf066d-ff07-4b2e-96ab-52415ed6bf72' at ffff8ff627d1f000, cookie 0x88da08396ccc7dc0 00010000:00080000:2.0:1788837971.447382:0:66253:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp recovering/t98784247810 exp ffff8ff627d1f000 cur 3365 last 1788837970 00010000:02000400:2.0:1788837971.447390:0:66253:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788837971.447398:0:66253:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788837971.447423:0:66253:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788837971.447588:0:66253:0:(import.c:65:import_set_state_nolock()) ffff8ff61d4bc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788837971.447657:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116375040:12345-192.168.203.30@tcp:38:ll_cfg_requeue.0 Request processed in 314us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837971.447664:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1065 00000100:00100000:2.0:1788837971.450151:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837971.450245:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116375296 00000100:00100000:0.0:1788837971.450257:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116375296 00000100:00100000:0.0:1788837971.450324:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:0.0:1788837971.450336:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+7:42411:x1875729116375296:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.450580:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116375296:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 246us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.450589:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:0.0:1788837971.462663:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837971.464354:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116368384 00000100:00100000:2.0:1788837971.464378:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116368384 00000100:00100000:2.0:1788837971.464484:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1066 00000100:00100000:2.0:1788837971.464499:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116368384:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00080000:2.0:1788837971.464529:0:66254:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247810, current: 98784247810, replaying 00000100:00100000:2.0:1788837971.464551:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116368384:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 57us (1906us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788837971.464558:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1066 00010000:00080000:3.0:1788837971.467117:0:85193:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788837971.467378:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837971.470442:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116375424 00000100:00100000:1.0:1788837971.470462:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116375424 00000100:00100000:1.0:1788837971.470540:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:1.0:1788837971.470552:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116375424:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.470751:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116375424:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 200us (3377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.470760:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:2.0:1788837971.476116:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837971.476513:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116375552 00000100:00100000:3.0:1788837971.477333:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116375552 00000100:00100000:3.0:1788837971.477401:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:3.0:1788837971.477412:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116375552:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.477484:0:85166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837971.477507:0:85166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7e84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbbf expref: -99 pid: 85166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.477544:0:85166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7e84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbbf expref: 9 pid: 85166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.477556:0:85166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7e84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbbf expref: 9 pid: 85166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.477568:0:85166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f4000, rc 0) 00000100:00100000:3.0:1788837971.477679:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116375552:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 267us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.477686:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1788837971.479960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837971.480082:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116375680 00000100:00100000:1.0:1788837971.480095:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116375680 00000100:00100000:1.0:1788837971.480215:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:1.0:1788837971.480227:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116375680:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.480723:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116375680:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 497us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.480735:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:3.0:1788837971.482578:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837971.483589:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116375808 00000100:00100000:1.0:1788837971.483604:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116375808 00000100:00100000:1.0:1788837971.483681:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:1.0:1788837971.483692:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116375808:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.484686:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116375808:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 991us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.484698:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:2.0:1788837971.504235:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837971.504294:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116375936 00000100:00100000:0.0:1788837971.504307:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116375936 00000100:00100000:1.0:1788837971.504483:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:1.0:1788837971.504501:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116375936:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837971.504527:0:85170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837971.504566:0:85170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712c200/0x88da08396ccc7e8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbc6 expref: -99 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.504604:0:85170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712c200/0x88da08396ccc7e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbc6 expref: 10 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.504619:0:85170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712c200/0x88da08396ccc7e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbc6 expref: 10 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.504631:0:85170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c200, rc 0) 00000100:00100000:1.0:1788837971.504707:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116375936:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 211us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.504715:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:1.0:1788837971.513033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837971.513242:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116376064 00000100:00100000:3.0:1788837971.513256:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116376064 00000100:00100000:3.0:1788837971.513313:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1788837971.513335:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116376064:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.513485:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116376064:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 152us (466us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837971.513514:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 10000000:01000000:3.0:1788837971.772874:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788837971.772887:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff604fe2800 from 109 10000000:01000000:3.0:1788837971.772894:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788837971.772972:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.772986:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.773001:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.773036:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.773265:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.773344:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff606616840 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.773429:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134963072 00000100:00100000:0.0:1788837971.773441:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134963072 00000100:00100000:0.0:1788837971.773507:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788837971.773518:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:6544:x1875729134963072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837971.773537:0:85170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.773555:0:85170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc7e99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7e92 expref: -99 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.773584:0:85170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc7e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7e92 expref: 11 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.773595:0:85170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc7e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7e92 expref: 11 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.773627:0:85170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8e00, rc 0) 00000100:00100000:0.0:1788837971.773700:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729134963072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.773708:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788837971.774206:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.774225:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.774235:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.774291:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.774335:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.774356:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff606616840 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.776500:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134963200 00000100:00100000:0.0:1788837971.776517:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134963200 00000100:00100000:0.0:1788837971.776590:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788837971.776601:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729134963200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788837971.776631:0:85165:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788837971.776652:0:85165:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788837971.776655:0:85165:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 109 00000100:00100000:0.0:1788837971.777793:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729134963200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1188us (3450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.777824:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788837971.783566:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788837971.784191:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788837971.784207:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.784220:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837971.784233:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788837971.784237:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff503592800 from 52 10000000:01000000:2.0:1788837971.784240:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837971.784287:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5000/0x88da08396ccc7ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.784296:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5000/0x88da08396ccc7ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.784306:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5000/0x88da08396ccc7ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.784332:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.784413:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.784484:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.785162:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134963328 00000100:00100000:3.0:1788837971.785172:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134963328 00000100:00100000:3.0:1788837971.785245:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788837971.785255:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729134963328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.785272:0:85167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837971.785287:0:85167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059f5200/0x88da08396ccc7ea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7ea0 expref: -99 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.785325:0:85167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059f5200/0x88da08396ccc7ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7ea0 expref: 12 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.785338:0:85167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059f5200/0x88da08396ccc7ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7ea0 expref: 12 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.785347:0:85167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f5200, rc 0) 00000100:00100000:3.0:1788837971.785409:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134963328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.785416:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788837971.785442:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837971.785458:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5000/0x88da08396ccc7ea0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7ea7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.785469:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5000/0x88da08396ccc7ea0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7ea7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.785553:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.785580:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.785611:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.786109:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134963456 00000100:00100000:0.0:1788837971.786115:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134963456 00000100:00100000:0.0:1788837971.786149:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788837971.786157:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134963456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.786306:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134963456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.786314:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788837971.786517:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.786550:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.786593:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.786619:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.786873:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134963584 00000100:00100000:0.0:1788837971.786878:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134963584 00000100:00100000:0.0:1788837971.786915:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788837971.786923:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134963584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.787018:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134963584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.787031:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788837971.787110:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788837971.787893:0:85223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788837971.787973:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788837971.787995:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837971.788007:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5000/0x88da08396ccc7ea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7ea7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.788019:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5000/0x88da08396ccc7ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7ea7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837971.788031:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788837971.793509:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff503592800 from 106 10000000:01000000:2.0:1788837971.793520:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788837971.793583:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc7eae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.793597:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc7eae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.793629:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc7eae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.793660:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.793751:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.793838:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.793859:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134963712 00000100:00100000:3.0:1788837971.793869:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134963712 00000100:00100000:3.0:1788837971.793949:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788837971.793960:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134963712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.793978:0:85165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837971.793994:0:85165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059f4c00/0x88da08396ccc7eb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7eae expref: -99 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.794022:0:85165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059f4c00/0x88da08396ccc7eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7eae expref: 13 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.794047:0:85165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059f4c00/0x88da08396ccc7eb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7eae expref: 13 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.794058:0:85165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f4c00, rc 0) 00000100:00100000:3.0:1788837971.794125:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729134963712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.794132:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788837971.795078:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837971.795099:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc7eae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7eb5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.795111:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc7eae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7eb5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837971.795196:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.795240:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837971.795276:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.795355:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134963840 00000100:00100000:3.0:1788837971.795361:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134963840 00000100:00100000:3.0:1788837971.795411:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788837971.795420:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729134963840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788837971.795440:0:85167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788837971.795461:0:85167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788837971.795465:0:85167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788837971.795469:0:85167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788837971.795473:0:85167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788837971.795476:0:85167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 109 00000100:00100000:3.0:1788837971.795569:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729134963840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.795577:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788837971.798818:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788837971.798952:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788837971.798965:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc7eae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7eb5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.798978:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc7eae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7eb5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788837971.798989:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788837971.798992:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1788837971.798996:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788837971.799039:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8200/0x88da08396ccc7ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.799047:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8200/0x88da08396ccc7ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.799071:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8200/0x88da08396ccc7ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837971.799094:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.799165:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.799220:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134963968 00000100:00100000:0.0:1788837971.799222:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.799230:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134963968 00000100:00100000:3.0:1788837971.799299:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788837971.799310:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729134963968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.799335:0:85165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837971.799352:0:85165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059f5e00/0x88da08396ccc7ec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7ebc expref: -99 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.799405:0:85165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059f5e00/0x88da08396ccc7ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7ebc expref: 14 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.799418:0:85165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059f5e00/0x88da08396ccc7ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7ebc expref: 14 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.799428:0:85165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f5e00, rc 0) 00000100:00100000:3.0:1788837971.799483:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729134963968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.799491:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788837971.802359:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134963968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837971.802392:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8200/0x88da08396ccc7ebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7ec3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.802408:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8200/0x88da08396ccc7ebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7ec3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837971.802528:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.802594:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837971.802631:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.803014:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134964096 00000100:00100000:3.0:1788837971.803023:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134964096 00000100:00100000:3.0:1788837971.803093:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788837971.803103:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729134964096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.803308:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729134964096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.803316:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788837971.805354:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.805450:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.805550:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837971.805600:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558540 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.806106:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134964224 00000100:00100000:3.0:1788837971.806117:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134964224 00000100:00100000:3.0:1788837971.806197:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788837971.806207:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729134964224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.807851:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.809149:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729134964224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2936us (3591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.809164:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:1.0:1788837971.809527:0:85224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788837971.809923:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788837971.810016:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788837971.810041:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8200/0x88da08396ccc7ebc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7ec3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.810054:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8200/0x88da08396ccc7ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7ec3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837971.810127:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788837971.810131:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff503592800 from 1 10000000:01000000:3.0:1788837971.810136:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788837971.810193:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4200/0x88da08396ccc7eca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.810203:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4200/0x88da08396ccc7eca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.810216:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4200/0x88da08396ccc7eca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.810241:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.810309:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.810592:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624ea6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837971.810631:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134964352 00000100:00100000:1.0:1788837971.810639:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134964352 00000100:00100000:1.0:1788837971.810938:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788837971.810950:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729134964352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837971.810969:0:85167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837971.810986:0:85167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712cc00/0x88da08396ccc7ed1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7eca expref: -99 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.811016:0:85167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712cc00/0x88da08396ccc7ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7eca expref: 15 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.811034:0:85167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712cc00/0x88da08396ccc7ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7eca expref: 15 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.811044:0:85167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712cc00, rc 0) 00000100:00100000:1.0:1788837971.811217:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729134964352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.811225:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788837971.811309:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.811341:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4200/0x88da08396ccc7eca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7ed1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.811351:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4200/0x88da08396ccc7eca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7ed1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837971.811368:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788837971.811373:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4200/0x88da08396ccc7eca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7ed1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.811400:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4200/0x88da08396ccc7eca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7ed1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837971.811410:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788837971.811412:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff503592800 from 7 10000000:01000000:3.0:1788837971.811414:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788837971.811433:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4600/0x88da08396ccc7ed8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.811440:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4600/0x88da08396ccc7ed8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.811447:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4600/0x88da08396ccc7ed8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.811463:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.811496:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.811519:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624ea6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788837971.811855:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134964480 00000100:00100000:1.0:1788837971.811861:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134964480 00000100:00100000:1.0:1788837971.811927:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788837971.811946:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729134964480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837971.811954:0:85167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837971.811964:0:85167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712d200/0x88da08396ccc7edf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7ed8 expref: -99 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.811990:0:85167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712d200/0x88da08396ccc7edf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7ed8 expref: 16 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.811999:0:85167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712d200/0x88da08396ccc7edf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7ed8 expref: 16 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.812006:0:85167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d200, rc 0) 00000100:00100000:1.0:1788837971.812048:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729134964480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.812054:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788837971.812128:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837971.812139:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4600/0x88da08396ccc7ed8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7edf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.812147:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4600/0x88da08396ccc7ed8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7edf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837971.812217:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.812244:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837971.812885:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.813001:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134964608 00000100:00100000:3.0:1788837971.813007:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134964608 00000100:00100000:3.0:1788837971.813035:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788837971.813044:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729134964608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.813494:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504cafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729134964608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 450us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.813503:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788837971.814282:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.820585:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.820705:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.820853:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837971.821098:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134964736 00000100:00100000:2.0:1788837971.821108:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134964736 00000100:00100000:2.0:1788837971.821190:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788837971.821202:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729134964736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.821360:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729134964736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837971.821368:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788837971.821398:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788837971.835827:0:85225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788837971.835914:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788837971.835960:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837971.835977:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4600/0x88da08396ccc7ed8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7edf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.835993:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4600/0x88da08396ccc7ed8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7edf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837971.836005:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788837971.836008:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff63f7ce800 from 52 10000000:01000000:3.0:1788837971.836012:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788837971.836064:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4e00/0x88da08396ccc7ee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.836074:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4e00/0x88da08396ccc7ee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.836088:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4e00/0x88da08396ccc7ee6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.836119:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.836224:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.836279:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.836309:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134964864 00000100:00100000:3.0:1788837971.836318:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134964864 00000100:00100000:3.0:1788837971.836372:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837971.836384:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729134964864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.836414:0:85165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837971.836432:0:85165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059f5600/0x88da08396ccc7eed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7ee6 expref: -99 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.836465:0:85165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059f5600/0x88da08396ccc7eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7ee6 expref: 17 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.836478:0:85165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059f5600/0x88da08396ccc7eed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7ee6 expref: 17 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.836488:0:85165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f5600, rc 0) 00000100:00100000:3.0:1788837971.836531:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729134964864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.836539:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788837971.836597:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.836613:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4e00/0x88da08396ccc7ee6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7eed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.836623:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4e00/0x88da08396ccc7ee6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7eed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.836675:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.836701:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.836717:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.836730:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134964992 00000100:00100000:3.0:1788837971.836733:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134964992 00000100:00100000:3.0:1788837971.836758:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788837971.836764:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633204050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729134964992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.836927:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633204050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729134964992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.836936:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788837971.836966:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134964992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.836996:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.837039:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.837058:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.837068:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134965120 00000100:00100000:3.0:1788837971.837072:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134965120 00000100:00100000:3.0:1788837971.837092:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788837971.837098:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729134965120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.837178:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729134965120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.837197:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788837971.837239:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788837971.848058:0:85227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788837971.851130:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788837971.851172:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788837971.851196:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4e00/0x88da08396ccc7ee6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7eed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.851211:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4e00/0x88da08396ccc7ee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7eed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837971.851294:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788837971.851299:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788837971.851303:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788837971.852043:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5400/0x88da08396ccc7ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.852056:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5400/0x88da08396ccc7ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.852134:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5400/0x88da08396ccc7ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.852254:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.852636:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.853120:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788837971.853508:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134965248 00000100:00100000:2.0:1788837971.853519:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134965248 00000100:00100000:2.0:1788837971.853625:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788837971.853636:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633205050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729134965248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837971.853676:0:85170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837971.853705:0:85170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5a00/0x88da08396ccc7efb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7ef4 expref: -99 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.853754:0:85170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5a00/0x88da08396ccc7efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7ef4 expref: 18 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.853769:0:85170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5a00/0x88da08396ccc7efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7ef4 expref: 18 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.853781:0:85170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5a00, rc 0) 00000100:00100000:2.0:1788837971.853870:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633205050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729134965248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837971.853879:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788837971.853992:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837971.854014:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5400/0x88da08396ccc7ef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7efb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.854024:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5400/0x88da08396ccc7ef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7efb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837971.854121:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.854162:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837971.854869:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.854924:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134965376 00000100:00100000:3.0:1788837971.854939:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134965376 00000100:00100000:3.0:1788837971.854979:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788837971.854987:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729134965376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.855176:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729134965376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.855194:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788837971.855638:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.856004:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.856116:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837971.856151:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.856200:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134965504 00000100:00100000:3.0:1788837971.856205:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134965504 00000100:00100000:3.0:1788837971.856269:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788837971.856277:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729134965504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.859036:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.859189:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729134965504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2646us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.859204:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000040:00080000:1.0:1788837971.861198:0:85229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788837971.862194:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788837971.862225:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788837971.862239:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5400/0x88da08396ccc7ef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7efb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.862252:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5400/0x88da08396ccc7ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7efb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837971.862264:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837971.862267:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff63f7ce800 from 7 10000000:01000000:2.0:1788837971.862271:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837971.867038:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4000/0x88da08396ccc7f02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.867070:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4000/0x88da08396ccc7f02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.867116:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4000/0x88da08396ccc7f02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837971.867550:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.867651:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837971.867715:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837971.868022:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134965632 00000100:00100000:2.0:1788837971.868031:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134965632 00000100:00100000:2.0:1788837971.868199:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788837971.868210:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633206850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729134965632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837971.868229:0:85170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837971.868254:0:85170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5600/0x88da08396ccc7f09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7f02 expref: -99 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.868287:0:85170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5600/0x88da08396ccc7f09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7f02 expref: 19 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.868299:0:85170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5600/0x88da08396ccc7f09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7f02 expref: 19 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.868309:0:85170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5600, rc 0) 00000100:00100000:2.0:1788837971.868377:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633206850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729134965632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.868510:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837971.868529:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4000/0x88da08396ccc7f02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.868540:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4000/0x88da08396ccc7f02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7f09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837971.868644:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.868674:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.868701:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788837971.884885:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134965760 00000100:00100000:1.0:1788837971.884908:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134965760 00000100:00100000:1.0:1788837971.885423:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788837971.885439:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729134965760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.885703:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729134965760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (17027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.885710:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788837971.896171:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.896247:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.896332:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.896433:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837971.896478:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837971.896589:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134965888 00000100:00100000:2.0:1788837971.896598:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134965888 00000100:00100000:2.0:1788837971.896703:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788837971.896715:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633205450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729134965888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.896903:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633205450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729134965888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837971.896946:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788837971.897020:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134965888:0@lo:503:ll_cfg_requeue.0 00010000:00010000:2.0:1788837971.904196:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788837971.907433:0:85230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788837971.907554:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788837971.907581:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788837971.907597:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4000/0x88da08396ccc7f02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.907614:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4000/0x88da08396ccc7f02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837971.907627:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788837971.907631:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627f9a800 from 52 10000000:01000000:2.0:1788837971.907634:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788837971.907712:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4e00/0x88da08396ccc7f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.907730:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4e00/0x88da08396ccc7f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.907748:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4e00/0x88da08396ccc7f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.907786:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.907916:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.907984:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.911365:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134966016 00000100:00100000:0.0:1788837971.911387:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134966016 00000100:00100000:0.0:1788837971.911474:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788837971.911486:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729134966016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837971.911511:0:85165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.911537:0:85165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc7f17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7f10 expref: -99 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.911574:0:85165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc7f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7f10 expref: 20 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.911588:0:85165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc7f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7f10 expref: 20 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.911600:0:85165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9c00, rc 0) 00000100:00100000:0.0:1788837971.911705:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729134966016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.911713:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788837971.911890:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837971.911916:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4e00/0x88da08396ccc7f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f17 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.912000:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4e00/0x88da08396ccc7f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7f17 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.912175:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.912224:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.912273:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.914124:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134966144 00000100:00100000:0.0:1788837971.914141:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134966144 00000100:00100000:0.0:1788837971.914211:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788837971.914222:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729134966144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.914435:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729134966144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.914444:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788837971.916970:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.917044:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.917230:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.917272:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788837971.917632:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134966272 00000100:00100000:1.0:1788837971.917639:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134966272 00000100:00100000:1.0:1788837971.917686:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788837971.917694:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729134966272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.917840:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729134966272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837971.917848:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788837971.918014:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788837971.925031:0:85232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788837971.925142:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788837971.925193:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788837971.925208:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4e00/0x88da08396ccc7f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f17 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.925222:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4e00/0x88da08396ccc7f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f17 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788837971.925233:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788837971.925236:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788837971.925239:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788837971.925292:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc7f1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.925330:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc7f1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.925345:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc7f1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837971.925380:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.925488:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837971.925548:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.930311:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134966400 00000100:00100000:0.0:1788837971.930332:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134966400 00000100:00100000:0.0:1788837971.930409:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788837971.930421:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729134966400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788837971.930443:0:85170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837971.930468:0:85170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc7f25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7f1e expref: -99 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.930503:0:85170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc7f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7f1e expref: 21 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.930517:0:85170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc7f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7f1e expref: 21 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837971.930526:0:85170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8a00, rc 0) 00000100:00100000:0.0:1788837971.930631:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729134966400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (5143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.930638:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788837971.931462:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788837971.931490:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc7f1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f25 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837971.931503:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc7f1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7f25 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837971.931601:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.931669:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837971.931723:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558000 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.932464:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134966528 00000100:00100000:0.0:1788837971.932476:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134966528 00000100:00100000:0.0:1788837971.932536:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788837971.932557:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6082c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729134966528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.932782:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6082c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729134966528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.932792:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788837971.932855:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.932904:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788837971.932963:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837971.932996:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558000 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.933000:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134966656 00000100:00100000:3.0:1788837971.933004:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134966656 00000100:00100000:3.0:1788837971.933038:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788837971.933046:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505a7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729134966656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.940905:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505a7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729134966656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7842us (7925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.940928:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788837971.942000:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788837971.946403:0:85233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788837971.946547:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788837971.946577:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788837971.946591:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc7f1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f25 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.946606:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc7f1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f25 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788837971.946619:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788837971.946623:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff627f9a800 from 7 10000000:01000000:2.0:1788837971.946626:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788837971.946682:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc7f2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.946692:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc7f2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.946732:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc7f2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.946770:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.946899:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.947069:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134966784 00000100:00100000:2.0:1788837971.947078:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134966784 00000100:00100000:2.0:1788837971.947136:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788837971.947145:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729134966784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837971.947164:0:85165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788837971.947188:0:85165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5c00/0x88da08396ccc7f33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7f2c expref: -99 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.947216:0:85165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5c00/0x88da08396ccc7f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7f2c expref: 22 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.947228:0:85165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5c00/0x88da08396ccc7f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7f2c expref: 22 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.947238:0:85165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5c00, rc 0) 00000100:00100000:2.0:1788837971.947274:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729134966784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837971.947281:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788837971.947916:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788837971.948091:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788837971.948112:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc7f2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f33 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837971.948132:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc7f2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7f33 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788837971.948231:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.948273:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.948305:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788837971.948429:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134966912 00000100:00100000:0.0:1788837971.948436:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134966912 00000100:00100000:0.0:1788837971.948479:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788837971.948488:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729134966912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788837971.951252:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729134966912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2754us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837971.951270:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788837971.954311:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134966912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.954565:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134967040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788837971.954830:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837971.954887:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.955237:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134967040 00000100:00100000:3.0:1788837971.955249:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134967040 00000100:00100000:3.0:1788837971.955324:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788837971.955337:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729134967040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.955521:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729134967040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.955530:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788837971.955648:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134967040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788837971.958659:0:85235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788837971.958970:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788837971.959007:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788837971.959022:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc7f2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f33 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959036:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc7f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f33 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837971.959048:0:6544:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788837971.959052:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ff610244d28 from 1 10000000:01000000:3.0:1788837971.959055:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788837971.959114:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5a00/0x88da08396ccc7f3a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959122:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5a00/0x88da08396ccc7f3a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959137:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5a00/0x88da08396ccc7f3a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.959171:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134967168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.959271:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.959327:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5058c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.959353:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134967168 00000100:00100000:3.0:1788837971.959360:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134967168 00000100:00100000:3.0:1788837971.959414:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788837971.959424:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729134967168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.959441:0:85170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837971.959458:0:85170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059f5c00/0x88da08396ccc7f41 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7f3a expref: -99 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959488:0:85170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059f5c00/0x88da08396ccc7f41 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7f3a expref: 23 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959500:0:85170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059f5c00/0x88da08396ccc7f41 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7f3a expref: 23 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959510:0:85170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f5c00, rc 0) 00000100:00100000:3.0:1788837971.959551:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729134967168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.959558:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788837971.959610:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134967168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.959626:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5a00/0x88da08396ccc7f3a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f41 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959635:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5a00/0x88da08396ccc7f3a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7f41 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837971.959656:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788837971.959660:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5a00/0x88da08396ccc7f3a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f41 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959677:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5a00/0x88da08396ccc7f3a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f41 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788837971.959685:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788837971.959686:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ff610244d28 from 1 10000000:01000000:3.0:1788837971.959689:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788837971.959705:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5800/0x88da08396ccc7f48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959713:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5800/0x88da08396ccc7f48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959720:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5800/0x88da08396ccc7f48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.959734:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134967296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.959761:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.959773:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5058c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.959787:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134967296 00000100:00100000:3.0:1788837971.959791:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134967296 00000100:00100000:3.0:1788837971.959841:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788837971.959848:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729134967296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.959854:0:85165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837971.959863:0:85165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059f5000/0x88da08396ccc7f4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc7f48 expref: -99 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959876:0:85165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059f5000/0x88da08396ccc7f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc7f48 expref: 24 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959895:0:85165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059f5000/0x88da08396ccc7f4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc7f48 expref: 24 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959902:0:85165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f5000, rc 0) 00000100:00100000:3.0:1788837971.959927:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729134967296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837971.959933:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788837971.959961:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134967296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788837971.959971:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5800/0x88da08396ccc7f48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f4f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.959979:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5800/0x88da08396ccc7f48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7f4f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837971.960032:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134967424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.960069:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837971.960082:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5058c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788837971.960092:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134967424 00000100:00100000:3.0:1788837971.960095:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134967424 00000100:00100000:3.0:1788837971.960116:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788837971.960121:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729134967424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788837971.960209:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729134967424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (138us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788837971.960216:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788837971.960245:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639568700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134967424:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788837971.960276:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788837971.960282:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5800/0x88da08396ccc7f48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f4f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837971.960290:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5800/0x88da08396ccc7f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7f4f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837972.925038:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837973.951955:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837974.595757:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837974.595835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837974.595876:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116376320 00000100:00100000:0.0:1788837974.595889:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116376320 00000100:00100000:0.0:1788837974.595968:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1051 00000100:00100000:0.0:1788837974.595981:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116376320:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837974.596208:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116376320:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 230us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837974.596217:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1051 00000100:00080000:0.0:1788837974.596245:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788837974.596434:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116376192 00000100:00100000:1.0:1788837974.596439:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116376192 00000100:00100000:1.0:1788837974.596488:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:1.0:1788837974.596497:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116376192:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788837974.596526:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116376192:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837974.596533:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00010000:00010000:0.0:1788837974.972912:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837975.421194:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134967552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837975.421307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837975.422210:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134967552 00000100:00100000:2.0:1788837975.422224:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134967552 00000100:00100000:2.0:1788837975.422307:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:2.0:1788837975.422321:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134967552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837975.422360:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837975.422439:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134967552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837975.422447:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00080000:1.0:1788837975.422532:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837975.422596:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134967552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837975.422867:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837975.422882:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134967680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837975.422925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837975.423006:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134967680 00000100:00100000:0.0:1788837975.423012:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134967680 00000100:00100000:0.0:1788837975.423171:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:0.0:1788837975.423180:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134967680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837975.423202:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837975.423238:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134967680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837975.423244:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00080000:1.0:1788837975.423295:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837975.423319:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134967680:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788837975.936509:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:0.0:1788837975.937085:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837975.937091:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788837975.937095:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837975.937105:0:27607:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3364 00000100:00080000:0.0:1788837975.937110:0:27607:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788837975.937118:0:27607:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788837975.937143:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff624ebca80 x1875729134967936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837975.937204:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788837975.937207:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837975.937214:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788837975.937216:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837975.937221:0:27607:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3364 00000100:00080000:0.0:1788837975.937224:0:27607:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788837975.937228:0:27607:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788837975.937235:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134967808:0@lo:400:kworker.0 00000100:00100000:0.0:1788837975.937241:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff624ebce00 x1875729134968192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788837975.937262:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837975.937267:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788837975.937284:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837975.937289:0:27607:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3364 00000100:00080000:0.0:1788837975.937291:0:27607:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788837975.937296:0:27607:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788837975.937313:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff624ebf100 x1875729134968448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837975.937332:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788837975.937336:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788837975.937341:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788837975.937343:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837975.937347:0:27607:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3364 00000100:00080000:0.0:1788837975.937349:0:27607:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788837975.937354:0:27607:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788837975.937367:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff604231500 x1875729134968576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837975.937410:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134967936:0@lo:38:kworker.0 00000100:00080000:0.0:1788837975.937414:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788837975.937421:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788837975.937423:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff640eec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788837975.937430:0:27607:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff640eec000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788837975.937446:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd6d880 x1875729134969088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788837975.937461:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837975.937486:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134968064:0@lo:400:kworker.0 00000100:00100000:3.0:1788837975.937498:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134968192:0@lo:38:kworker.0 00000100:00100000:1.0:1788837975.937579:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134968832:0@lo:400:kworker.0 00000100:00100000:3.0:1788837975.943144:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837975.943223:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134968448:0@lo:38:kworker.0 00000100:00100000:3.0:1788837975.943276:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837975.943296:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134968576:0@lo:38:kworker.0 00000100:00100000:3.0:1788837975.943527:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837975.947419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837975.947498:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837975.947515:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134968704:0@lo:400:kworker.0 00000100:00100000:1.0:1788837975.947577:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837975.947636:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134968832 00000100:00100000:1.0:1788837975.947645:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134968832 00000100:00100000:1.0:1788837975.947721:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425 00000100:00100000:1.0:1788837975.947732:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134968832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837975.947815:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134968832:12345-0@lo:400:kworker.0 Request processed in 68us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837975.947831:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425 00000100:00100000:1.0:1788837975.947858:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134968448 00000100:00100000:1.0:1788837975.947862:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134968448 00000100:00100000:1.0:1788837975.947883:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134968704 00000100:00100000:1.0:1788837975.947886:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134968704 00000100:00100000:1.0:1788837975.947909:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:1.0:1788837975.947914:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134968448:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788837975.947950:0:8472:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8ff627d19000, cookie 0x88da08396ccc7dc7 00010000:00080000:1.0:1788837975.947957:0:8472:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378651 exp ffff8ff627d19000 cur 3369 last 1788837970 00000004:00100000:1.0:1788837975.947981:0:8472:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788837975.948261:0:8472:0:(import.c:65:import_set_state_nolock()) ffff8ff5036b5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837975.948315:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729134968448:12345-0@lo:38:kworker.0 Request processed in 400us (5038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837975.948323:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:1.0:1788837975.948338:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:1.0:1788837975.948345:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134968704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837975.948376:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134968704:12345-0@lo:400:kworker.0 Request processed in 32us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837975.948382:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00080000:1.0:1788837975.948404:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788837975.948430:0:85193:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788837975.948436:0:85193:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 98784247810 00000020:00080000:1.0:1788837975.948442:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788837975.948446:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247810, next_transno: 98784247810 00010000:00080000:1.0:1788837975.948450:0:85193:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247810) 00000020:00080000:1.0:1788837975.948453:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788837975.948473:0:85193:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116368384 t98784247810 from 192.168.203.30@tcp req@ffff8ff624ebf800 x1875729116368384/t0(98784247810) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:627/0 lens 528/0 e 0 to 0 dl 1788837982 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788837975.948574:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134968704:0@lo:400:kworker.0 00000100:00100000:1.0:1788837975.948590:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134968832:0@lo:400:kworker.0 00000004:00080000:1.0:1788837975.949419:0:85193:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 890us 00000100:00100000:0.0:1788837975.951236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837975.951340:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134968320:0@lo:400:kworker.0 00000100:00100000:0.0:1788837975.951408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837975.951517:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134967936 00000100:00100000:0.0:1788837975.951525:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134967936 00000100:00100000:0.0:1788837975.951561:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134968192 00000100:00100000:0.0:1788837975.951564:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134968192 00000100:00100000:0.0:1788837975.951573:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134968576 00000100:00100000:0.0:1788837975.951576:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134968576 00000100:00100000:0.0:1788837975.951601:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134968064 00000100:00100000:0.0:1788837975.951604:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134968064 00000100:00100000:0.0:1788837975.951640:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134968320 00000100:00100000:0.0:1788837975.951644:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134968320 00000100:00100000:0.0:1788837975.951663:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1788837975.951672:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134968064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837975.951731:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134968064:12345-0@lo:400:kworker.0 Request processed in 60us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837975.951738:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1788837975.951760:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1788837975.951766:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134968320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837975.951816:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134968320:12345-0@lo:400:kworker.0 Request processed in 31us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837975.951823:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1788837975.951835:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1788837975.951839:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729134967936:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788837975.951882:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3369 last 0 00000020:00000080:0.0:1788837975.951922:0:76060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88da08396ccc7f56 00000004:00100000:0.0:1788837975.951942:0:76060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788837975.951981:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff604963000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837975.952018:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875729134967936:12345-0@lo:38:kworker.0 Request processed in 177us (14563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837975.952034:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1788837975.952046:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:0.0:1788837975.952050:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729134968192:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788837975.952064:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3369 last 0 00000020:00000080:0.0:1788837975.952086:0:76060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88da08396ccc7f5d 00000004:00100000:0.0:1788837975.952093:0:76060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788837975.952108:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff604967000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837975.952136:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875729134968192:12345-0@lo:38:kworker.0 Request processed in 84us (9138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837975.952143:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:0.0:1788837975.952164:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1788837975.952168:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729134968576:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788837975.952181:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3369 last 0 00000020:00000080:0.0:1788837975.952205:0:76060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x88da08396ccc7f64 00000004:00100000:0.0:1788837975.952211:0:76060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788837975.952222:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff604963800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837975.952249:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875729134968576:12345-0@lo:38:kworker.0 Request processed in 79us (8725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837975.952256:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1788837975.952281:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134969216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837975.952315:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837975.952357:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134968320:0@lo:400:kworker.0 00000100:00080000:0.0:1788837975.952387:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788837975.952399:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134969216 00000100:00100000:0.0:1788837975.952409:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134969216 00000100:00100000:0.0:1788837975.952438:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:0.0:1788837975.952444:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134969216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837975.952473:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788837975.952506:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134969216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837975.952512:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00100000:0.0:1788837975.952541:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134969216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837975.952673:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134968064:0@lo:400:kworker.0 00000100:00100000:0.0:1788837975.952682:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134968960:0@lo:400:kworker.0 00000100:00100000:0.0:1788837975.952710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837975.952737:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134968960 00000100:00100000:0.0:1788837975.952741:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134968960 00000100:00100000:0.0:1788837975.952772:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:0.0:1788837975.952780:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729134968960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837975.952831:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729134968960:12345-0@lo:400:kworker.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837975.952837:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00080000:0.0:1788837975.952850:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837975.952869:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134968960:0@lo:400:kworker.0 00000100:00100000:0.0:1788837975.953006:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134967808 00000100:00100000:0.0:1788837975.953011:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134967808 00000100:00100000:0.0:1788837975.953040:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788837975.953047:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505a7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729134967808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837975.953083:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505a7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729134967808:12345-0@lo:400:kworker.0 Request processed in 36us (15765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837975.953096:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000001:00100000:0.0:1788837975.953184:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788837975.953212:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134967808:0@lo:400:kworker.0 00010000:00080000:3.0:1788837975.955428:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff604231500 x1875729134968576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837975.955452:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00080000:3.0:1788837975.958234:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8ff604231500 x1875729134968576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837975.958249:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788837975.958255:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788837975.958278:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788837975.958285:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134968576:0@lo:38:kworker.0 00000100:00100000:3.0:1788837975.958487:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729134969088:0@lo:38:kworker.0 00000100:00100000:3.0:1788837975.958555:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837975.958598:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134969088 00000100:00100000:3.0:1788837975.958606:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134969088 00000100:00100000:3.0:1788837975.958644:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1788837975.958651:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729134969088:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788837975.958682:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3369 last 0 00000020:00000080:3.0:1788837975.958720:0:76060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88da08396ccc7f6b 00000004:00100000:3.0:1788837975.958735:0:76060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788837975.958762:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff6049ba800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788837975.958831:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729134969088:12345-0@lo:38:kworker.0 Request processed in 178us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837975.958838:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00010000:00080000:3.0:1788837975.958878:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff62bd6d880 x1875729134969088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788837985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837975.958892:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:3.0:1788837975.958899:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788837975.958902:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788837975.958904:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff640eec000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788837975.958909:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729134969088:0@lo:38:kworker.0 00010000:00080000:3.0:1788837975.958923:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff624ebca80 x1875729134967936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837975.958932:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00080000:3.0:1788837975.959744:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8ff624ebca80 x1875729134967936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837975.959754:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788837975.959758:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788837975.959762:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788837975.959767:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134967936:0@lo:38:kworker.0 00010000:00080000:3.0:1788837975.959791:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff624ebce00 x1875729134968192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837975.959831:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000100:00080000:3.0:1788837975.972464:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8ff624ebce00 x1875729134968192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837975.972480:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788837975.972486:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788837975.972490:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788837975.972497:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134968192:0@lo:38:kworker.0 00000100:00080000:3.0:1788837975.972614:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:3.0:1788837975.972627:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788837975.972636:0:3642:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788837975.972639:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:3.0:1788837975.972643:0:3642:0:(recover.c:53:ptlrpc_replay_next()) import ffff8ff6061da800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:3.0:1788837975.972647:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788837975.972854:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134968448:0@lo:38:kworker.0 00000001:00100000:3.0:1788837975.973919:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1788837975.974056:0:85389:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1788837975.974065:0:85389:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788837975.974071:0:85389:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1788837975.975617:0:85389:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788837975.975929:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134969344:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788837975.976040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837975.981357:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134969344 00000100:00100000:2.0:1788837975.981397:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134969344 00000100:00100000:2.0:1788837975.981476:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:2.0:1788837975.981488:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729134969344:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788837975.981515:0:37907:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff640e54000 x1875729134969344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:631/0 lens 224/0 e 0 to 0 dl 1788837986 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788837975.981528:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729134969344:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 44us (5488us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788837975.981535:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00010000:00010000:2.0:1788837976.000742:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.002457:0:85193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f72 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.002500:0:85193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.002521:0:85193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.002536:0:85193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.002544:0:85193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.002551:0:85193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.009055:0:85193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.009074:0:85193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f72 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.009083:0:85193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.009104:0:85193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712de00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788837976.009110:0:85193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.009119:0:85193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f72 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.009141:0:85193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff64216eb00) 00010000:00010000:1.0:1788837976.009145:0:85193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837976.009151:0:85193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f72 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.009789:0:85193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f72 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837976.009845:0:85193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000771cbe4e reply state 0000000047ce5eb9 transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.009863:0:85193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.009880:0:85193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff64216e100) 00010000:00010000:1.0:1788837976.009883:0:85193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837976.009887:0:85193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788837976.010044:0:85193:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788837976.010073:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788837976.010077:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000020:00080000:1.0:1788837976.010082:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788837976.010084:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000001:00080000:2.0:1788837976.017789:0:85160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247810 is committed 00010000:00010000:3.0:1788837976.019942:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837976.019966:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837976.019975:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837976.019982:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837976.019988:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837976.019998:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837976.020025:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff64216e100) 00010000:00010000:3.0:1788837976.020028:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837976.020034:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837976.020041:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc7f79 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837976.020323:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837976.020365:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116368896 00000100:00100000:3.0:1788837976.020376:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116368896 00000100:00100000:3.0:1788837976.020438:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1071 00000100:00100000:3.0:1788837976.020449:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116368896:12345-192.168.203.30@tcp:36:rm.0 00010000:00080000:3.0:1788837976.020475:0:75504:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247811, current: 98784247811, replaying 00000100:00100000:3.0:1788837976.020510:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116368896:12345-192.168.203.30@tcp:36:rm.0 Request processed in 64us (193us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788837976.020517:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1071 00000020:00080000:2.0:1788837976.022325:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.022337:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247811, next_transno: 98784247811 00010000:00080000:2.0:1788837976.022344:0:85193:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247811) 00000020:00080000:2.0:1788837976.022348:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.022364:0:85193:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116368896 t98784247811 from 192.168.203.30@tcp req@ffff8ff640e55f80 x1875729116368896/t0(98784247811) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:632/0 lens 512/0 e 0 to 0 dl 1788837987 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788837976.022505:0:85193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7f80 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.022527:0:85193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7f80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.022545:0:85193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7f80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.022565:0:85193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.022572:0:85193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.022595:0:85193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.022726:0:85193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc7f8e lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.022735:0:85193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc7f8e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.022743:0:85193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc7f8e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.023070:0:85193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc7f8e lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024193:0:85193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc7f8e lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024212:0:85193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc7f8e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024220:0:85193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788837976.024225:0:85193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc7f8e lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024236:0:85193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc7f8e lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024256:0:85193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff8ff504471d00) 00010000:00010000:2.0:1788837976.024259:0:85193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788837976.024264:0:85193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc7f8e lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024290:0:85193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc7f8e lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024336:0:85193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7f80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024343:0:85193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7f80 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024349:0:85193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7f80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024354:0:85193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788837976.024357:0:85193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7f80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024364:0:85193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7f80 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024373:0:85193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff504471f00) 00010000:00010000:2.0:1788837976.024376:0:85193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788837976.024379:0:85193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7f80 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024385:0:85193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc7f80 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788837976.024398:0:85193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003aa40f4e reply state 000000005bb554ae transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024410:0:85193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.024426:0:85193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff504471000) 00010000:00010000:2.0:1788837976.024429:0:85193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788837976.024433:0:85193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788837976.024560:0:85193:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788837976.024589:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.024592:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000020:00080000:2.0:1788837976.024597:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.024599:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000100:00100000:3.0:1788837976.028972:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837976.030357:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116370688 00000100:00100000:2.0:1788837976.030375:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116370688 00000100:00100000:2.0:1788837976.030456:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1072 00000100:00100000:2.0:1788837976.030468:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2403:x1875729116370688:12345-192.168.203.30@tcp:101:lfs.0 00010000:00080000:2.0:1788837976.030494:0:67312:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247812, current: 98784247812, replaying 00000100:00100000:2.0:1788837976.030519:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2403:x1875729116370688:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 54us (1563us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788837976.030528:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1072 00000020:00080000:1.0:1788837976.031855:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788837976.031891:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247812, next_transno: 98784247812 00010000:00080000:1.0:1788837976.031898:0:85193:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247812) 00000020:00080000:1.0:1788837976.031902:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788837976.031917:0:85193:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116370688 t98784247812 from 192.168.203.30@tcp req@ffff8ff640e56680 x1875729116370688/t0(98784247812) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:632/0 lens 536/0 e 0 to 0 dl 1788837987 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788837976.031953:0:85193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788837976.031985:0:85193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f95 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cba3 expref: -99 pid: 85193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.032212:0:85193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396ccc7f9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.032230:0:85193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396ccc7f9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.032244:0:85193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396ccc7f9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.032259:0:85193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.032266:0:85193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.032273:0:85193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788837976.035272:0:85193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:1.0:1788837976.035321:0:85193:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x88da08396ccc7d11 00000004:00080000:1.0:1788837976.035325:0:85193:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x88da08396ccc7d11 in new mfd 00010000:00010000:1.0:1788837976.035344:0:85193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396ccc7f9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.035374:0:85193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396ccc7f9c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.035382:0:85193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396ccc7f9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.035388:0:85193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712ca00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788837976.035393:0:85193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396ccc7f9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.035401:0:85193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396ccc7f9c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.035422:0:85193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff64216eb00) 00010000:00010000:1.0:1788837976.035426:0:85193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837976.035431:0:85193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396ccc7f9c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.035437:0:85193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396ccc7f9c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788837976.035458:0:85193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058d6cbc8 reply state 0000000010734e6c transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.035472:0:85193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.035480:0:85193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8ff64216ea00) 00010000:00010000:1.0:1788837976.035482:0:85193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788837976.035749:0:85193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788837976.035821:0:85193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f95 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 10 pid: 85193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.035841:0:85193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff64216eb00) 00010000:00010000:1.0:1788837976.035844:0:85193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788837976.035849:0:85193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396ccc7f95 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cba3 expref: 10 pid: 85193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.035877:0:85193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712de00, rc 0) 00010000:00080000:1.0:1788837976.035971:0:85193:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788837976.035998:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788837976.036002:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000020:00080000:1.0:1788837976.036007:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788837976.036009:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000100:00100000:3.0:1788837976.084402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837976.086756:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116370944 00000100:00100000:0.0:1788837976.086787:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116370944 00000100:00100000:0.0:1788837976.086914:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1073 00000100:00100000:0.0:1788837976.086930:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2403:x1875729116370944:12345-192.168.203.30@tcp:101:lfs.0 00010000:00080000:0.0:1788837976.086962:0:76060:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:0.0:1788837976.086978:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2403:x1875729116370944:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 53us (2596us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788837976.086986:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1073 00000020:00080000:0.0:1788837976.087018:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788837976.087022:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:0.0:1788837976.087027:0:85193:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:0.0:1788837976.087031:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788837976.087970:0:85193:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116370944 t98784247813 from 192.168.203.30@tcp req@ffff8ff640e54e00 x1875729116370944/t0(98784247813) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:632/0 lens 736/0 e 0 to 0 dl 1788837987 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788837976.088002:0:85193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837976.088179:0:85193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc7fb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbaa expref: -99 pid: 85193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788837976.088343:0:85193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:0.0:1788837976.092773:0:85193:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x88da08396ccc7d26 00000004:00080000:0.0:1788837976.092789:0:85193:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x88da08396ccc7d26 in new mfd 00010000:00010000:0.0:1788837976.092898:0:85193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc7fb1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbaa expref: 12 pid: 85193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.092936:0:85193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61d6b9b00) 00010000:00010000:0.0:1788837976.092939:0:85193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837976.092945:0:85193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc7fb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbaa expref: 12 pid: 85193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.092974:0:85193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8600, rc 0) 00010000:00080000:0.0:1788837976.096726:0:85193:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788837976.096790:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788837976.096795:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:0.0:1788837976.096817:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788837976.096830:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:3.0:1788837976.101324:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837976.101975:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116371328 00000100:00100000:0.0:1788837976.101993:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116371328 00000100:00100000:0.0:1788837976.102201:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:0.0:1788837976.102215:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502465850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2403:x1875729116371328:12345-192.168.203.30@tcp:35:lfs.0 00010000:00080000:0.0:1788837976.102242:0:66256:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:0.0:1788837976.102265:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502465850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2403:x1875729116371328:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 54us (959us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788837976.102273:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 216 00000020:00080000:2.0:1788837976.102366:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.102372:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:2.0:1788837976.102377:0:85193:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:2.0:1788837976.102381:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.102392:0:85193:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116371328 t98784247814 from 192.168.203.30@tcp req@ffff8ff502465850 x1875729116371328/t0(98784247814) o35->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:632/0 lens 392/0 e 0 to 0 dl 1788837987 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788837976.102743:0:85193:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788837976.102824:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.102827:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:2.0:1788837976.102843:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.102845:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:2.0:1788837976.111349:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837976.113089:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116371584 00000100:00100000:0.0:1788837976.113112:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116371584 00000100:00100000:0.0:1788837976.113209:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:0.0:1788837976.113223:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2403:x1875729116371584:12345-192.168.203.30@tcp:35:lfs.0 00010000:00080000:0.0:1788837976.113251:0:66256:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:3.0:1788837976.113353:0:66257:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1788837976.113367:0:66257:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1788837976.114678:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2403:x1875729116371584:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 1448us (3338us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788837976.114693:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 217 00000020:00080000:2.0:1788837976.116197:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.116207:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:2.0:1788837976.116213:0:85193:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:2.0:1788837976.116217:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.116233:0:85193:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116371584 t98784247815 from 192.168.203.30@tcp req@ffff8ff626a89180 x1875729116371584/t0(98784247815) o35->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:632/0 lens 392/0 e 0 to 0 dl 1788837987 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788837976.116622:0:85193:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788837976.116645:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.116648:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:2.0:1788837976.116651:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.116653:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:3.0:1788837976.126859:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837976.126939:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116376448 00000100:00100000:0.0:1788837976.126954:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116376448 00000100:00100000:0.0:1788837976.127035:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1054 00000100:00100000:0.0:1788837976.127049:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:2403:x1875729116376448:12345-192.168.203.30@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788837976.127084:0:75504:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff61d27e680 x1875729116376448/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:632/0 lens 224/0 e 0 to 0 dl 1788837987 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788837976.127105:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:2403:x1875729116376448:12345-192.168.203.30@tcp:400:ldlm_lock_repla.0 Request processed in 61us (268us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788837976.127113:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1054 00000020:00080000:2.0:1788837976.127694:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.127704:0:85193:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247816 00010000:00080000:2.0:1788837976.127708:0:85193:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788837976.127712:0:85193:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788837976.127723:0:85193:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788837976.127726:0:85193:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1788837976.127909:0:85193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:3.0:1788837976.140593:0:85160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00100000:3.0:1788837976.140610:0:85160:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788837976.140644:0:85160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00010000:00010000:2.0:1788837976.140829:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140847:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140857:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140880:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788837976.140886:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140897:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140920:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140928:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc7f87 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140964:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140972:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140978:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140984:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788837976.140987:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.140994:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.141003:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.141015:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc7fa3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788837976.141194:0:85193:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788837976.141249:0:85193:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788837976.141271:0:85193:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8ff640e54000 x1875729134969344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:631/0 lens 224/0 e 0 to 0 dl 1788837986 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788837976.141432:0:85193:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.30@tcp: req@ffff8ff61d27e680 x1875729116376448/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:632/0 lens 224/0 e 0 to 0 dl 1788837987 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788837976.141514:0:85193:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788837976.145171:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788837976.145198:0:3642:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8ff626a8a680 x1875729134969344/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788837991 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837976.145216:0:3642:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8ff626a8a680 x1875729134969344/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788837991 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788837976.145224:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788837976.145257:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788837976.145263:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134969344:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788837976.145461:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788837976.145481:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134969472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837976.145578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837976.145642:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134969472 00000100:00100000:2.0:1788837976.145651:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134969472 00000100:00100000:2.0:1788837976.145724:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:2.0:1788837976.145736:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134969472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788837976.145784:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:2.0:1788837976.145857:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134969472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837976.145865:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:00100000:2.0:1788837976.145912:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134969472:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1788837976.200992:0:85193:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f518867fe10 00100000:10000000:0.0:1788837976.201013:0:85193:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1788837976.203401:0:85181:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:2.0:1788837976.203468:0:85181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85181:1875729134969600:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788837976.203574:0:85181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837976.203615:0:85181:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788837976.203751:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134969600 00000100:00100000:2.0:1788837976.203760:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134969600 00000100:00100000:2.0:1788837976.203839:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:2.0:1788837976.203849:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:85181:x1875729134969600:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788837976.203885:0:8462:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -63 00002000:02000040:2.0:1788837976.203890:0:8462:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:737) 00000004:00080000:0.0:1788837976.204720:0:85179:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1788837976.204759:0:85179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85179:1875729134969728:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788837976.204856:0:85179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837976.204883:0:85179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff627f0a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788837976.212291:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134969728 00000100:00100000:0.0:1788837976.212313:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134969728 00000100:00100000:0.0:1788837976.212408:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:0.0:1788837976.212422:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:85179:x1875729134969728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788837976.212470:0:26215:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -561 00002000:02000040:0.0:1788837976.212476:0:26215:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:737) 00002000:00010000:2.0:1788837976.226987:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837976.227010:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000402a85a3/0x88da08396ccc7fbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227048:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e1:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:2.0:1788837976.227054:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837976.227063:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000402a85a3/0x88da08396ccc7fbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227087:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000402a85a3/0x88da08396ccc7fbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227100:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000402a85a3/0x88da08396ccc7fbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227110:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000402a85a3/0x88da08396ccc7fbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227146:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788837976.227331:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837976.227337:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a83939a/0x88da08396ccc7fc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227347:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e0:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:2.0:1788837976.227350:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837976.227354:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a83939a/0x88da08396ccc7fc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227388:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a83939a/0x88da08396ccc7fc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227397:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a83939a/0x88da08396ccc7fc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227405:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a83939a/0x88da08396ccc7fc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227433:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788837976.227477:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788837976.227482:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eee2fdb5/0x88da08396ccc7fcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227490:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2df:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:2.0:1788837976.227494:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788837976.227498:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eee2fdb5/0x88da08396ccc7fcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227507:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eee2fdb5/0x88da08396ccc7fcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227515:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eee2fdb5/0x88da08396ccc7fcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227535:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eee2fdb5/0x88da08396ccc7fcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227558:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788837976.227578:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837976.227585:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000402a85a3/0x88da08396ccc7fbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227594:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.227599:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000402a85a3/0x88da08396ccc7fbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227609:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000402a85a3/0x88da08396ccc7fbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227633:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000402a85a3/0x88da08396ccc7fbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227640:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000402a85a3/0x88da08396ccc7fbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227665:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837976.227668:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a83939a/0x88da08396ccc7fc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227686:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.227689:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a83939a/0x88da08396ccc7fc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227697:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a83939a/0x88da08396ccc7fc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227710:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a83939a/0x88da08396ccc7fc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227718:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a83939a/0x88da08396ccc7fc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227733:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837976.227737:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eee2fdb5/0x88da08396ccc7fcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227744:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.227747:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eee2fdb5/0x88da08396ccc7fcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227755:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eee2fdb5/0x88da08396ccc7fcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227764:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eee2fdb5/0x88da08396ccc7fcd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227778:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eee2fdb5/0x88da08396ccc7fcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.227793:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837976.227795:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837976.227845:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.229858:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.232080:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.232095:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067783460/0x88da08396ccc7fd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232119:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2de:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.232124:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.232132:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067783460/0x88da08396ccc7fd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232164:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067783460/0x88da08396ccc7fd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232178:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067783460/0x88da08396ccc7fd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232209:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067783460/0x88da08396ccc7fd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232241:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788837976.232289:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.232294:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026bbd6ec/0x88da08396ccc7fdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232303:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dd:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.232306:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.232309:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026bbd6ec/0x88da08396ccc7fdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232318:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026bbd6ec/0x88da08396ccc7fdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232325:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026bbd6ec/0x88da08396ccc7fdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232333:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026bbd6ec/0x88da08396ccc7fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232349:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788837976.232389:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.232394:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004827993b/0x88da08396ccc7fe2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232408:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dc:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.232411:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.232415:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004827993b/0x88da08396ccc7fe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232424:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004827993b/0x88da08396ccc7fe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232431:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004827993b/0x88da08396ccc7fe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232438:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004827993b/0x88da08396ccc7fe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232454:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788837976.232467:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788837976.232475:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067783460/0x88da08396ccc7fd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232485:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712de00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.232491:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067783460/0x88da08396ccc7fd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232501:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067783460/0x88da08396ccc7fd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232532:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067783460/0x88da08396ccc7fd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232539:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067783460/0x88da08396ccc7fd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232574:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837976.232578:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026bbd6ec/0x88da08396ccc7fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232584:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712ca00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.232587:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026bbd6ec/0x88da08396ccc7fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232594:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026bbd6ec/0x88da08396ccc7fdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232603:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026bbd6ec/0x88da08396ccc7fdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232610:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026bbd6ec/0x88da08396ccc7fdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232623:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.232626:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004827993b/0x88da08396ccc7fe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232649:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712dc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.232653:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004827993b/0x88da08396ccc7fe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232660:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004827993b/0x88da08396ccc7fe2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232672:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004827993b/0x88da08396ccc7fe2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232679:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004827993b/0x88da08396ccc7fe2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232691:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.232693:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.232694:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.232741:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.232746:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023372e95/0x88da08396ccc7fe9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232754:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2db:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.232757:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.232762:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023372e95/0x88da08396ccc7fe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232771:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023372e95/0x88da08396ccc7fe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232786:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023372e95/0x88da08396ccc7fe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232793:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023372e95/0x88da08396ccc7fe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232832:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.232839:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.232843:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023372e95/0x88da08396ccc7fe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232849:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712ce00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.232852:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023372e95/0x88da08396ccc7fe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232860:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023372e95/0x88da08396ccc7fe9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232871:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023372e95/0x88da08396ccc7fe9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232878:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023372e95/0x88da08396ccc7fe9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232892:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.232899:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.232901:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.232954:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.232959:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d71b80e9/0x88da08396ccc7ff0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232967:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2da:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.232970:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.232980:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d71b80e9/0x88da08396ccc7ff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232988:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d71b80e9/0x88da08396ccc7ff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.232996:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d71b80e9/0x88da08396ccc7ff0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233008:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d71b80e9/0x88da08396ccc7ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233021:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.233026:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.233036:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d71b80e9/0x88da08396ccc7ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233042:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.233045:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d71b80e9/0x88da08396ccc7ff0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233068:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d71b80e9/0x88da08396ccc7ff0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233085:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d71b80e9/0x88da08396ccc7ff0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233093:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d71b80e9/0x88da08396ccc7ff0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233113:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.233114:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.233116:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.233178:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.233183:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a34368/0x88da08396ccc7ff7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233198:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d9:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.233201:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.233204:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a34368/0x88da08396ccc7ff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233213:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5a34368/0x88da08396ccc7ff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233225:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5a34368/0x88da08396ccc7ff7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233238:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5a34368/0x88da08396ccc7ff7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233256:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.233263:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.233266:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5a34368/0x88da08396ccc7ff7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233278:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.233281:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a34368/0x88da08396ccc7ff7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233288:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5a34368/0x88da08396ccc7ff7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233303:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5a34368/0x88da08396ccc7ff7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233310:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5a34368/0x88da08396ccc7ff7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233329:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.233332:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.233333:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.233387:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.233401:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ffe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233409:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d8:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.233412:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.233416:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233426:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233442:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ffe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233448:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233467:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.233474:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.233483:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233491:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.233494:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233502:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233524:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ffe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233537:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000047f1a66/0x88da08396ccc7ffe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233550:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.233552:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.233553:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.233596:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.233601:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006efe6612/0x88da08396ccc8005 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233608:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d7:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.233611:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.233616:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006efe6612/0x88da08396ccc8005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233625:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006efe6612/0x88da08396ccc8005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233633:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006efe6612/0x88da08396ccc8005 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233649:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006efe6612/0x88da08396ccc8005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233680:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.233687:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.233690:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006efe6612/0x88da08396ccc8005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233705:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.233708:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006efe6612/0x88da08396ccc8005 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233715:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006efe6612/0x88da08396ccc8005 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233733:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006efe6612/0x88da08396ccc8005 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233740:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006efe6612/0x88da08396ccc8005 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233785:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.233786:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.233788:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.233862:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.233873:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a58b4c84/0x88da08396ccc800c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233881:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d6:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.233890:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.233894:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a58b4c84/0x88da08396ccc800c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233910:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a58b4c84/0x88da08396ccc800c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233918:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a58b4c84/0x88da08396ccc800c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233926:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a58b4c84/0x88da08396ccc800c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233939:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.233946:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.233950:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a58b4c84/0x88da08396ccc800c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233965:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.233968:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a58b4c84/0x88da08396ccc800c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233975:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a58b4c84/0x88da08396ccc800c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.233990:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a58b4c84/0x88da08396ccc800c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234013:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a58b4c84/0x88da08396ccc800c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234029:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234036:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234037:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.234091:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.234096:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009661bfa4/0x88da08396ccc8013 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234104:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d5:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.234107:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.234116:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009661bfa4/0x88da08396ccc8013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234125:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009661bfa4/0x88da08396ccc8013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234133:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009661bfa4/0x88da08396ccc8013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234146:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009661bfa4/0x88da08396ccc8013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234172:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.234178:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.234187:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009661bfa4/0x88da08396ccc8013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234194:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5e400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.234197:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009661bfa4/0x88da08396ccc8013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234212:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009661bfa4/0x88da08396ccc8013 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234223:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009661bfa4/0x88da08396ccc8013 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234237:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009661bfa4/0x88da08396ccc8013 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234251:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234253:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234255:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.234306:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.234311:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067b574e8/0x88da08396ccc801a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234319:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d4:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.234322:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.234326:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067b574e8/0x88da08396ccc801a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234348:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067b574e8/0x88da08396ccc801a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234356:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067b574e8/0x88da08396ccc801a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234363:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067b574e8/0x88da08396ccc801a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234376:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.234383:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.234387:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067b574e8/0x88da08396ccc801a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234393:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5e000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.234396:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067b574e8/0x88da08396ccc801a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234402:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067b574e8/0x88da08396ccc801a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234413:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067b574e8/0x88da08396ccc801a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234420:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067b574e8/0x88da08396ccc801a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234439:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234441:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234442:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.234481:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.234486:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6c2c09/0x88da08396ccc8021 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234494:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d3:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.234498:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.234502:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b6c2c09/0x88da08396ccc8021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234511:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b6c2c09/0x88da08396ccc8021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234519:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b6c2c09/0x88da08396ccc8021 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234526:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b6c2c09/0x88da08396ccc8021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234539:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.234545:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.234549:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b6c2c09/0x88da08396ccc8021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234568:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.234571:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6c2c09/0x88da08396ccc8021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234579:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b6c2c09/0x88da08396ccc8021 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234590:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b6c2c09/0x88da08396ccc8021 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234598:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b6c2c09/0x88da08396ccc8021 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234610:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234612:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234614:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.234654:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.234659:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000981fc373/0x88da08396ccc8028 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234667:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d2:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.234671:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.234674:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000981fc373/0x88da08396ccc8028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234682:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000981fc373/0x88da08396ccc8028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234695:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000981fc373/0x88da08396ccc8028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234701:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000981fc373/0x88da08396ccc8028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234712:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.234719:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.234722:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000981fc373/0x88da08396ccc8028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234729:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.234732:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000981fc373/0x88da08396ccc8028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234740:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000981fc373/0x88da08396ccc8028 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234751:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000981fc373/0x88da08396ccc8028 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234759:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000981fc373/0x88da08396ccc8028 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234773:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234781:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234783:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.234854:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.234859:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ac2bd9/0x88da08396ccc802f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234868:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d1:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.234871:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.234875:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ac2bd9/0x88da08396ccc802f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234884:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2ac2bd9/0x88da08396ccc802f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234893:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ac2bd9/0x88da08396ccc802f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234899:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ac2bd9/0x88da08396ccc802f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234913:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.234918:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.234922:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2ac2bd9/0x88da08396ccc802f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234930:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5ee00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.234933:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ac2bd9/0x88da08396ccc802f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234952:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ac2bd9/0x88da08396ccc802f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234963:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2ac2bd9/0x88da08396ccc802f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234971:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ac2bd9/0x88da08396ccc802f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.234984:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234986:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.234987:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.235025:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.235030:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ef6459/0x88da08396ccc8036 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.235038:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d0:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.235041:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.235045:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ef6459/0x88da08396ccc8036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.235053:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ef6459/0x88da08396ccc8036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.235060:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ef6459/0x88da08396ccc8036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.235072:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024ef6459/0x88da08396ccc8036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.235084:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.235091:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.235095:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024ef6459/0x88da08396ccc8036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.235101:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5fe00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.235104:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ef6459/0x88da08396ccc8036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.235112:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ef6459/0x88da08396ccc8036 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.235124:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024ef6459/0x88da08396ccc8036 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.235132:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ef6459/0x88da08396ccc8036 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.235144:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.235146:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.235148:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837976.240832:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837976.242601:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.246749:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.246773:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba5fe21c/0x88da08396ccc803d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.246809:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cf:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.246815:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.246824:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba5fe21c/0x88da08396ccc803d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.246844:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba5fe21c/0x88da08396ccc803d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.246857:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba5fe21c/0x88da08396ccc803d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.246865:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba5fe21c/0x88da08396ccc803d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.246896:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.246911:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.246918:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba5fe21c/0x88da08396ccc803d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.246926:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.246932:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba5fe21c/0x88da08396ccc803d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.246942:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba5fe21c/0x88da08396ccc803d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.246969:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba5fe21c/0x88da08396ccc803d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.246977:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba5fe21c/0x88da08396ccc803d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247000:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.247002:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.247003:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.247177:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.247183:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccc6fee7/0x88da08396ccc8044 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247191:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ce:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.247194:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.247199:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc6fee7/0x88da08396ccc8044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247207:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccc6fee7/0x88da08396ccc8044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247215:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccc6fee7/0x88da08396ccc8044 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247221:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccc6fee7/0x88da08396ccc8044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247249:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.247258:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.247262:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccc6fee7/0x88da08396ccc8044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247269:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5e600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.247272:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccc6fee7/0x88da08396ccc8044 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247280:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccc6fee7/0x88da08396ccc8044 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247292:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccc6fee7/0x88da08396ccc8044 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247299:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccc6fee7/0x88da08396ccc8044 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247311:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.247313:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.247314:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.247357:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.247363:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f08355e/0x88da08396ccc804b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247370:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cd:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.247378:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.247382:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f08355e/0x88da08396ccc804b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247463:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f08355e/0x88da08396ccc804b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247471:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f08355e/0x88da08396ccc804b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247478:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f08355e/0x88da08396ccc804b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247494:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.247502:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.247507:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f08355e/0x88da08396ccc804b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247515:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5e800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.247519:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f08355e/0x88da08396ccc804b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247526:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f08355e/0x88da08396ccc804b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247537:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f08355e/0x88da08396ccc804b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.247555:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f08355e/0x88da08396ccc804b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248707:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.248710:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.248713:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.248829:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.248838:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007df17fb8/0x88da08396ccc8052 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248850:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cc:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.248854:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.248859:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df17fb8/0x88da08396ccc8052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248872:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df17fb8/0x88da08396ccc8052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248882:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007df17fb8/0x88da08396ccc8052 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248890:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007df17fb8/0x88da08396ccc8052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248911:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.248919:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.248933:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007df17fb8/0x88da08396ccc8052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248941:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.248945:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007df17fb8/0x88da08396ccc8052 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248954:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007df17fb8/0x88da08396ccc8052 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248973:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007df17fb8/0x88da08396ccc8052 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248980:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df17fb8/0x88da08396ccc8052 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.248995:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.248996:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.248998:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837976.249332:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.250869:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.250887:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50a60a3/0x88da08396ccc8059 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.250909:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cb:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.250913:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.250920:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c50a60a3/0x88da08396ccc8059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.250953:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c50a60a3/0x88da08396ccc8059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.250965:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50a60a3/0x88da08396ccc8059 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.250974:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c50a60a3/0x88da08396ccc8059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.250995:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.251009:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.251015:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c50a60a3/0x88da08396ccc8059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.251024:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5fc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.251029:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50a60a3/0x88da08396ccc8059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.252215:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50a60a3/0x88da08396ccc8059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.252253:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c50a60a3/0x88da08396ccc8059 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.252262:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c50a60a3/0x88da08396ccc8059 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.252306:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.252308:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.252311:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.252473:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.252481:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cb7b4aa/0x88da08396ccc8060 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.252495:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ca:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.252500:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.252507:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cb7b4aa/0x88da08396ccc8060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.252521:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cb7b4aa/0x88da08396ccc8060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.252532:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cb7b4aa/0x88da08396ccc8060 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.252540:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cb7b4aa/0x88da08396ccc8060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.255613:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788837976.255829:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.255840:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaa69399/0x88da08396ccc8067 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.255875:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c9:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.255881:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.255889:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaa69399/0x88da08396ccc8067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.255906:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaa69399/0x88da08396ccc8067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.255919:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaa69399/0x88da08396ccc8067 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.255927:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaa69399/0x88da08396ccc8067 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788837976.267730:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837976.267756:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ce354d/0x88da08396ccc806e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.267782:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e1:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:0.0:1788837976.267788:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837976.267807:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ce354d/0x88da08396ccc806e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.267831:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4ce354d/0x88da08396ccc806e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.267845:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ce354d/0x88da08396ccc806e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.267853:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ce354d/0x88da08396ccc806e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268694:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837976.268708:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cb7b4aa/0x88da08396ccc8060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268720:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5ec00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.268725:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cb7b4aa/0x88da08396ccc8060 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268737:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cb7b4aa/0x88da08396ccc8060 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268763:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cb7b4aa/0x88da08396ccc8060 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268771:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cb7b4aa/0x88da08396ccc8060 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268812:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837976.268817:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaa69399/0x88da08396ccc8067 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268831:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5e200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.268835:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaa69399/0x88da08396ccc8067 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268844:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaa69399/0x88da08396ccc8067 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268857:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaa69399/0x88da08396ccc8067 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268865:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837976.268868:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4ce354d/0x88da08396ccc806e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268875:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.268878:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ce354d/0x88da08396ccc806e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268886:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ce354d/0x88da08396ccc806e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268896:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4ce354d/0x88da08396ccc806e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.268905:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837976.268912:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837976.268914:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.275077:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788837976.275098:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaa69399/0x88da08396ccc8067 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275180:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.275364:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.275373:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e121c778/0x88da08396ccc8075 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275391:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c8:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.275397:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.275405:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e121c778/0x88da08396ccc8075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275438:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e121c778/0x88da08396ccc8075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275449:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e121c778/0x88da08396ccc8075 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275458:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e121c778/0x88da08396ccc8075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275481:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.275491:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.275497:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e121c778/0x88da08396ccc8075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275505:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5fa00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.275511:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e121c778/0x88da08396ccc8075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275521:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e121c778/0x88da08396ccc8075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275540:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e121c778/0x88da08396ccc8075 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275548:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e121c778/0x88da08396ccc8075 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275594:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.275596:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.275598:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.275653:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.275658:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7c80dbc/0x88da08396ccc807c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275665:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c7:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.275668:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.275672:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c80dbc/0x88da08396ccc807c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275680:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7c80dbc/0x88da08396ccc807c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275688:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7c80dbc/0x88da08396ccc807c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275694:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c80dbc/0x88da08396ccc807c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275708:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.275715:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.275720:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7c80dbc/0x88da08396ccc807c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275738:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.275742:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7c80dbc/0x88da08396ccc807c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275749:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7c80dbc/0x88da08396ccc807c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275761:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7c80dbc/0x88da08396ccc807c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275768:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7c80dbc/0x88da08396ccc807c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275782:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.275784:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.275786:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.275847:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.275852:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006738d72a/0x88da08396ccc8083 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275860:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c6:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.275863:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.275867:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006738d72a/0x88da08396ccc8083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275876:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006738d72a/0x88da08396ccc8083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275891:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006738d72a/0x88da08396ccc8083 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275898:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006738d72a/0x88da08396ccc8083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275913:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788837976.275953:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.275958:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015065e6a/0x88da08396ccc808a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275966:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c5:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.275969:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.275974:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015065e6a/0x88da08396ccc808a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275982:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015065e6a/0x88da08396ccc808a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275990:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015065e6a/0x88da08396ccc808a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.275998:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015065e6a/0x88da08396ccc808a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276022:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788837976.276029:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788837976.276034:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006738d72a/0x88da08396ccc8083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276041:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5ea00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.276045:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006738d72a/0x88da08396ccc8083 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276053:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006738d72a/0x88da08396ccc8083 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276064:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006738d72a/0x88da08396ccc8083 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276072:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006738d72a/0x88da08396ccc8083 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276086:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.276090:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015065e6a/0x88da08396ccc808a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276097:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.276100:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015065e6a/0x88da08396ccc808a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276119:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015065e6a/0x88da08396ccc808a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276131:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015065e6a/0x88da08396ccc808a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276138:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015065e6a/0x88da08396ccc808a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276163:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.276165:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.276167:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.276211:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.276217:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d278e3/0x88da08396ccc8091 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276225:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c4:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.276228:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.276232:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d278e3/0x88da08396ccc8091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276241:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d278e3/0x88da08396ccc8091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276249:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d278e3/0x88da08396ccc8091 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276263:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048d278e3/0x88da08396ccc8091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276276:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.276283:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.276287:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048d278e3/0x88da08396ccc8091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276294:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.276297:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d278e3/0x88da08396ccc8091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276305:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d278e3/0x88da08396ccc8091 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276317:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048d278e3/0x88da08396ccc8091 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276325:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d278e3/0x88da08396ccc8091 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276338:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.276340:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.276341:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.276381:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.276392:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db245dd/0x88da08396ccc8098 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276401:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c3:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.276404:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.276408:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db245dd/0x88da08396ccc8098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276417:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db245dd/0x88da08396ccc8098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276425:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db245dd/0x88da08396ccc8098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276432:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008db245dd/0x88da08396ccc8098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276445:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.276451:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.276454:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008db245dd/0x88da08396ccc8098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276461:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.276464:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008db245dd/0x88da08396ccc8098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276471:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008db245dd/0x88da08396ccc8098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276488:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008db245dd/0x88da08396ccc8098 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276496:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008db245dd/0x88da08396ccc8098 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276511:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.276512:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.276515:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788837976.276558:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.276564:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b18d11ea/0x88da08396ccc809f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276572:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c2:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.276576:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.276581:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b18d11ea/0x88da08396ccc809f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276589:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b18d11ea/0x88da08396ccc809f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276599:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b18d11ea/0x88da08396ccc809f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276607:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b18d11ea/0x88da08396ccc809f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276630:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788837976.276638:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788837976.276642:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b18d11ea/0x88da08396ccc809f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276649:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788837976.276653:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b18d11ea/0x88da08396ccc809f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276660:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b18d11ea/0x88da08396ccc809f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276671:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b18d11ea/0x88da08396ccc809f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276678:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b18d11ea/0x88da08396ccc809f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.276691:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.276693:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.276695:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788837976.277005:0:8462:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:1.0:1788837976.277129:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:85181:x1875729134969600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 73277us (73562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837976.277141:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:1.0:1788837976.277239:0:85181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85181:1875729134969600:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788837976.277258:0:85181:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2e1:0x0] from OST, last_created [0x2c0000401:0x2e1:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1788837976.277346:0:85181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85181:1875729134969984:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788837976.277387:0:85181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837976.277415:0:85181:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff637f4ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788837976.277435:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134969856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837976.277461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837976.277511:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134969984 00000100:00100000:1.0:1788837976.277519:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134969984 00000100:00100000:1.0:1788837976.277561:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5919 00000100:00100000:1.0:1788837976.277570:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:85181:x1875729134969984:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788837976.277614:0:26214:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 738 00010000:00010000:2.0:1788837976.278863:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837976.280952:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134969856 00000100:00100000:2.0:1788837976.280970:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134969856 00000100:00100000:2.0:1788837976.281051:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1788837976.281063:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134969856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837976.281095:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837976.281216:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134969856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837976.281224:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00010000:00010000:0.0:1788837976.284076:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788837976.284098:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4ce354d/0x88da08396ccc806e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788837976.284287:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134969856:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1788837976.284502:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837976.284511:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc80a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.284527:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e0:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:0.0:1788837976.284532:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837976.284539:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc80a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.284558:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc80a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285053:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc80a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285063:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc80a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285109:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788837976.285174:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837976.285180:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099062105/0x88da08396ccc80ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285189:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2df:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:0.0:1788837976.285203:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837976.285208:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099062105/0x88da08396ccc80ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285219:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099062105/0x88da08396ccc80ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285228:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099062105/0x88da08396ccc80ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285236:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099062105/0x88da08396ccc80ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285252:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788837976.285296:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837976.285301:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc80b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285309:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2de:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:0.0:1788837976.285311:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837976.285316:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc80b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285324:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc80b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285331:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc80b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285346:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc80b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285362:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788837976.285373:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837976.285381:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc80a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285390:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.285395:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc80a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285407:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc80a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285429:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc80a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285438:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc80a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285456:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837976.285460:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099062105/0x88da08396ccc80ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285479:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.285482:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099062105/0x88da08396ccc80ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285490:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099062105/0x88da08396ccc80ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285502:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099062105/0x88da08396ccc80ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285510:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099062105/0x88da08396ccc80ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285524:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837976.285528:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc80b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285535:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.285539:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc80b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285546:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc80b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.285556:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc80b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.285814:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837976.286898:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837976.286910:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.287773:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc80b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.287829:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.287831:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.287834:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837976.287999:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837976.288007:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8a0e6b1/0x88da08396ccc80bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288023:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dd:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:0.0:1788837976.288028:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837976.288035:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a0e6b1/0x88da08396ccc80bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288051:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8a0e6b1/0x88da08396ccc80bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288062:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8a0e6b1/0x88da08396ccc80bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288071:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a0e6b1/0x88da08396ccc80bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288094:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837976.288117:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837976.288122:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8a0e6b1/0x88da08396ccc80bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288131:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.288136:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8a0e6b1/0x88da08396ccc80bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288147:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8a0e6b1/0x88da08396ccc80bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288176:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8a0e6b1/0x88da08396ccc80bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288183:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8a0e6b1/0x88da08396ccc80bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288196:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.288198:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.288199:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837976.288242:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837976.288248:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000270c394f/0x88da08396ccc80c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288256:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dc:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:0.0:1788837976.288259:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837976.288264:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000270c394f/0x88da08396ccc80c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288284:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000270c394f/0x88da08396ccc80c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288293:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000270c394f/0x88da08396ccc80c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288301:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000270c394f/0x88da08396ccc80c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288314:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837976.288321:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837976.288326:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000270c394f/0x88da08396ccc80c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288334:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.288338:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000270c394f/0x88da08396ccc80c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288346:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000270c394f/0x88da08396ccc80c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288358:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000270c394f/0x88da08396ccc80c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288366:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000270c394f/0x88da08396ccc80c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288386:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.288388:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.288390:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788837976.288431:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788837976.288437:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc80c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288446:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2db:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:0.0:1788837976.288449:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788837976.288453:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc80c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288462:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc80c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288472:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc80c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288479:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc80c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288493:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788837976.288500:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837976.288505:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc80c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288524:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.288527:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc80c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288535:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc80c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288545:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc80c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.288552:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc80c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788837976.291144:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:85181:x1875729134969984:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13564us (13746us total) trans 4294969449 rc 0/0 00000100:00100000:1.0:1788837976.291171:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5919 00000100:00100000:1.0:1788837976.291255:0:85181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85181:1875729134969984:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788837976.291274:0:85181:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2e1:0x0]-[0x2c0000401:0x301:0x0] 00002000:00010000:1.0:1788837976.291426:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.291435:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc80d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291453:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2da:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.291458:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.291465:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc80d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291501:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc80d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291514:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc80d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291523:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc80d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291542:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788837976.291583:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.291587:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc80d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291596:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d9:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.291599:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.291602:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc80d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291610:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc80d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291618:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc80d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291636:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc80d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291649:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788837976.291687:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.291693:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc80de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291700:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d8:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.291703:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.291707:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc80de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291716:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc80de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291723:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc80de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291730:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc80de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291742:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788837976.291778:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.291783:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc80e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291795:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d7:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.291823:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.291827:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc80e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291836:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc80e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291844:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc80e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291851:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc80e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291859:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788837976.291899:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.291904:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc80ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291912:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d6:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.291916:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.291920:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc80ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291935:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc80ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291954:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc80ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291961:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc80ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.291970:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788837976.292010:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.292014:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc80f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292022:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d5:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.292025:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.292028:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc80f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292037:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc80f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292045:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc80f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292052:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc80f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292073:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788837976.292111:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.292116:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc80fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292124:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d4:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.292127:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.292131:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc80fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292140:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc80fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292148:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc80fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292167:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc80fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292176:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788837976.292212:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.292217:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc8101 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292224:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d3:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.292233:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.292237:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc8101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292247:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc8101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292255:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc8101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292263:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc8101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292272:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1788837976.292313:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.292318:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc8108 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292326:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d2:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.292329:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.292332:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc8108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292340:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc8108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292348:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc8108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292362:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc8108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292372:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788837976.292408:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.292413:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc810f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292421:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d1:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.292424:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.292428:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc810f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292437:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc810f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292445:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc810f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292453:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc810f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292461:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1788837976.292496:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.292501:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc8116 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292514:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d0:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.292517:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.292521:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc8116 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292530:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc8116 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292538:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc8116 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292546:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc8116 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292555:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1788837976.292599:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.292604:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc811d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292612:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cf:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.292615:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.292619:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc811d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292627:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc811d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292646:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc811d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292653:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc811d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292662:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1788837976.292703:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.292708:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000366bdbcb/0x88da08396ccc8124 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292717:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ce:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.292720:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.292724:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000366bdbcb/0x88da08396ccc8124 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292734:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000366bdbcb/0x88da08396ccc8124 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292742:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000366bdbcb/0x88da08396ccc8124 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292749:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000366bdbcb/0x88da08396ccc8124 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292770:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1788837976.292840:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.292845:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002598d5d7/0x88da08396ccc812b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292866:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cd:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.292870:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.292875:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002598d5d7/0x88da08396ccc812b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292884:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002598d5d7/0x88da08396ccc812b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292891:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002598d5d7/0x88da08396ccc812b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292899:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002598d5d7/0x88da08396ccc812b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292908:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1788837976.292966:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.292971:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3860a2/0x88da08396ccc8132 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.292985:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cc:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.292993:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.292997:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3860a2/0x88da08396ccc8132 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.293012:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb3860a2/0x88da08396ccc8132 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.293019:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb3860a2/0x88da08396ccc8132 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.293025:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb3860a2/0x88da08396ccc8132 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.293038:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:1.0:1788837976.293082:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.293092:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015587dc5/0x88da08396ccc8139 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.293100:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cb:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.293103:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.293107:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015587dc5/0x88da08396ccc8139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.293121:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015587dc5/0x88da08396ccc8139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.293130:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015587dc5/0x88da08396ccc8139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.293144:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015587dc5/0x88da08396ccc8139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.293906:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788837976.293917:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc80d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.293928:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.293940:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc80d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.293951:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc80d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.293979:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc80d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294002:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b129b2bf/0x88da08396ccc80d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294029:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788837976.294033:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc80d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294091:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.294095:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc80d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294103:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc80d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294116:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc80d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294123:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c549960b/0x88da08396ccc80d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294135:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788837976.294146:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc80de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294160:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.294174:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc80de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294184:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc80de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294195:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc80de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294203:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043586584/0x88da08396ccc80de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294225:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788837976.294235:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc80e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294242:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.294246:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc80e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294257:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc80e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294268:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc80e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294275:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ea61d8/0x88da08396ccc80e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294302:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788837976.294312:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc80ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294319:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.294323:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc80ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294331:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc80ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294341:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc80ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294355:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000264a1b22/0x88da08396ccc80ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294370:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788837976.294374:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc80f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294380:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.294384:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc80f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294404:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc80f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294415:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc80f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294424:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c18a7491/0x88da08396ccc80f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294438:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788837976.294442:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc80fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294448:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.294451:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc80fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294459:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc80fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294469:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc80fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294476:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065a64b41/0x88da08396ccc80fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294501:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788837976.294505:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc8101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294511:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.294515:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc8101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294524:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc8101 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294534:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc8101 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294541:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f9a3448/0x88da08396ccc8101 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.294551:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788837976.294555:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc8108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300172:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.300183:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc8108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300231:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc8108 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300262:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc8108 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300270:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e82e661b/0x88da08396ccc8108 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300312:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788837976.300318:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc810f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300325:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.300328:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc810f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300337:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc810f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300348:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc810f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300357:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc810f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300386:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788837976.300390:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc8116 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300397:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.300401:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc8116 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300408:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc8116 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300419:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc8116 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300426:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc8116 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300441:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788837976.300445:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc811d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300452:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.300455:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc811d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300475:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc811d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300486:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc811d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300494:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc811d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300509:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837976.300514:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000366bdbcb/0x88da08396ccc8124 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300521:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.300524:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000366bdbcb/0x88da08396ccc8124 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300532:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000366bdbcb/0x88da08396ccc8124 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300541:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000366bdbcb/0x88da08396ccc8124 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.300548:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000366bdbcb/0x88da08396ccc8124 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301139:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837976.301144:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002598d5d7/0x88da08396ccc812b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301161:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.301164:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002598d5d7/0x88da08396ccc812b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301173:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002598d5d7/0x88da08396ccc812b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301199:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002598d5d7/0x88da08396ccc812b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301208:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002598d5d7/0x88da08396ccc812b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301222:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837976.301227:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb3860a2/0x88da08396ccc8132 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301243:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.301248:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3860a2/0x88da08396ccc8132 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301278:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb3860a2/0x88da08396ccc8132 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301291:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb3860a2/0x88da08396ccc8132 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301299:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb3860a2/0x88da08396ccc8132 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.301321:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.301323:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.301326:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.301351:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.301359:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.301373:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.305085:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788837976.305259:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.305268:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df95a8c/0x88da08396ccc8140 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305284:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ca:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.305289:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.305296:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005df95a8c/0x88da08396ccc8140 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305314:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005df95a8c/0x88da08396ccc8140 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305326:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df95a8c/0x88da08396ccc8140 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305334:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005df95a8c/0x88da08396ccc8140 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305360:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788837976.305401:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.305406:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b71cdb93/0x88da08396ccc8147 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305422:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c9:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.305425:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.305429:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b71cdb93/0x88da08396ccc8147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305439:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b71cdb93/0x88da08396ccc8147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305447:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b71cdb93/0x88da08396ccc8147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305454:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b71cdb93/0x88da08396ccc8147 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305467:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788837976.305507:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.305512:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc814e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305520:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c8:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.305523:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.305527:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc814e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305536:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc814e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.305553:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc814e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.305854:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788837976.305863:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015587dc5/0x88da08396ccc8139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.305874:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.305879:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015587dc5/0x88da08396ccc8139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.305890:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015587dc5/0x88da08396ccc8139 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.305923:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015587dc5/0x88da08396ccc8139 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.305932:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015587dc5/0x88da08396ccc8139 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.305959:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788837976.305963:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005df95a8c/0x88da08396ccc8140 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.305970:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.305973:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005df95a8c/0x88da08396ccc8140 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.305981:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005df95a8c/0x88da08396ccc8140 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.305992:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005df95a8c/0x88da08396ccc8140 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.305999:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005df95a8c/0x88da08396ccc8140 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.306012:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788837976.306016:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b71cdb93/0x88da08396ccc8147 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.306029:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788837976.306033:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b71cdb93/0x88da08396ccc8147 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.306041:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b71cdb93/0x88da08396ccc8147 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.306052:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b71cdb93/0x88da08396ccc8147 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.306059:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b71cdb93/0x88da08396ccc8147 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837976.306071:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.306073:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.306074:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.306084:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837976.306698:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc814e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306719:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788837976.306813:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.306820:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005664f87e/0x88da08396ccc8155 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306829:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c7:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.306832:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.306838:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005664f87e/0x88da08396ccc8155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306849:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005664f87e/0x88da08396ccc8155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306858:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005664f87e/0x88da08396ccc8155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306867:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005664f87e/0x88da08396ccc8155 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306891:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788837976.306935:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.306940:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dfcccd1/0x88da08396ccc815c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306949:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c6:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.306952:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.306956:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dfcccd1/0x88da08396ccc815c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306965:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dfcccd1/0x88da08396ccc815c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306973:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dfcccd1/0x88da08396ccc815c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306981:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dfcccd1/0x88da08396ccc815c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.306992:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788837976.307030:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.307035:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8163 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307042:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c5:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.307051:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.307056:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8163 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307065:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8163 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307073:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8163 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307080:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8163 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307089:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788837976.307129:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.307134:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc816a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307142:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c4:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.307145:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.307149:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc816a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307170:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc816a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307177:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc816a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307191:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc816a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307200:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788837976.307237:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.307242:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc8171 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307251:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c3:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.307255:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.307259:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc8171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307267:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc8171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307275:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc8171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307282:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc8171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307290:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788837976.307327:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788837976.307333:0:26215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000239a4481/0x88da08396ccc8178 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307346:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c2:0x0].0x0 since=3370s v=(0 0) 00010000:00010000:1.0:1788837976.307349:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788837976.307353:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000239a4481/0x88da08396ccc8178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307362:0:26215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000239a4481/0x88da08396ccc8178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307369:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000239a4481/0x88da08396ccc8178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307376:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000239a4481/0x88da08396ccc8178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788837976.307384:0:26215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788837976.307998:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788837976.308008:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc814e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308018:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.308022:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc814e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308031:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc814e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308060:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc814e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308080:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc814e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308106:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788837976.308110:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005664f87e/0x88da08396ccc8155 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308116:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.308119:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005664f87e/0x88da08396ccc8155 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308128:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005664f87e/0x88da08396ccc8155 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308138:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005664f87e/0x88da08396ccc8155 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308145:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005664f87e/0x88da08396ccc8155 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308165:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788837976.308169:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dfcccd1/0x88da08396ccc815c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308176:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.308185:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dfcccd1/0x88da08396ccc815c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308192:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dfcccd1/0x88da08396ccc815c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308204:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dfcccd1/0x88da08396ccc815c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308211:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dfcccd1/0x88da08396ccc815c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308225:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788837976.308228:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8163 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308234:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.308236:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8163 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308244:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8163 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308255:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8163 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308262:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8163 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308281:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788837976.308285:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc816a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308291:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.308295:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc816a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308303:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc816a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308315:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc816a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308322:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc816a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308333:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788837976.308337:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc8171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308345:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.308348:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc8171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308367:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc8171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308377:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc8171 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308385:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc8171 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308397:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788837976.308400:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000239a4481/0x88da08396ccc8178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308407:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788837976.308410:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000239a4481/0x88da08396ccc8178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308418:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000239a4481/0x88da08396ccc8178 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308428:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000239a4481/0x88da08396ccc8178 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308436:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000239a4481/0x88da08396ccc8178 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788837976.308464:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837976.308465:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837976.308467:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.308681:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.308689:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788837976.308696:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788837976.319367:0:26215:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:1.0:1788837976.319519:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:85179:x1875729134969728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 107094us (114656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837976.319534:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00000100:00100000:1.0:1788837976.319621:0:85179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85179:1875729134969728:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788837976.319642:0:85179:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2e1:0x0] from OST, last_created [0x280000401:0x2e1:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:1.0:1788837976.319732:0:85179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85179:1875729134970240:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788837976.319774:0:85179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837976.319843:0:85179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788837976.319875:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134970112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837976.319905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837976.319953:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134970240 00000100:00100000:1.0:1788837976.319960:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134970240 00000100:00100000:1.0:1788837976.320007:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5920 00000100:00100000:1.0:1788837976.320018:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:85179:x1875729134970240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788837976.320064:0:26209:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 738 00000100:00100000:0.0:1788837976.326617:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134970112 00000100:00100000:0.0:1788837976.326647:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134970112 00000100:00100000:0.0:1788837976.326731:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:0.0:1788837976.326743:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729134970112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837976.326776:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837976.326913:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729134970112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (7006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837976.326938:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:1.0:1788837976.330354:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134970112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837976.338621:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:85179:x1875729134970240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18595us (18837us total) trans 4294969449 rc 0/0 00000100:00100000:1.0:1788837976.338637:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5920 00000100:00100000:0.0:1788837976.339028:0:85179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85179:1875729134970240:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788837976.339062:0:85179:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2e1:0x0]-[0x280000401:0x301:0x0] 00000100:00100000:0.0:1788837976.647385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837976.647436:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837976.647481:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837976.647520:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116376832 00000100:00100000:0.0:1788837976.647533:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116376832 00000100:00100000:0.0:1788837976.647607:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116376704 00000100:00100000:0.0:1788837976.647611:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116376704 00000100:00100000:0.0:1788837976.647638:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1055 00000100:00100000:0.0:1788837976.647649:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116376832:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837976.647741:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116376832:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837976.647749:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1055 00000100:00100000:0.0:1788837976.647770:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1056 00000100:00100000:0.0:1788837976.647777:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116376704:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837976.647841:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116376704:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 65us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837976.647848:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1056 00000100:00080000:0.0:1788837976.647865:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837976.648739:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116376576 00000100:00100000:2.0:1788837976.648754:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116376576 00000100:00100000:2.0:1788837976.649356:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:2.0:1788837976.649374:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116376576:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837976.649462:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116376576:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 96us (2092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837976.649469:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00010000:00010000:2.0:1788837977.020976:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788837977.241649:0:85449:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788837978.048219:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788837978.346503:0:85501:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788837978.346891:0:85501:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788837979.085692:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788837979.904190:0:85553:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788837979.904449:0:85553:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788837980.093564:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837980.542733:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837980.542758:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134970368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837980.542859:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837980.542956:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134970368 00000100:00100000:0.0:1788837980.542964:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134970368 00000100:00100000:0.0:1788837980.543041:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:0.0:1788837980.543052:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134970368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837980.543082:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837980.543134:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134970368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837980.543142:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00080000:3.0:1788837980.543208:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788837980.543243:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134970368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837980.543569:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788837980.543578:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134970496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788837980.543605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837980.543827:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134970496 00000100:00100000:2.0:1788837980.543833:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134970496 00000100:00100000:2.0:1788837980.543882:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1788837980.543890:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134970496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837980.543909:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837980.543954:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134970496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837980.543960:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00080000:3.0:1788837980.544034:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837980.544084:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134970496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837981.053195:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837981.053223:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134970624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837981.053314:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837981.053459:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134970624 00000100:00100000:0.0:1788837981.053470:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134970624 00000100:00100000:0.0:1788837981.053531:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:0.0:1788837981.053541:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134970624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837981.053575:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788837981.053826:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134970624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 285us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837981.053833:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:3.0:1788837981.053923:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134970624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788837981.054257:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134970752:0@lo:400:kworker.0 00000100:00100000:0.0:1788837981.054303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837981.054468:0:85166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134970752 00000100:00100000:2.0:1788837981.054476:0:85166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134970752 00000100:00100000:2.0:1788837981.054524:0:85166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788837981.054534:0:85166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729134970752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837981.054564:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729134970880:0@lo:400:kworker.0 00000100:00100000:3.0:1788837981.054611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837981.054643:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134970880 00000100:00100000:3.0:1788837981.054647:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134970880 00000100:00100000:3.0:1788837981.054685:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1788837981.054691:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729134970880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837981.054724:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729134970880:12345-0@lo:400:kworker.0 Request processed in 33us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837981.054731:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00080000:3.0:1788837981.054749:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837981.054767:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729134970880:0@lo:400:kworker.0 00000100:00100000:2.0:1788837981.055243:0:85166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729134970752:12345-0@lo:400:kworker.0 Request processed in 709us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837981.055270:0:85166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788837981.055316:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729134971136:0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.055325:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134971392:0@lo:400:kworker.0 00000100:00100000:2.0:1788837981.055354:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837981.055368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837981.055384:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134971648:0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.055396:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134971904:0@lo:400:kworker.0 00000100:00100000:2.0:1788837981.055420:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837981.055441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837981.055445:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729134972160:0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.055467:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788837981.055475:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134971264:0@lo:400:kworker.0 00000100:00100000:2.0:1788837981.055482:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837981.055505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837981.055514:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788837981.055523:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729134971008:0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.055530:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729134971776:0@lo:400:kworker.0 00000100:00100000:2.0:1788837981.055560:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837981.055675:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134971648 00000100:00100000:3.0:1788837981.055682:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134971648 00000100:00100000:3.0:1788837981.055716:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134971904 00000100:00100000:3.0:1788837981.055719:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134971904 00000100:00100000:3.0:1788837981.055746:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:3.0:1788837981.055752:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134971648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837981.055812:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134971648:12345-0@lo:400:kworker.0 Request processed in 44us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837981.055819:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:3.0:1788837981.055832:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:3.0:1788837981.055848:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729134971904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837981.055894:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729134971904:12345-0@lo:400:kworker.0 Request processed in 46us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837981.055900:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00100000:3.0:1788837981.055917:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134971392 00000100:00100000:3.0:1788837981.055921:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134971392 00000100:00100000:3.0:1788837981.055941:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:3.0:1788837981.055947:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729134971392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837981.055973:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729134971392:12345-0@lo:400:kworker.0 Request processed in 27us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837981.055979:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:2.0:1788837981.056050:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134971520:0@lo:400:kworker.0 00000100:00100000:2.0:1788837981.056081:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837981.056100:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134972032:0@lo:400:kworker.0 00000100:00100000:2.0:1788837981.056141:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837981.056163:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134970752:0@lo:400:kworker.0 00000100:00100000:2.0:1788837981.056178:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134971648:0@lo:400:kworker.0 00000100:00100000:0.0:1788837981.056203:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837981.056211:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134971520 00000100:00100000:2.0:1788837981.056216:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134971520 00000100:00100000:2.0:1788837981.056247:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134972032 00000100:00100000:2.0:1788837981.056251:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134972032 00000100:00100000:1.0:1788837981.056264:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134971136 00000100:00100000:1.0:1788837981.056275:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134971136 00000100:00100000:2.0:1788837981.056279:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429 00000100:00100000:2.0:1788837981.056289:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134971520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.056313:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134972160 00000100:00100000:1.0:1788837981.056317:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134972160 00000100:00100000:2.0:1788837981.056336:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134971520:12345-0@lo:400:kworker.0 Request processed in 48us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837981.056339:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134971264 00000100:00100000:1.0:1788837981.056343:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134971264 00000100:00100000:2.0:1788837981.056347:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429 00000100:00100000:1.0:1788837981.056358:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134971008 00000100:00100000:1.0:1788837981.056362:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134971008 00000100:00100000:2.0:1788837981.056377:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2430 00000100:00100000:1.0:1788837981.056383:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1788837981.056389:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134972032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.056394:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729134971136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837981.056509:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134971776 00000100:00100000:3.0:1788837981.056513:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134971776 00000100:00100000:3.0:1788837981.056532:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1788837981.056538:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729134972160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837981.056908:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134972032:12345-0@lo:400:kworker.0 Request processed in 523us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837981.056915:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2430 00000100:00100000:2.0:1788837981.056938:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1788837981.056946:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134971264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.056991:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729134971136:12345-0@lo:400:kworker.0 Request processed in 599us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837981.057001:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1788837981.057003:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134971264:12345-0@lo:400:kworker.0 Request processed in 55us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837981.057012:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1788837981.057020:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1788837981.057029:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729134971008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837981.057034:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1788837981.057044:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729134971776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.057065:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729134971008:12345-0@lo:400:kworker.0 Request processed in 36us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837981.057074:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1788837981.057087:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729134971776:12345-0@lo:400:kworker.0 Request processed in 44us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837981.057094:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1788837981.057165:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729134971776:0@lo:400:kworker.0 00000100:00100000:0.0:1788837981.057176:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134971392:0@lo:400:kworker.0 00000100:00100000:0.0:1788837981.057186:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134971904:0@lo:400:kworker.0 00000100:00100000:0.0:1788837981.057212:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134971264:0@lo:400:kworker.0 00000100:00100000:3.0:1788837981.057273:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729134972160:12345-0@lo:400:kworker.0 Request processed in 734us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837981.057279:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00080000:3.0:1788837981.057306:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837981.057310:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837981.057312:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837981.057314:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788837981.057374:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729134971008:0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.057385:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134971520:0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.057395:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134972032:0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.057404:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729134971136:0@lo:400:kworker.0 00000100:00100000:1.0:1788837981.057419:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729134972160:0@lo:400:kworker.0 00010000:00010000:2.0:1788837981.117201:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837981.565164:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134972416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837981.565237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837981.565281:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837981.565287:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134972288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788837981.565315:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837981.565365:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134972416 00000100:00100000:2.0:1788837981.565372:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134972416 00000100:00100000:3.0:1788837981.565383:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134972288 00000100:00100000:3.0:1788837981.565391:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134972288 00000100:00100000:2.0:1788837981.565424:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:2.0:1788837981.565433:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729134972416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837981.565469:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837981.565529:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729134972416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837981.565537:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:2.0:1788837981.565597:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134972416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837981.566144:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:3.0:1788837981.566158:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729134972288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788837981.566205:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:3.0:1788837981.566285:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729134972288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837981.566292:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:2.0:1788837981.566712:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134972288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837981.566850:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788837981.566972:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134972544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837981.567026:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837981.567107:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134972544 00000100:00100000:0.0:1788837981.567112:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134972544 00000100:00100000:0.0:1788837981.567161:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:0.0:1788837981.567168:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134972544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837981.567185:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837981.567476:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729134972544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 307us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837981.567483:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:1.0:1788837981.567536:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134972544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837981.760125:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837981.760172:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837981.760200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837981.760265:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116377088 00000100:00100000:0.0:1788837981.760275:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116377088 00000100:00100000:0.0:1788837981.760342:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116377216 00000100:00100000:0.0:1788837981.760345:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116377216 00000100:00100000:0.0:1788837981.760369:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1063 00000100:00100000:0.0:1788837981.760378:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116377088:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837981.760465:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116377088:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 88us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837981.760473:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1063 00000100:00100000:0.0:1788837981.760489:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1064 00000100:00100000:0.0:1788837981.760496:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116377216:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837981.760523:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116377216:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837981.760529:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1064 00000100:00080000:1.0:1788837981.761273:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837981.761278:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837981.762336:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116376960 00000100:00100000:3.0:1788837981.762347:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116376960 00000100:00100000:3.0:1788837981.762417:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:3.0:1788837981.762426:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116376960:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837981.762522:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116376960:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 96us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837981.762529:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:1.0:1788837981.987934:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837981.988063:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116377344 00000100:00100000:3.0:1788837981.988074:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116377344 00000100:00100000:3.0:1788837981.988147:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1074 00000100:00100000:3.0:1788837981.988159:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:65204:x1875729116377344:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788837981.988187:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788837981.988217:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc817f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbcd expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837981.988297:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccc8186 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837981.988312:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccc8186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837981.988326:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccc8186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837981.988377:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788837981.988380:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837981.988422:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccc8186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837981.988446:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc817f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbcd expref: 8 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837981.988465:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccc8186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbcd expref: 7 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837981.988474:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c000) 00010000:00010000:3.0:1788837981.988477:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788837981.988480:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030400, rc 0) 00000100:00100000:3.0:1788837981.988592:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:65204:x1875729116377344:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 435us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837981.988600:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1074 00000100:00100000:0.0:1788837981.998786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837981.998971:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116377472 00000100:00100000:1.0:1788837981.998986:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116377472 00000100:00100000:1.0:1788837981.999083:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1075 00000100:00100000:1.0:1788837981.999097:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:65204:x1875729116377472:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:1.0:1788837981.999167:0:66255:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:1.0:1788837981.999273:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:65204:x1875729116377472:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 178us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837981.999282:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1075 00000100:00100000:0.0:1788837982.002544:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837982.003176:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116377600 00000100:00100000:1.0:1788837982.003190:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116377600 00000100:00100000:1.0:1788837982.003282:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1076 00000100:00100000:1.0:1788837982.003294:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:65204:x1875729116377600:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:1.0:1788837982.003344:0:66253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:1.0:1788837982.003948:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:65204:x1875729116377600:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 647us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837982.003962:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1076 00000100:00100000:3.0:1788837982.007848:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837982.008105:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116377728 00000100:00100000:1.0:1788837982.008125:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116377728 00000100:00100000:1.0:1788837982.008167:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5921 00000100:00100000:1.0:1788837982.008176:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1875729116377728:12345-192.168.203.30@tcp:8:lfs.0 00010000:00080000:1.0:1788837982.008271:0:8463:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp t0 exp 0000000000000000 cur 3376 last 0 00000020:00000080:1.0:1788837982.008304:0:8463:0:(genops.c:1385:class_connect()) connect: client fdcf066d-ff07-4b2e-96ab-52415ed6bf72, cookie 0x88da08396ccc818d 00002000:00100000:1.0:1788837982.008316:0:8463:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fdcf066d-ff07-4b2e-96ab-52415ed6bf72/ffff8ff6104d9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788837982.008334:0:8463:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788837982.008413:0:8463:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788837982.008439:0:8463:0:(import.c:65:import_set_state_nolock()) ffff8ff6104d8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788837982.008506:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116377728:12345-192.168.203.30@tcp:8:lfs.0 Request processed in 329us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837982.008514:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5921 00000100:00100000:0.0:1788837982.013200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000001:00100000:3.0:1788837982.013935:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00080000:3.0:1788837982.013946:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969449 is committed 00000100:00100000:2.0:1788837982.014636:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116377856 00000100:00100000:2.0:1788837982.014654:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116377856 00000100:00100000:2.0:1788837982.014763:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1906 00000100:00100000:2.0:1788837982.014778:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:65204:x1875729116377856:12345-192.168.203.30@tcp:13:lfs.0 00000100:00080000:1.0:1788837982.014786:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788837982.014877:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837982.014989:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:65204:x1875729116377856:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 215us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837982.014997:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1906 00000100:00100000:2.0:1788837982.019946:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837982.020089:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116377984 00000100:00100000:0.0:1788837982.020128:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116377984 00000100:00100000:0.0:1788837982.020194:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5922 00000100:00100000:0.0:1788837982.020214:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2403:x1875729116377984:12345-192.168.203.30@tcp:8:lfs.0 00010000:00080000:0.0:1788837982.020262:0:26212:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp t0 exp 0000000000000000 cur 3376 last 0 00000020:00000080:0.0:1788837982.020303:0:26212:0:(genops.c:1385:class_connect()) connect: client fdcf066d-ff07-4b2e-96ab-52415ed6bf72, cookie 0x88da08396ccc8194 00002000:00100000:0.0:1788837982.020319:0:26212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fdcf066d-ff07-4b2e-96ab-52415ed6bf72/ffff8ff50345b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788837982.020341:0:26212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788837982.023136:0:26212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788837982.023185:0:26212:0:(import.c:65:import_set_state_nolock()) ffff8ff50345e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788837982.023262:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116377984:12345-192.168.203.30@tcp:8:lfs.0 Request processed in 3056us (3332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837982.023273:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5922 00000100:00100000:2.0:1788837982.026509:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837982.026659:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116378112 00000100:00100000:0.0:1788837982.026673:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116378112 00000100:00100000:0.0:1788837982.026785:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1907 00000100:00100000:0.0:1788837982.026844:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:65204:x1875729116378112:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:0.0:1788837982.026889:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837982.026987:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:65204:x1875729116378112:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 190us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837982.026996:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1907 00000100:00080000:1.0:1788837982.027312:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788837982.028572:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00080000:3.0:1788837982.028596:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969449 is committed 00010000:00010000:0.0:1788837982.140975:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837983.165997:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837984.191379:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837985.215506:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788837985.664061:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134972672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837985.664148:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837985.664287:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134972672 00000100:00100000:2.0:1788837985.664296:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134972672 00000100:00100000:2.0:1788837985.664360:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:2.0:1788837985.664368:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134972672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788837985.664395:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837985.664440:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134972672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837985.664447:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:2.0:1788837985.664494:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134972672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788837985.664701:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788837985.664710:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134972800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837985.664744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837985.664772:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134972800 00000100:00100000:2.0:1788837985.664775:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134972800 00000100:00100000:2.0:1788837985.664825:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1788837985.664832:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134972800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837985.664850:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837985.664885:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134972800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837985.664891:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1788837985.664919:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134972800:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788837985.669899:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837985.669910:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837986.173036:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837986.173060:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134972928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837986.173183:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.173231:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134972928 00000100:00100000:3.0:1788837986.173238:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134972928 00000100:00100000:3.0:1788837986.173277:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:3.0:1788837986.173285:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134972928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788837986.173323:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788837986.173364:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134972928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.173371:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00100000:3.0:1788837986.173408:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134972928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837986.174110:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729134973184:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.174172:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134973696:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.174208:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134974208:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174229:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.174251:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788837986.174256:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134973056:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174284:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.174308:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134973568:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.174342:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134974080:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174360:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.174388:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134973184 00000100:00100000:3.0:1788837986.174392:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134973184 00000100:00100000:3.0:1788837986.174430:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134973568 00000100:00100000:3.0:1788837986.174434:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134973568 00000100:00100000:3.0:1788837986.174450:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134974080 00000100:00100000:3.0:1788837986.174453:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134974080 00000100:00100000:3.0:1788837986.174472:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1788837986.174480:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729134973184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174530:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729134973184:12345-0@lo:400:kworker.0 Request processed in 50us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.174537:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1788837986.174552:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1788837986.174559:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134973568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174600:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134973568:12345-0@lo:400:kworker.0 Request processed in 42us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.174606:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1788837986.174618:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1788837986.174624:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729134974080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174649:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729134974080:12345-0@lo:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.174654:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1788837986.174672:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134973696 00000100:00100000:3.0:1788837986.174676:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134973696 00000100:00100000:3.0:1788837986.174699:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:3.0:1788837986.174706:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134973696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174736:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134973696:12345-0@lo:400:kworker.0 Request processed in 30us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.174741:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:3.0:1788837986.174758:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134974208 00000100:00100000:3.0:1788837986.174762:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134974208 00000100:00100000:3.0:1788837986.174786:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431 00000100:00100000:3.0:1788837986.174792:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134974208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174847:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134974208:12345-0@lo:400:kworker.0 Request processed in 55us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.174860:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431 00000100:00100000:3.0:1788837986.174879:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134973056 00000100:00100000:3.0:1788837986.174883:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134973056 00000100:00100000:3.0:1788837986.174906:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788837986.174912:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729134973056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.174943:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729134973056:12345-0@lo:400:kworker.0 Request processed in 30us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.174949:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788837986.174979:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837986.174983:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837986.174985:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837986.175007:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729134973440:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.175048:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134973952:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.175101:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729134974464:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.175140:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788837986.175145:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729134973312:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.175178:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134973824:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.175211:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134974336:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837986.175260:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134973952 00000100:00100000:3.0:1788837986.175271:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134973952 00000100:00100000:3.0:1788837986.175295:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134973824 00000100:00100000:3.0:1788837986.175298:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134973824 00000100:00100000:3.0:1788837986.175314:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134974336 00000100:00100000:3.0:1788837986.175316:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134974336 00000100:00100000:3.0:1788837986.175337:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:3.0:1788837986.175343:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134973952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175376:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134973952:12345-0@lo:400:kworker.0 Request processed in 33us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.175381:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:3.0:1788837986.175392:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:3.0:1788837986.175398:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134973824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175421:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134973824:12345-0@lo:400:kworker.0 Request processed in 24us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.175425:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:3.0:1788837986.175433:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:3.0:1788837986.175438:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134974336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175456:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134974336:12345-0@lo:400:kworker.0 Request processed in 18us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.175460:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00100000:3.0:1788837986.175484:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134973440 00000100:00100000:3.0:1788837986.175487:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134973440 00000100:00100000:3.0:1788837986.175506:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134974464 00000100:00100000:3.0:1788837986.175509:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134974464 00000100:00100000:3.0:1788837986.175521:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134973312 00000100:00100000:3.0:1788837986.175523:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134973312 00000100:00100000:3.0:1788837986.175537:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1788837986.175542:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729134973440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175579:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729134973440:12345-0@lo:400:kworker.0 Request processed in 37us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.175586:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1788837986.175598:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1788837986.175603:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729134974464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175624:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729134974464:12345-0@lo:400:kworker.0 Request processed in 21us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.175629:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1788837986.175638:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1788837986.175643:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729134973312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175668:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729134973312:12345-0@lo:400:kworker.0 Request processed in 25us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.175673:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00080000:3.0:1788837986.175693:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788837986.175696:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837986.175698:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788837986.175730:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729134973312:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175741:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134973824:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175747:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:3.0:1788837986.175761:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134974336:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175770:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729134973440:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175780:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134973952:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175788:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729134974464:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175864:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134973056:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175877:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134973568:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175887:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134974080:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175897:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729134973184:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175907:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134973696:0@lo:400:kworker.0 00000100:00100000:3.0:1788837986.175917:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:3.0:1788837986.175929:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134974208:0@lo:400:kworker.0 00010000:00010000:0.0:1788837986.248430:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837986.685198:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134974592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837986.685282:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837986.685461:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134974848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788837986.685492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837986.685528:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134974720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837986.685552:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837986.685597:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134974592 00000100:00100000:1.0:1788837986.685605:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134974592 00000100:00100000:1.0:1788837986.685656:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:1.0:1788837986.685665:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134974592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837986.685698:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:2.0:1788837986.685822:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134974848 00000100:00100000:2.0:1788837986.685827:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134974848 00000100:00100000:2.0:1788837986.685854:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134974720 00000100:00100000:2.0:1788837986.685857:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134974720 00000100:00100000:2.0:1788837986.685870:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:2.0:1788837986.685876:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134974848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837986.685889:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837986.685928:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134974848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837986.685936:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:2.0:1788837986.685952:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1788837986.685958:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134974720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788837986.685968:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837986.685992:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134974720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837986.686014:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1788837986.686071:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134974848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837986.686122:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134974720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837986.693461:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134974592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7786us (8168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837986.693495:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00100000:3.0:1788837986.693684:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134974592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837986.878517:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837986.878614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837986.878656:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837986.878752:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116378496 00000100:00100000:0.0:1788837986.878761:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116378496 00000100:00100000:0.0:1788837986.878858:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1071 00000100:00100000:0.0:1788837986.878867:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116378496:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837986.878946:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116378496:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 81us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837986.878954:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1071 00000100:00100000:2.0:1788837986.879436:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116378752 00000100:00100000:2.0:1788837986.879442:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116378752 00000100:00100000:2.0:1788837986.879484:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2435 00000100:00100000:2.0:1788837986.879493:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116378752:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837986.879534:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116378752:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 43us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837986.879542:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2435 00000100:00080000:2.0:1788837986.879576:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788837986.879580:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837986.890973:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116378240 00000100:00100000:3.0:1788837986.890990:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116378240 00000100:00100000:3.0:1788837986.891047:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:3.0:1788837986.891057:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116378240:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837986.891202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837986.891236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837986.891269:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116378624 00000100:00100000:2.0:1788837986.891274:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116378624 00000100:00100000:2.0:1788837986.891312:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2436 00000100:00100000:2.0:1788837986.891319:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116378624:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837986.891381:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116378624:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 62us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837986.891389:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2436 00000100:00080000:2.0:1788837986.891408:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837986.891434:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116378368 00000100:00100000:2.0:1788837986.891438:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116378368 00000100:00100000:2.0:1788837986.891469:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1072 00000100:00100000:2.0:1788837986.891493:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116378368:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837986.891521:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116378368:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837986.891528:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1072 00000100:00080000:2.0:1788837986.891542:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837986.894161:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627e59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116378240:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3092us (15640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837986.894180:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00010000:00010000:2.0:1788837987.264231:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837988.285140:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837989.323507:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788837989.363573:0:85746:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1788837990.334202:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837990.786397:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134974976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788837990.786494:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837990.786588:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134974976 00000100:00100000:2.0:1788837990.786597:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134974976 00000100:00100000:2.0:1788837990.786664:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:2.0:1788837990.786675:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134974976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788837990.786714:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837990.786766:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134974976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837990.786773:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00080000:2.0:1788837990.786816:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788837990.786858:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134974976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788837990.792217:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134975104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837990.792337:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837990.792481:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134975104 00000100:00100000:3.0:1788837990.792493:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134975104 00000100:00100000:3.0:1788837990.792633:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1788837990.792667:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134975104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788837990.792718:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837990.792838:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134975104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837990.792852:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1788837990.792955:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134975104:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788837990.793005:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1788837991.241601:0:85794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1788837991.294935:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134975232:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.295060:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.295495:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134975744:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.297756:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.297835:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134976256:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.297890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.297912:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729134976768:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.297950:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.298627:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788837991.298638:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729134975616:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.298677:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.298706:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134976128:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.298737:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.298757:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134976640:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.298777:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.298849:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729134975360:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.298873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.298904:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134975872:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.298943:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.298965:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134976384:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.299208:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.299228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134976896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837991.299246:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.299266:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788837991.299272:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134975488:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.299291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.299310:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134976000:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.299331:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.299348:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134976512:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.299366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.299405:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134975232 00000100:00100000:3.0:1788837991.299415:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134975232 00000100:00100000:3.0:1788837991.299472:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788837991.299483:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729134975232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.300156:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610317450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729134975232:12345-0@lo:400:kworker.0 Request processed in 671us (5101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.300166:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788837991.300211:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134975744 00000100:00100000:3.0:1788837991.300216:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134975744 00000100:00100000:3.0:1788837991.300251:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134976256 00000100:00100000:3.0:1788837991.300255:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134976256 00000100:00100000:3.0:1788837991.300266:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134976768 00000100:00100000:3.0:1788837991.300269:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134976768 00000100:00100000:3.0:1788837991.300279:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134975616 00000100:00100000:3.0:1788837991.300294:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134975616 00000100:00100000:3.0:1788837991.300312:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134975360 00000100:00100000:3.0:1788837991.300315:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134975360 00000100:00100000:3.0:1788837991.300329:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134975488 00000100:00100000:3.0:1788837991.300333:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134975488 00000100:00100000:3.0:1788837991.300349:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1788837991.300356:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134975744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.300398:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134975744:12345-0@lo:400:kworker.0 Request processed in 43us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.300405:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1788837991.300419:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1788837991.300425:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729134976256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.300453:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729134976256:12345-0@lo:400:kworker.0 Request processed in 29us (2563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.300458:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1788837991.300469:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1788837991.300475:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729134976768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.300500:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729134976768:12345-0@lo:400:kworker.0 Request processed in 25us (2549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.300506:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1788837991.300516:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1788837991.300522:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729134975616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.300563:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729134975616:12345-0@lo:400:kworker.0 Request processed in 41us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.300569:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1788837991.300580:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1788837991.300585:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729134975360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837991.302853:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134975872 00000100:00100000:2.0:1788837991.302869:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134975872 00000100:00100000:2.0:1788837991.303275:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134976384 00000100:00100000:2.0:1788837991.303281:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134976384 00000100:00100000:2.0:1788837991.303302:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134976896 00000100:00100000:2.0:1788837991.303305:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134976896 00000100:00100000:2.0:1788837991.303345:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:2.0:1788837991.303356:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134975872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837991.303473:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134975872:12345-0@lo:400:kworker.0 Request processed in 119us (4540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837991.303481:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00100000:2.0:1788837991.303499:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:2.0:1788837991.303504:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729134976384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837991.303548:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729134976384:12345-0@lo:400:kworker.0 Request processed in 43us (4340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837991.303554:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00100000:2.0:1788837991.303567:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:2.0:1788837991.303573:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134976896:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837991.303733:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1788837991.303744:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134975488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.303783:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134975488:12345-0@lo:400:kworker.0 Request processed in 44us (4491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.303789:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1788837991.303829:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134976128 00000100:00100000:3.0:1788837991.303834:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134976128 00000100:00100000:3.0:1788837991.303866:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134976640 00000100:00100000:3.0:1788837991.303869:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134976640 00000100:00100000:3.0:1788837991.303891:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134976000 00000100:00100000:3.0:1788837991.303894:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134976000 00000100:00100000:3.0:1788837991.303911:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134976512 00000100:00100000:3.0:1788837991.303914:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134976512 00000100:00100000:3.0:1788837991.303947:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437 00000100:00100000:3.0:1788837991.303954:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134976128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.304735:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134976128:12345-0@lo:400:kworker.0 Request processed in 777us (5991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.304745:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437 00000100:00100000:3.0:1788837991.304767:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:3.0:1788837991.304775:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134976640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.304829:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134976640:12345-0@lo:400:kworker.0 Request processed in 56us (6050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.304834:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00100000:3.0:1788837991.304844:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:3.0:1788837991.304851:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134976000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.304879:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134976000:12345-0@lo:400:kworker.0 Request processed in 29us (5547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.304897:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:3.0:1788837991.304909:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:3.0:1788837991.304916:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134976512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.305784:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134976512:12345-0@lo:400:kworker.0 Request processed in 864us (6412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.305793:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000004:00000024:2.0:1788837991.306213:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788837991.306269:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134976896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2694us (7020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837991.306277:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00100000:2.0:1788837991.306372:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134975488:0@lo:400:kworker.0 00000100:00100000:2.0:1788837991.306384:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134976000:0@lo:400:kworker.0 00000100:00100000:2.0:1788837991.306394:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134976512:0@lo:400:kworker.0 00000100:00100000:2.0:1788837991.306403:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134975872:0@lo:400:kworker.0 00000100:00100000:2.0:1788837991.306413:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134976384:0@lo:400:kworker.0 00000100:00100000:2.0:1788837991.306426:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134976896:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788837991.307834:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788837991.307842:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788837991.307845:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788837991.307847:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837991.307898:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729134975616:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.307915:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134976128:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.307926:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134976640:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.309175:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134975232:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.309196:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134975744:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.309209:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134976256:0@lo:400:kworker.0 00000100:00100000:3.0:1788837991.309219:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729134976768:0@lo:400:kworker.0 00000100:00100000:2.0:1788837991.310126:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729134975360:12345-0@lo:400:kworker.0 Request processed in 8343us (10053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837991.310150:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1788837991.310229:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729134975360:0@lo:400:kworker.0 00010000:00010000:3.0:1788837991.359105:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788837991.805185:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788837991.806863:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837991.806889:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134977152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837991.806958:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788837991.807024:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134977152 00000100:00100000:3.0:1788837991.807032:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134977152 00000100:00100000:3.0:1788837991.807105:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1788837991.807113:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134977152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788837991.807136:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837991.807176:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134977152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837991.807183:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1788837991.807358:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134977152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788837991.808238:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134977024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837991.808287:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837991.808343:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134977280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788837991.808374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837991.808460:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134977024 00000100:00100000:0.0:1788837991.808465:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134977024 00000100:00100000:0.0:1788837991.808505:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:0.0:1788837991.808513:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134977024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837991.808541:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837991.808592:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134977024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837991.808598:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:0.0:1788837991.808637:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134977024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788837991.811127:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134977280 00000100:00100000:2.0:1788837991.811139:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134977280 00000100:00100000:2.0:1788837991.811238:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1788837991.811248:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134977280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788837991.811283:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:2.0:1788837991.811368:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134977280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (2993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837991.811452:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:3.0:1788837991.811719:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134977280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788837992.000634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837992.000689:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837992.000741:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837992.000748:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116379008 00000100:00100000:3.0:1788837992.000762:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116379008 00000100:00100000:0.0:1788837992.000773:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837992.000836:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00080000:0.0:1788837992.000880:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788837992.000882:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116379136 00000100:00100000:3.0:1788837992.000887:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116379136 00000100:00100000:0.0:1788837992.000904:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116379264 00000100:00100000:0.0:1788837992.000910:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116379264 00000100:00100000:3.0:1788837992.000940:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1079 00000100:00100000:0.0:1788837992.000945:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116379392 00000100:00100000:0.0:1788837992.000950:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116379392 00000100:00100000:3.0:1788837992.000955:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116379008:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837992.000975:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2441 00000100:00100000:0.0:1788837992.000984:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116379264:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837992.001042:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116379008:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 92us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837992.001061:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1079 00000100:00100000:3.0:1788837992.001079:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1080 00000100:00100000:3.0:1788837992.001088:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116379136:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837992.001092:0:85165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116378880 00000100:00100000:2.0:1788837992.001097:0:85165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116378880 00000100:00100000:2.0:1788837992.001133:0:85165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:2.0:1788837992.001140:0:85165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116378880:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837992.001185:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116379264:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 202us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837992.001192:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2441 00000100:00100000:0.0:1788837992.001207:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2442 00000100:00100000:0.0:1788837992.001213:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116379392:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837992.001234:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116379392:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837992.001240:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2442 00000100:00080000:0.0:1788837992.001273:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788837992.001276:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837992.001278:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788837992.008182:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116379136:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 7081us (7394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837992.008197:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1080 00000100:00100000:2.0:1788837992.009193:0:85165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610315850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116378880:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 8046us (8446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837992.009205:0:85165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00010000:00010000:2.0:1788837992.381749:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837992.986989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837992.987106:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116379520 00000100:00100000:2.0:1788837992.987116:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116379520 00000100:00100000:2.0:1788837992.987181:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1077 00000100:00100000:2.0:1788837992.987190:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:65672:x1875729116379520:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788837992.987247:0:67312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:2.0:1788837992.987336:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:65672:x1875729116379520:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 147us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837992.987344:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1077 00000100:00100000:0.0:1788837992.998749:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788837993.002625:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116379648 00000100:00100000:2.0:1788837993.002640:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116379648 00000100:00100000:2.0:1788837993.002709:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1078 00000100:00100000:2.0:1788837993.002721:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:65672:x1875729116379648:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788837993.002765:0:66253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788837993.003065:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:65672:x1875729116379648:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 344us (4327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837993.003073:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1078 00000100:00100000:1.0:1788837993.021021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837993.021123:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116379776 00000100:00100000:3.0:1788837993.021133:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116379776 00000100:00100000:3.0:1788837993.021191:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1916 00000100:00100000:3.0:1788837993.021220:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:65672:x1875729116379776:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1788837993.021256:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788837993.021338:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:65672:x1875729116379776:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837993.021345:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1916 00000100:00100000:0.0:1788837993.023575:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837993.024125:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116379904 00000100:00100000:1.0:1788837993.024136:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116379904 00000100:00100000:1.0:1788837993.024192:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1917 00000100:00100000:1.0:1788837993.024202:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:65672:x1875729116379904:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:1.0:1788837993.024234:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837993.024314:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:65672:x1875729116379904:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 106us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837993.024321:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1917 00000100:00100000:2.0:1788837993.068301:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788837993.069100:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116380160 00000100:00100000:0.0:1788837993.069119:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116380160 00000100:00100000:0.0:1788837993.069203:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1079 00000100:00100000:0.0:1788837993.069216:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:65688:x1875729116380160:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788837993.069244:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788837993.069270:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc819b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbd4 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069373:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069388:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069502:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069522:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc81a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069530:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc81a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069537:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc81a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069649:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069657:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069663:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069669:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069675:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788837993.069680:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069689:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069704:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c000) 00010000:00010000:0.0:1788837993.069714:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837993.069720:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069727:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc81a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069744:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc81a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069750:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc81a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069756:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc81a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069761:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788837993.069763:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc81a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069770:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc81a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069777:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8ff61d6b9a00) 00010000:00010000:0.0:1788837993.069779:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788837993.069782:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc81a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069787:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc81a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069899:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc819b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbd4 expref: 8 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069916:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c000) 00010000:00010000:0.0:1788837993.069918:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788837993.069922:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc819b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbd4 expref: 8 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788837993.069932:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8c00, rc 0) 00000100:00100000:0.0:1788837993.069999:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:65688:x1875729116380160:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 786us (1712us total) trans 0 rc 301/301 00000100:00100000:0.0:1788837993.070007:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1079 00000100:00100000:2.0:1788837993.073341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837993.074453:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116380288 00000100:00100000:3.0:1788837993.074472:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116380288 00000100:00100000:3.0:1788837993.074578:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1080 00000100:00100000:3.0:1788837993.074589:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:65688:x1875729116380288:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1788837993.074668:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074686:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074699:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074716:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc81b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074723:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc81b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074730:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc81b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074867:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074897:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074904:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788837993.074951:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788837993.074964:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074980:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074986:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074992:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.074999:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075005:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837993.075009:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075018:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075031:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c000) 00010000:00010000:3.0:1788837993.075034:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837993.075056:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075062:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc81b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075081:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc81b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075086:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc81b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075092:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc81b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075098:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837993.075100:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc81b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075106:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc81b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075114:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8ff61254cb00) 00010000:00010000:3.0:1788837993.075117:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837993.075119:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc81b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075125:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc81b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075141:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075157:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075164:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075169:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788837993.075172:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075178:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075186:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff8ff61254c900) 00010000:00010000:3.0:1788837993.075188:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788837993.075191:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788837993.075197:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc81be lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788837993.075284:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:65688:x1875729116380288:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 695us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837993.075293:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1080 00010000:00010000:2.0:1788837993.405176:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837994.443183:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788837995.453057:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788837995.902914:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134977408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788837995.903018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837995.903113:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134977408 00000100:00100000:0.0:1788837995.903123:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134977408 00000100:00100000:0.0:1788837995.903197:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:0.0:1788837995.903209:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134977408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788837995.903245:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837995.903295:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134977408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837995.903302:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00080000:0.0:1788837995.903326:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788837995.903369:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134977408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788837995.905047:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134977536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788837995.905143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837995.905207:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134977536 00000100:00100000:1.0:1788837995.905217:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134977536 00000100:00100000:1.0:1788837995.905276:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:1.0:1788837995.905286:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134977536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788837995.905319:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788837995.905365:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134977536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837995.905404:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00080000:1.0:1788837995.905429:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788837995.905465:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134977536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788837996.422136:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788837996.422167:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134977664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788837996.422257:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.422311:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134977664 00000100:00100000:0.0:1788837996.422323:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134977664 00000100:00100000:0.0:1788837996.422388:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1788837996.422398:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134977664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788837996.422456:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788837996.422510:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729134977664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837996.422517:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1788837996.422691:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729134977664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788837996.423433:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729134978048:0@lo:400:kworker.0 00000100:00100000:1.0:1788837996.423487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837996.423516:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134978560:0@lo:400:kworker.0 00000100:00100000:1.0:1788837996.423543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837996.423559:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134979072:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.423700:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134977792:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.423736:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.423764:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134978304:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.423785:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.423821:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134978816:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.423844:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.423862:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788837996.423868:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729134978176:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.423889:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.423906:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134978688:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.423925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.423940:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729134979200:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.423961:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.423990:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134978048 00000100:00100000:0.0:1788837996.423996:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134978048 00000100:00100000:0.0:1788837996.424058:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134978304 00000100:00100000:0.0:1788837996.424061:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134978304 00000100:00100000:0.0:1788837996.424076:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134978816 00000100:00100000:0.0:1788837996.424078:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134978816 00000100:00100000:0.0:1788837996.424088:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134978176 00000100:00100000:0.0:1788837996.424090:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134978176 00000100:00100000:0.0:1788837996.424111:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134979200 00000100:00100000:0.0:1788837996.424113:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134979200 00000100:00100000:0.0:1788837996.424126:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788837996.424134:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729134978048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424182:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729134978048:12345-0@lo:400:kworker.0 Request processed in 48us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837996.424189:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788837996.424205:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788837996.424211:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134978304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424239:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134978304:12345-0@lo:400:kworker.0 Request processed in 28us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837996.424246:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788837996.424258:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788837996.424263:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729134978816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424290:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729134978816:12345-0@lo:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837996.424296:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788837996.424306:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1788837996.424312:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729134978176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424335:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729134978176:12345-0@lo:400:kworker.0 Request processed in 23us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837996.424341:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1788837996.424343:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729134977920:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424351:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:0.0:1788837996.424356:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729134979200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837996.424375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.424378:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729134979200:12345-0@lo:400:kworker.0 Request processed in 22us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837996.424389:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1788837996.424398:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134978432:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424399:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134977920 00000100:00100000:0.0:1788837996.424402:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134977920 00000100:00100000:0.0:1788837996.424417:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1788837996.424423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.424423:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729134977920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837996.424442:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134978944:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424448:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729134977920:12345-0@lo:400:kworker.0 Request processed in 26us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837996.424454:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1788837996.424461:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.424473:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134977792 00000100:00100000:0.0:1788837996.424477:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134977792 00000100:00100000:2.0:1788837996.424497:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729134977920:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424504:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788837996.424509:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729134977792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837996.424525:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134978560 00000100:00100000:2.0:1788837996.424528:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134978560 00000100:00100000:0.0:1788837996.424539:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610317850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729134977792:12345-0@lo:400:kworker.0 Request processed in 30us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837996.424545:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788837996.424555:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134978688 00000100:00100000:2.0:1788837996.424564:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134978688 00000100:00100000:2.0:1788837996.424586:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134978944 00000100:00100000:2.0:1788837996.424589:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134978944 00000100:00100000:2.0:1788837996.424613:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:2.0:1788837996.424619:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134978560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837996.424652:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134978560:12345-0@lo:400:kworker.0 Request processed in 33us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837996.424657:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:2.0:1788837996.424668:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:2.0:1788837996.424674:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134978688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837996.424701:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134978688:12345-0@lo:400:kworker.0 Request processed in 27us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837996.424706:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:2.0:1788837996.424717:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:2.0:1788837996.424723:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134978944:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788837996.424731:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788837996.424737:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788837996.424740:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788837996.424751:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134978944:12345-0@lo:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837996.424756:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00100000:0.0:1788837996.424759:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729134978176:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424769:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134978688:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424778:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729134979200:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424786:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134977792:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424817:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134978304:0@lo:400:kworker.0 00000100:00100000:0.0:1788837996.424829:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729134978816:0@lo:400:kworker.0 00000100:00100000:1.0:1788837996.424931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837996.424971:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729134978048:0@lo:400:kworker.0 00000100:00100000:1.0:1788837996.424989:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134978560:0@lo:400:kworker.0 00000100:00100000:2.0:1788837996.425011:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134979072 00000100:00100000:2.0:1788837996.425026:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134979072 00000100:00100000:2.0:1788837996.425060:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:2.0:1788837996.425066:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134979072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837996.425102:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134979072:12345-0@lo:400:kworker.0 Request processed in 36us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837996.425107:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:2.0:1788837996.425128:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134978432 00000100:00100000:2.0:1788837996.425131:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134978432 00000100:00100000:2.0:1788837996.425162:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1788837996.425167:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134978432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788837996.425196:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134978432:12345-0@lo:400:kworker.0 Request processed in 29us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837996.425201:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1788837996.425236:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134978432:0@lo:400:kworker.0 00000100:00100000:2.0:1788837996.425246:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134978944:0@lo:400:kworker.0 00000100:00080000:2.0:1788837996.425262:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788837996.425277:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134979072:0@lo:400:kworker.0 00010000:00010000:2.0:1788837996.478252:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788837996.925193:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788837996.925227:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134979328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837996.925345:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788837996.925517:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134979328 00000100:00100000:2.0:1788837996.925528:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134979328 00000100:00100000:2.0:1788837996.925594:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:2.0:1788837996.925605:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134979328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788837996.925633:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788837996.925688:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134979328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837996.925696:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:3.0:1788837996.925822:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134979328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788837996.926070:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788837996.926081:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134979456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837996.926118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788837996.926275:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134979456 00000100:00100000:1.0:1788837996.926281:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134979456 00000100:00100000:1.0:1788837996.926323:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:1.0:1788837996.926331:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729134979456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788837996.926364:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445089280 avail 1298849792 00000100:00100000:1.0:1788837996.926415:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729134979456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788837996.926423:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:3.0:1788837996.926528:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134979456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788837996.926751:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134979584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788837996.926783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788837996.926959:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134979584 00000100:00100000:0.0:1788837996.926965:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134979584 00000100:00100000:0.0:1788837996.927042:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:0.0:1788837996.927050:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134979584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788837996.927066:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788837996.927113:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134979584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837996.927120:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:3.0:1788837996.927180:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134979584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788837997.120674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837997.120742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837997.120789:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837997.120867:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788837997.120894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788837997.121198:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116380928 00000100:00100000:3.0:1788837997.121214:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116380928 00000100:00100000:3.0:1788837997.121304:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116380800 00000100:00100000:3.0:1788837997.121307:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116380800 00000100:00100000:3.0:1788837997.121334:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2447 00000100:00100000:3.0:1788837997.121346:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116380928:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837997.121445:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116380928:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 101us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837997.121454:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2447 00000100:00100000:3.0:1788837997.121475:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2448 00000100:00100000:3.0:1788837997.121482:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116380800:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837997.121507:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116380800:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837997.121512:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2448 00000100:00100000:2.0:1788837997.121706:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116380672 00000100:00100000:2.0:1788837997.121712:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116380672 00000100:00100000:2.0:1788837997.121768:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116380544 00000100:00100000:2.0:1788837997.121773:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116380544 00000100:00100000:2.0:1788837997.121825:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1087 00000100:00100000:3.0:1788837997.121836:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1088 00000100:00100000:2.0:1788837997.121837:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116380672:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788837997.121857:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116380544:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788837997.121879:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116380672:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 46us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788837997.121898:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1087 00000100:00100000:3.0:1788837997.121908:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116380544:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 53us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788837997.121917:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1088 00000100:00080000:1.0:1788837997.122082:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788837997.122090:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788837997.122094:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788837997.122098:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788837997.126739:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116380416 00000100:00100000:0.0:1788837997.126765:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116380416 00000100:00100000:0.0:1788837997.126916:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:0.0:1788837997.126931:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116380416:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788837997.127046:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116380416:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 118us (6389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788837997.127054:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00010000:00010000:2.0:1788837997.501658:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788837998.527528:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788837999.550945:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788838000.060707:0:85989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 23:26:39 (1788837999) 00000100:00100000:3.0:1788838000.177513:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838000.177612:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116381056 00000100:00100000:2.0:1788838000.177628:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116381056 00000100:00100000:2.0:1788838000.177766:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1081 00000100:00100000:2.0:1788838000.177780:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66277:x1875729116381056:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838000.177837:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838000.177870:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc81c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbdb expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.177970:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.177988:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178020:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178037:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178044:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178050:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178109:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178125:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178133:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178140:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178147:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838000.178152:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178162:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178176:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c000) 00010000:00010000:2.0:1788838000.178179:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838000.178185:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178193:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178207:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178215:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178221:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178230:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838000.178234:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178239:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178247:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8ff504471000) 00010000:00010000:2.0:1788838000.178250:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838000.178253:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178259:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178300:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc81c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbdb expref: 8 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178311:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c000) 00010000:00010000:2.0:1788838000.178314:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838000.178317:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc81c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbdb expref: 8 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.178326:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4600, rc 0) 00000100:00100000:2.0:1788838000.178416:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66277:x1875729116381056:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 638us (917us total) trans 0 rc 301/301 00000100:00100000:2.0:1788838000.178425:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1081 00000100:00080000:3.0:1788838000.178559:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838000.212302:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838000.214329:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116381312 00000100:00100000:0.0:1788838000.218316:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116381312 00000100:00100000:0.0:1788838000.218430:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1082 00000100:00100000:0.0:1788838000.218444:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66277:x1875729116381312:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:0.0:1788838000.218522:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838000.218557:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccc8186 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbcd expref: 7 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.218578:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c000) 00010000:00010000:0.0:1788838000.218601:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838000.218687:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.218705:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.218717:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.218821:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.218831:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.218839:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221334:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221364:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221377:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838000.221399:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000700697df reply state 000000003e02f958 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221413:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221436:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff61d6b9e00) 00010000:00010000:0.0:1788838000.221439:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838000.221444:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788838000.221452:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788838000.221463:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221483:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221491:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221498:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838000.221503:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221512:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221523:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61d6b9100) 00010000:00010000:0.0:1788838000.221526:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838000.221530:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221538:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838000.221563:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000700697df reply state 000000003e02f958 transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221584:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.221591:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8ff61d6b9000) 00010000:00010000:0.0:1788838000.221594:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838000.221596:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788838000.221740:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:66277:x1875729116381312:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 3293us (9447us total) trans 103079215105 rc 0/0 00000100:00100000:0.0:1788838000.221750:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1082 00000100:00100000:0.0:1788838000.247785:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838000.247870:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116381440 00000100:00100000:2.0:1788838000.247885:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116381440 00000100:00100000:2.0:1788838000.247958:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1083 00000100:00100000:2.0:1788838000.247971:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:66278:x1875729116381440:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838000.248017:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838000.248048:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbe2 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.248144:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.248161:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.248173:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838000.248234:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838000.248238:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838000.248262:0:66255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.248290:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc81ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbe2 expref: 10 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.248310:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbe2 expref: 9 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838000.248319:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff504471000) 00010000:00010000:2.0:1788838000.248322:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838000.248333:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4200, rc 0) 00000100:00100000:2.0:1788838000.248432:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:66278:x1875729116381440:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 462us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838000.248441:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1083 00000100:00100000:1.0:1788838000.268423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838000.268868:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116381568 00000100:00100000:0.0:1788838000.268881:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116381568 00000100:00100000:0.0:1788838000.269284:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1084 00000100:00100000:0.0:1788838000.269311:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:66278:x1875729116381568:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838000.269348:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838000.269397:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbe9 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.269527:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.269556:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.269578:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.269591:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc820b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.269619:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc820b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.269626:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc820b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.269771:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc8212 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.269792:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc8212 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270134:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc8212 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838000.270218:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788838000.270223:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788838000.270273:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc8212 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270290:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270307:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270314:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270321:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270347:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838000.270352:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270372:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270396:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff504471000) 00010000:00010000:0.0:1788838000.270400:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838000.270405:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270411:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270436:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc820b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270441:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc820b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270457:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc820b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270463:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838000.270466:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc820b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270484:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc820b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270500:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8ff61d6b9000) 00010000:00010000:0.0:1788838000.270503:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838000.270517:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc820b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270522:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc820b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270562:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc81fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbe9 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270584:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc8212 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbe9 expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.270603:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff61d6b9e00) 00010000:00010000:0.0:1788838000.270606:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788838000.270608:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9600, rc 0) 00000100:00100000:0.0:1788838000.270731:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:66278:x1875729116381568:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1423us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838000.270740:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1084 00000100:00100000:2.0:1788838000.275391:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838000.275528:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116381824 00000100:00100000:0.0:1788838000.275542:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116381824 00000100:00100000:0.0:1788838000.275629:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1085 00000100:00100000:0.0:1788838000.275642:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:66278:x1875729116381824:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838000.275669:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838000.275696:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbf0 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838000.275876:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788838000.276020:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8219 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbf0 expref: 12 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.276037:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff504471000) 00010000:00010000:0.0:1788838000.276041:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838000.276047:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbf0 expref: 12 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838000.276060:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8400, rc 0) 00000100:00100000:0.0:1788838000.276168:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:66278:x1875729116381824:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 530us (788us total) trans 103079215106 rc 301/301 00000100:00100000:0.0:1788838000.276177:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1085 00000100:00100000:1.0:1788838000.284766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838000.285671:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116382080 00000100:00100000:3.0:1788838000.285695:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116382080 00000100:00100000:3.0:1788838000.286643:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1086 00000100:00100000:3.0:1788838000.286657:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:66278:x1875729116382080:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1788838000.286732:0:67312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838000.286764:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc8212 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbe9 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838000.286785:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff61d6b9e00) 00010000:00010000:3.0:1788838000.286791:0:67312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838000.286837:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838000.286852:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838000.286860:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838000.287182:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e036dcf4 reply state 00000000e57c9b50 transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838000.287209:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838000.287233:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff61d6b9e00) 00010000:00010000:3.0:1788838000.287235:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1788838000.287239:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788838000.287249:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1788838000.287370:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:66278:x1875729116382080:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 715us (2619us total) trans 103079215107 rc 0/0 00000100:00100000:3.0:1788838000.287379:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1086 00000100:00100000:1.0:1788838000.294423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838000.294784:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116382336 00000100:00100000:0.0:1788838000.295023:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116382336 00000100:00100000:0.0:1788838000.295146:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:0.0:1788838000.295159:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:66278:x1875729116382336:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1788838000.295459:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:66278:x1875729116382336:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 302us (1049us total) trans 103079215108 rc 0/0 00000100:00100000:0.0:1788838000.295468:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 218 00010000:00010000:2.0:1788838000.582128:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838001.021060:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134979712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838001.021153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838001.021555:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134979712 00000100:00100000:2.0:1788838001.021565:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134979712 00000100:00100000:2.0:1788838001.021640:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1788838001.021651:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134979712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838001.021691:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838001.022132:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838001.022145:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134979840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838001.022193:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.022226:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134979840 00000100:00100000:0.0:1788838001.022230:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134979840 00000100:00100000:0.0:1788838001.022273:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:0.0:1788838001.022279:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134979840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838001.022299:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788838001.022912:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838001.022917:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838001.023056:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134979712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1404us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838001.023066:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:3.0:1788838001.023307:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134979712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838001.024081:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134979840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1797us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.024093:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:3.0:1788838001.024304:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134979840:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1788838001.103858:0:85160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215108 is committed 00010000:00010000:3.0:1788838001.103995:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104016:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104026:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104032:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838001.104038:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104048:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104087:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8ff61d6b9000) 00010000:00010000:3.0:1788838001.104091:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838001.104097:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104103:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc81e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104136:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104142:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104147:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104152:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838001.104156:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104161:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104169:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff61d6b9e00) 00010000:00010000:3.0:1788838001.104182:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838001.104186:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104192:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc81e8 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104222:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104229:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104235:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104240:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838001.104243:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104249:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104258:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff61d6b9e00) 00010000:00010000:3.0:1788838001.104261:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838001.104264:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.104270:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc8227 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838001.208901:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838001.209023:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116382464 00000100:00100000:0.0:1788838001.209040:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116382464 00000100:00100000:0.0:1788838001.209131:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1087 00000100:00100000:0.0:1788838001.209142:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66287:x1875729116382464:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1788838001.209187:0:66254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:0.0:1788838001.209285:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66287:x1875729116382464:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 145us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.209293:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1087 00000100:00100000:2.0:1788838001.228609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838001.234149:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116382592 00000100:00100000:3.0:1788838001.234165:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116382592 00000100:00100000:3.0:1788838001.234249:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1088 00000100:00100000:3.0:1788838001.234366:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:66287:x1875729116382592:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838001.234406:0:75504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838001.234515:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:66287:x1875729116382592:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 155us (5921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838001.234523:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1088 00000100:00080000:3.0:1788838001.234546:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838001.240029:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838001.240172:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116382720 00000100:00100000:3.0:1788838001.240184:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116382720 00000100:00100000:3.0:1788838001.240272:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1924 00000100:00100000:3.0:1788838001.240283:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:66287:x1875729116382720:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1788838001.240314:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838001.240378:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:66287:x1875729116382720:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 97us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838001.240385:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1924 00000100:00080000:2.0:1788838001.240571:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838001.250080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838001.250210:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116382848 00000100:00100000:2.0:1788838001.250220:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116382848 00000100:00100000:2.0:1788838001.250296:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1925 00000100:00100000:2.0:1788838001.250306:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:66287:x1875729116382848:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838001.250332:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838001.250391:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:66287:x1875729116382848:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838001.250398:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1925 00000100:00080000:3.0:1788838001.250624:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838001.286111:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838001.287628:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116383104 00000100:00100000:3.0:1788838001.287649:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116383104 00000100:00100000:3.0:1788838001.287758:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1089 00000100:00100000:3.0:1788838001.287771:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66294:x1875729116383104:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00010000:3.0:1788838001.287876:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838001.287910:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc81f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbe2 expref: 7 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.287940:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff504471000) 00010000:00010000:3.0:1788838001.287961:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838001.288057:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288074:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288104:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288121:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288129:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288136:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288745:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288757:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288763:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288771:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288776:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838001.288781:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288790:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288831:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254cb00) 00010000:00010000:3.0:1788838001.288843:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838001.288848:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.288855:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc822e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838001.290088:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2a07471 reply state 0000000027218daa transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.290114:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.290124:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff61254ce00) 00010000:00010000:3.0:1788838001.290127:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838001.290131:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788838001.291097:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:66294:x1875729116383104:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 3319us (5046us total) trans 103079215109 rc 0/0 00000100:00100000:3.0:1788838001.291110:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1089 00000100:00100000:1.0:1788838001.318113:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838001.319298:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116383232 00000100:00100000:3.0:1788838001.319311:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116383232 00000100:00100000:3.0:1788838001.319368:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1090 00000100:00100000:3.0:1788838001.319379:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:66297:x1875729116383232:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1788838001.319401:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838001.319424:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc823c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbf7 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.319505:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc8243 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.319519:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc8243 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.319546:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc8243 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838001.319590:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838001.319594:0:66254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838001.319618:0:66254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc8243 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.319642:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc823c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbf7 expref: 10 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.319673:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc8243 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbf7 expref: 9 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.319682:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254cb00) 00010000:00010000:3.0:1788838001.319685:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838001.319689:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030c00, rc 0) 00000100:00100000:3.0:1788838001.319760:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:66297:x1875729116383232:12345-192.168.203.30@tcp:101:rm.0 Request processed in 381us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838001.319767:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1090 00000100:00100000:1.0:1788838001.323529:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838001.324166:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116383360 00000100:00100000:3.0:1788838001.324177:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116383360 00000100:00100000:3.0:1788838001.324241:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1091 00000100:00100000:3.0:1788838001.324251:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:66297:x1875729116383360:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1788838001.324272:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838001.324292:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccc824a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cbfe expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324373:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324387:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324398:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324409:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8258 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324416:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324424:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324499:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccc825f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324508:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccc825f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324514:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccc825f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838001.324557:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788838001.324561:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838001.324580:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccc825f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324602:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccc825f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324612:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324619:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324624:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324644:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.324651:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838001.326248:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326261:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326278:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254cb00) 00010000:00010000:3.0:1788838001.326281:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838001.326286:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326294:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc8251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326312:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326328:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8258 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326334:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8258 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326340:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838001.326343:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8258 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326349:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8258 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326357:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff61254ce00) 00010000:00010000:3.0:1788838001.326360:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838001.326363:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8258 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326369:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8258 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326410:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccc824a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbfe expref: 11 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326426:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccc825f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbfe expref: 10 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838001.326434:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff8ff61254c100) 00010000:00010000:3.0:1788838001.327589:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838001.327602:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030200, rc 0) 00000100:00100000:1.0:1788838001.331238:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:66297:x1875729116383360:12345-192.168.203.30@tcp:101:rm.0 Request processed in 6976us (7707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838001.331251:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1091 00000100:00100000:1.0:1788838001.336531:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838001.336729:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116383616 00000100:00100000:2.0:1788838001.336748:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116383616 00000100:00100000:2.0:1788838001.336846:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1092 00000100:00100000:2.0:1788838001.336857:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:66297:x1875729116383616:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1788838001.336920:0:67312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788838001.336954:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccc825f lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbfe expref: 10 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.336973:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff8ff61254c100) 00010000:00010000:2.0:1788838001.337001:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccc8243 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbf7 expref: 9 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337011:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254cb00) 00010000:00010000:2.0:1788838001.337017:0:67312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838001.337047:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337073:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337083:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337095:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337103:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337109:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337202:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc8274 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337210:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc8274 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337216:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc8274 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337407:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337416:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337424:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337431:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337438:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337446:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337475:0:67312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838001.337493:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc8274 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337499:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc8274 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337512:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc8274 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337518:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838001.337523:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc8274 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337532:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc8274 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337542:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff8ff504471600) 00010000:00010000:2.0:1788838001.337545:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788838001.337548:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc8274 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337554:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4200/0x88da08396ccc8274 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337575:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337582:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337587:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337593:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337597:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838001.337607:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337613:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337621:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff504471300) 00010000:00010000:2.0:1788838001.337624:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838001.337627:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337633:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5e00/0x88da08396ccc8266 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838001.337647:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000994507ae reply state 000000002757d371 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337673:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838001.337680:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff61254ce00) 00010000:00010000:2.0:1788838001.337683:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838001.337685:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838001.337763:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:66297:x1875729116383616:12345-192.168.203.30@tcp:36:rm.0 Request processed in 908us (1242us total) trans 103079215110 rc 0/0 00000100:00100000:2.0:1788838001.337770:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1092 00010000:00010000:1.0:1788838001.338200:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838001.338209:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838001.338216:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838001.338220:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838001.338227:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838001.338239:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff8ff504471600) 00010000:00010000:1.0:1788838001.338242:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788838001.338245:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838001.338264:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5800/0x88da08396ccc827b lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838001.338282:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838001.338284:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838001.338286:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838001.533107:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838001.533133:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134979968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838001.533203:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838001.534721:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134979968 00000100:00100000:2.0:1788838001.534734:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134979968 00000100:00100000:2.0:1788838001.534815:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:2.0:1788838001.534826:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134979968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838001.534872:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788838001.534956:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134979968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838001.534962:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:2.0:1788838001.535019:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134979968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838001.535280:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729134980480:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.535317:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.535341:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134980992:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.535362:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.535382:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788838001.535388:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134980096:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.535415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.535439:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729134980608:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.535719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.535743:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134981120:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.535778:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.535837:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729134980224:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.535870:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.535888:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134980736:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.535908:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.535922:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729134981248:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.535938:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.535955:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788838001.535960:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134980352:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.535979:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.536004:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729134980864:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.536023:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838001.536051:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134980480 00000100:00100000:0.0:1788838001.536055:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134980480 00000100:00100000:0.0:1788838001.536088:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134980608 00000100:00100000:0.0:1788838001.536090:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134980608 00000100:00100000:0.0:1788838001.536101:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134980224 00000100:00100000:0.0:1788838001.536103:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134980224 00000100:00100000:0.0:1788838001.536113:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134981248 00000100:00100000:0.0:1788838001.536115:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134981248 00000100:00100000:0.0:1788838001.536123:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134980352 00000100:00100000:0.0:1788838001.536125:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134980352 00000100:00100000:0.0:1788838001.536135:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134980864 00000100:00100000:0.0:1788838001.536137:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134980864 00000100:00100000:0.0:1788838001.536149:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1788838001.536155:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729134980480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.536195:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729134980480:12345-0@lo:400:kworker.0 Request processed in 40us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.536210:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1788838001.536226:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1788838001.536232:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729134980608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.536257:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729134980608:12345-0@lo:400:kworker.0 Request processed in 25us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.536262:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1788838001.536271:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1788838001.536276:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729134980224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.536300:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729134980224:12345-0@lo:400:kworker.0 Request processed in 24us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.536306:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1788838001.536316:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1788838001.536321:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729134981248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.536345:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729134981248:12345-0@lo:400:kworker.0 Request processed in 24us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.536350:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1788838001.536359:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1788838001.536364:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134980352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.536385:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134980352:12345-0@lo:400:kworker.0 Request processed in 20us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.536390:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1788838001.536399:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1788838001.536404:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729134980864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.536422:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729134980864:12345-0@lo:400:kworker.0 Request processed in 19us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.536433:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1788838001.536449:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134980992 00000100:00100000:0.0:1788838001.536452:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134980992 00000100:00100000:0.0:1788838001.537580:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134981120 00000100:00100000:0.0:1788838001.537589:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134981120 00000100:00100000:0.0:1788838001.537618:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449 00000100:00100000:0.0:1788838001.537626:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134980992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.537679:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134980992:12345-0@lo:400:kworker.0 Request processed in 54us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.537686:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449 00000100:00100000:0.0:1788838001.537701:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:0.0:1788838001.537707:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134981120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.537733:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134981120:12345-0@lo:400:kworker.0 Request processed in 27us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.537738:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:0.0:1788838001.537757:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134980096 00000100:00100000:0.0:1788838001.537761:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134980096 00000100:00100000:0.0:1788838001.537783:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788838001.537789:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729134980096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.537830:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729134980096:12345-0@lo:400:kworker.0 Request processed in 41us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.537836:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788838001.537869:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134980736 00000100:00100000:0.0:1788838001.537873:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134980736 00000100:00100000:0.0:1788838001.537893:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:0.0:1788838001.537898:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134980736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.537934:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134980736:12345-0@lo:400:kworker.0 Request processed in 36us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838001.537940:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00080000:0.0:1788838001.537968:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838001.537971:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838001.537974:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838001.537976:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838001.538029:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134980352:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.538043:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729134980864:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.538052:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729134980224:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.538061:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134980736:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.538071:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729134981248:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.538105:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134980096:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.538117:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729134980608:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.538126:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134981120:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.538135:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729134980480:0@lo:400:kworker.0 00000100:00100000:0.0:1788838001.538144:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134980992:0@lo:400:kworker.0 00010000:00010000:1.0:1788838001.597234:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838002.045700:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134981632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838002.045782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838002.046060:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134981632 00000100:00100000:1.0:1788838002.046068:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134981632 00000100:00100000:1.0:1788838002.046115:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:1.0:1788838002.046123:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134981632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838002.046145:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838002.046183:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134981632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838002.046189:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:2.0:1788838002.046574:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838002.046586:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134981504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838002.046617:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838002.046663:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134981632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838002.046693:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134981504 00000100:00100000:2.0:1788838002.046696:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134981504 00000100:00100000:2.0:1788838002.046735:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:2.0:1788838002.046741:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134981504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788838002.046752:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838002.046791:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134981504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.046820:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:2.0:1788838002.046844:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134981504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838002.047782:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134981376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838002.047845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838002.058118:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134981376 00000100:00100000:3.0:1788838002.058132:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134981376 00000100:00100000:2.0:1788838002.060435:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:2.0:1788838002.060447:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134981376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838002.060485:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:2.0:1788838002.060577:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729134981376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (12730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838002.060584:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:0.0:1788838002.062008:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134981376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838002.248316:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838002.248386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838002.248437:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838002.248489:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116383744 00000100:00100000:3.0:1788838002.248499:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116383744 00000100:00100000:3.0:1788838002.248560:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:3.0:1788838002.248571:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:2405:x1875729116383744:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838002.248642:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:2405:x1875729116383744:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.248650:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:1.0:1788838002.249200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838002.249224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838002.249245:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116384256 00000100:00100000:1.0:1788838002.249250:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116384256 00000100:00100000:1.0:1788838002.249280:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116384128 00000100:00100000:1.0:1788838002.249283:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116384128 00000100:00100000:1.0:1788838002.249302:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2451 00000100:00100000:1.0:1788838002.249309:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116384256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838002.249346:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116384256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838002.249362:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2451 00000100:00100000:1.0:1788838002.249377:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2452 00000100:00100000:1.0:1788838002.249383:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116384128:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838002.249412:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116384128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838002.249418:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2452 00000100:00100000:0.0:1788838002.249567:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116383872 00000100:00100000:0.0:1788838002.249577:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116383872 00000100:00100000:3.0:1788838002.249766:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116384000 00000100:00100000:3.0:1788838002.249771:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116384000 00000100:00100000:3.0:1788838002.249873:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1095 00000100:00100000:3.0:1788838002.249881:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2404:x1875729116383872:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838002.249921:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2404:x1875729116383872:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.249928:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1095 00000100:00100000:3.0:1788838002.249943:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1096 00000100:00100000:3.0:1788838002.249950:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116384000:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838002.250036:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116384000:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838002.250045:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1096 00000100:00080000:0.0:1788838002.250322:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788838002.623181:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838003.646049:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838004.674675:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838005.696038:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838006.141073:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134981760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838006.141179:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838006.141412:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838006.141421:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134981888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838006.141454:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838006.141502:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134981760 00000100:00100000:3.0:1788838006.141512:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134981760 00000100:00100000:3.0:1788838006.141589:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134981888 00000100:00100000:3.0:1788838006.141593:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134981888 00000100:00100000:3.0:1788838006.141614:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1788838006.141626:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134981760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838006.141673:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838006.141726:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134981760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838006.141734:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1788838006.141759:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1788838006.141766:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134981888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838006.141784:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838006.141842:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134981888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838006.141849:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00080000:3.0:1788838006.141871:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838006.141876:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838006.141928:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134981888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838006.141946:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134981760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838006.655124:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838006.655158:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134982016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838006.655261:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838006.655325:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134982016 00000100:00100000:2.0:1788838006.655335:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134982016 00000100:00100000:2.0:1788838006.655388:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:2.0:1788838006.655397:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134982016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838006.655439:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788838006.655631:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134982016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 232us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838006.655639:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:3.0:1788838006.655882:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729134982272:0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.655921:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838006.655942:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134982784:0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.655987:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838006.656002:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729134983296:0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.656023:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838006.656041:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788838006.656046:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134982400:0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.656067:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838006.656085:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729134982912:0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.656107:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838006.656146:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134982272 00000100:00100000:3.0:1788838006.656151:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134982272 00000100:00100000:3.0:1788838006.656197:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134983296 00000100:00100000:3.0:1788838006.656200:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134983296 00000100:00100000:3.0:1788838006.656216:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134982400 00000100:00100000:3.0:1788838006.656218:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134982400 00000100:00100000:3.0:1788838006.656230:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134982912 00000100:00100000:3.0:1788838006.656232:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134982912 00000100:00100000:3.0:1788838006.656244:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1788838006.656251:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729134982272:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788838006.656271:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff5071cb800 x1875729134982272/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:662/0 lens 224/224 e 0 to 0 dl 1788838017 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838006.656305:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729134982272:12345-0@lo:400:kworker.0 Request processed in 55us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838006.656312:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1788838006.656346:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1788838006.656352:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729134983296:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788838006.656363:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff5071c8000 x1875729134983296/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:662/0 lens 224/224 e 0 to 0 dl 1788838017 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838006.656390:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729134983296:12345-0@lo:400:kworker.0 Request processed in 39us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838006.656396:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1788838006.656408:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1788838006.656414:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134982400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.656440:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134982400:12345-0@lo:400:kworker.0 Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838006.656446:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1788838006.656457:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1788838006.656463:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729134982912:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788838006.656473:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640ef0a80 x1875729134982912/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:662/0 lens 224/224 e 0 to 0 dl 1788838017 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838006.656895:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729134982528:0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.656944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838006.656971:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134983040:0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.656999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838006.657025:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788838006.657030:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134982144:0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838006.657102:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729134982656:0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838006.657134:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134983168:0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657157:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838006.657190:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134982784 00000100:00100000:2.0:1788838006.657196:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134982784 00000100:00100000:2.0:1788838006.657240:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:2.0:1788838006.657248:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134982784:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838006.657278:0:8471:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff5071cb100 x1875729134982784/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:662/0 lens 224/224 e 0 to 0 dl 1788838017 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838006.657313:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729134982784:12345-0@lo:400:kworker.0 Request processed in 66us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838006.657320:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00100000:2.0:1788838006.657344:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134982528 00000100:00100000:2.0:1788838006.657348:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134982528 00000100:00100000:2.0:1788838006.657370:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1788838006.657376:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729134982528:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838006.657388:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61fc2a680 x1875729134982528/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:662/0 lens 224/224 e 0 to 0 dl 1788838017 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838006.657423:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729134982528:12345-0@lo:400:kworker.0 Request processed in 46us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838006.657429:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1788838006.657442:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134982656 00000100:00100000:2.0:1788838006.657446:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134982656 00000100:00100000:2.0:1788838006.657464:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1788838006.657470:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729134982656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657502:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729134982656:12345-0@lo:400:kworker.0 Request processed in 32us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838006.657508:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1788838006.657527:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134983040 00000100:00100000:2.0:1788838006.657530:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134983040 00000100:00100000:2.0:1788838006.657558:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134983168 00000100:00100000:2.0:1788838006.657561:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134983168 00000100:00100000:2.0:1788838006.657582:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453 00000100:00100000:2.0:1788838006.657588:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134983040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657628:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134983040:12345-0@lo:400:kworker.0 Request processed in 40us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838006.657634:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453 00000100:00100000:2.0:1788838006.657646:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454 00000100:00100000:2.0:1788838006.657652:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134983168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657678:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729134983168:12345-0@lo:400:kworker.0 Request processed in 27us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838006.657683:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454 00000100:00100000:2.0:1788838006.657700:0:85167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134982144 00000100:00100000:2.0:1788838006.657703:0:85167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134982144 00000100:00100000:2.0:1788838006.657731:0:85167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788838006.657738:0:85167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729134982144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657784:0:85167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729134982144:12345-0@lo:400:kworker.0 Request processed in 46us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838006.657790:0:85167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788838006.657877:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134982144:0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657894:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729134982656:0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657904:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134983168:0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657913:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729134982528:0@lo:400:kworker.0 00000100:00100000:2.0:1788838006.657921:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729134983040:0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.658168:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729134982912:12345-0@lo:400:kworker.0 Request processed in 1705us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838006.658175:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00080000:3.0:1788838006.658205:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838006.658209:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838006.658212:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838006.658214:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838006.658247:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134982400:0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.658258:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729134982912:0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.658283:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729134982272:0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.658294:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134982784:0@lo:400:kworker.0 00000100:00100000:3.0:1788838006.658305:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729134983296:0@lo:400:kworker.0 00000100:00100000:1.0:1788838006.660304:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134982016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788838006.724853:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838007.165329:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838007.165355:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134983552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838007.165442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838007.165497:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134983552 00000100:00100000:1.0:1788838007.165504:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134983552 00000100:00100000:1.0:1788838007.165553:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:1.0:1788838007.165562:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134983552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838007.165587:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838007.165632:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729134983552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838007.165639:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:1.0:1788838007.165685:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134983552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838007.165876:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838007.165887:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134983424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838007.165923:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838007.165989:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134983424 00000100:00100000:0.0:1788838007.165993:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134983424 00000100:00100000:0.0:1788838007.166018:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:0.0:1788838007.166025:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134983424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788838007.166037:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838007.166076:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729134983424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838007.166082:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:0.0:1788838007.166391:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134983424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838007.166685:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838007.166700:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134983680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838007.166749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838007.167501:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134983680 00000100:00100000:1.0:1788838007.167510:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134983680 00000100:00100000:1.0:1788838007.167595:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:1.0:1788838007.167605:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134983680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838007.167651:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00010000:00000080:1.0:1788838007.167668:0:8472:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff5071c8a80 x1875729134983680/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:663/0 lens 224/368 e 0 to 0 dl 1788838018 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838007.167733:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729134983680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838007.167740:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:3.0:1788838007.167851:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134983680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838007.360259:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838007.360296:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838007.360318:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838007.360329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838007.360345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838007.360365:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116384768 00000100:00100000:2.0:1788838007.360372:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116384768 00000100:00100000:2.0:1788838007.360418:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116384896 00000100:00100000:2.0:1788838007.360420:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116384896 00000100:00100000:2.0:1788838007.360435:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2455 00000100:00100000:2.0:1788838007.360443:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116384768:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838007.360510:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116384768:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 67us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838007.360516:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2455 00000100:00100000:2.0:1788838007.360533:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2456 00000100:00100000:2.0:1788838007.360539:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116384896:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838007.360562:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116384896:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838007.360567:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2456 00000100:00100000:3.0:1788838007.364369:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116384512 00000100:00100000:3.0:1788838007.364388:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116384512 00000100:00100000:3.0:1788838007.364466:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116384640 00000100:00100000:3.0:1788838007.364469:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116384640 00000100:00100000:3.0:1788838007.364508:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1103 00000100:00100000:3.0:1788838007.364519:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2405:x1875729116384512:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000080:3.0:1788838007.364553:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff5071c8700 x1875729116384512/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:663/0 lens 224/224 e 0 to 0 dl 1788838018 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838007.364623:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2405:x1875729116384512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 105us (4372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838007.364631:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1103 00000100:00100000:3.0:1788838007.364651:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1104 00000100:00100000:3.0:1788838007.364657:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116384640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838007.364687:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116384640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (4355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838007.364693:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1104 00000100:00100000:3.0:1788838007.364715:0:85170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116384384 00000100:00100000:3.0:1788838007.364719:0:85170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116384384 00000100:00100000:3.0:1788838007.364746:0:85170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:3.0:1788838007.364753:0:85170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:2405:x1875729116384384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838007.364792:0:85170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+10:2405:x1875729116384384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (4471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838007.364831:0:85170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00080000:3.0:1788838007.364863:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838007.364867:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838007.364869:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838007.364872:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788838007.742423:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788838007.915022:0:85160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:2.0:1788838007.915086:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915102:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915110:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915123:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838007.915129:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915137:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915154:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff61254ce00) 00010000:00010000:2.0:1788838007.915157:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838007.915162:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915169:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc8235 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915189:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915194:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915200:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915204:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838007.915206:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915213:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915229:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff61254ce00) 00010000:00010000:2.0:1788838007.915231:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838007.915234:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838007.915240:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc826d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838008.768607:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788838009.166053:0:86387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1788838009.287137:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838009.289732:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116385024 00000100:00100000:3.0:1788838009.289747:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116385024 00000100:00080000:0.0:1788838009.289908:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838009.290017:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1093 00000100:00100000:3.0:1788838009.290028:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:66364:x1875729116385024:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:3.0:1788838009.290047:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838009.290069:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc05 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.290553:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccc8289 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.290569:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccc8289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.290583:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccc8289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838009.290630:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838009.290634:0:66254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838009.291203:0:66254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccc8289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.291244:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc8282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc05 expref: 8 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.291285:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccc8289 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc05 expref: 7 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.291294:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:3.0:1788838009.291297:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838009.291301:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030800, rc 0) 00010000:00000080:3.0:1788838009.291320:0:66254:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff5071c9f80 x1875729116385024/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:665/0 lens 576/688 e 0 to 0 dl 1788838020 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838009.291525:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66364:x1875729116385024:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1499us (4406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838009.291534:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1093 00000100:00100000:3.0:1788838009.295854:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838009.296336:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116385152 00000100:00100000:2.0:1788838009.296351:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116385152 00000100:00100000:2.0:1788838009.296431:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1094 00000100:00100000:2.0:1788838009.296443:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66364:x1875729116385152:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838009.296477:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838009.296506:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e400/0x88da08396ccc8290 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc0c expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.296766:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.296785:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.296825:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.296847:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc829e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.296876:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc829e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.296884:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc829e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.297008:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f200/0x88da08396ccc82a5 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.297017:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f200/0x88da08396ccc82a5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.297024:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f200/0x88da08396ccc82a5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838009.297072:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788838009.297077:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838009.297107:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f200/0x88da08396ccc82a5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.297123:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.297131:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.297137:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.297144:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.297162:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5ec00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838009.297167:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.297178:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.297195:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:2.0:1788838009.297198:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838009.299426:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.299452:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ec00/0x88da08396ccc8297 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.299480:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc829e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.299488:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc829e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.299497:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc829e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.299503:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5e000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838009.299507:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc829e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.299516:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc829e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.299552:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8ff504471f00) 00010000:00010000:2.0:1788838009.299555:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838009.299560:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc829e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.299567:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc829e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.300499:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e400/0x88da08396ccc8290 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc0c expref: 9 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.300528:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f200/0x88da08396ccc82a5 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc0c expref: 8 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.300537:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff504471500) 00010000:00010000:2.0:1788838009.300540:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788838009.300543:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5f200, rc 0) 00010000:00000080:2.0:1788838009.300557:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640ef1500 x1875729116385152/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:665/0 lens 592/688 e 0 to 0 dl 1788838020 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838009.301754:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:66364:x1875729116385152:12345-192.168.203.30@tcp:101:touch.0 Request processed in 5302us (5904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838009.301769:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1094 00000100:00100000:2.0:1788838009.314465:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838009.318972:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116385408 00000100:00100000:3.0:1788838009.318994:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116385408 00000100:00100000:3.0:1788838009.319081:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1095 00000100:00100000:3.0:1788838009.319106:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:66364:x1875729116385408:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:3.0:1788838009.319138:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838009.319167:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82ac lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc13 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.319334:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.319353:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.319380:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.319399:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.322233:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.322277:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.325255:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.325286:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.325300:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838009.326526:0:66253:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1788838009.326535:0:66253:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 0 -> 1788838010 00000004:00010000:3.0:1788838009.326538:0:66253:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 0 -> 1788838010 00000004:00010000:3.0:1788838009.326540:0:66253:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 0 -> 1788838010 00000004:00010000:3.0:1788838009.326542:0:66253:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:3.0:1788838009.326664:0:66253:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:3.0:1788838009.326675:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.326687:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.326701:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.326708:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.326715:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838009.326721:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.326729:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 5/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.326748:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff504471500) 00010000:00010000:3.0:1788838009.326752:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838009.326758:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 3/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.326765:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccc82b3 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838009.326785:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005de80359 reply state 000000008913f741 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.327899:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.327917:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8ff61254c700) 00010000:00010000:3.0:1788838009.327919:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838009.327924:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788838009.328005:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82ac lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.328041:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.328049:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:3.0:1788838009.328051:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1788838009.328054:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600031600, rc 0) 00010000:00000080:3.0:1788838009.328063:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff5071c8e00 x1875729116385408/t103079215111(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:665/0 lens 752/824 e 0 to 0 dl 1788838020 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838009.328167:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:66364:x1875729116385408:12345-192.168.203.30@tcp:101:touch.0 Request processed in 9065us (13716us total) trans 103079215111 rc 0/0 00000100:00100000:3.0:1788838009.328177:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1095 00000100:00100000:0.0:1788838009.344992:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838009.345724:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116385664 00000100:00100000:3.0:1788838009.345745:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116385664 00000100:00100000:3.0:1788838009.347389:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1096 00000100:00100000:3.0:1788838009.347417:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:66364:x1875729116385664:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:3.0:1788838009.347578:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.347699:0:76060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.347711:0:76060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.347761:0:76060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838009.347793:0:76060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 11 pid: 66253 timeout: 3503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838009.347836:0:76060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:76060:1875729134983808:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788838009.347966:0:76060:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838009.352858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838009.352999:0:76060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:76060:1875729134983808:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788838009.353035:0:76060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838009.353180:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116385792 00000100:00100000:2.0:1788838009.353189:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116385792 00010000:00010000:2.0:1788838009.353246:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 12 pid: 66253 timeout: 3503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838009.353315:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2538 00000100:00100000:2.0:1788838009.353327:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2405:x1875729116385792:12345-192.168.203.30@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1788838009.353350:0:7497:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 12 pid: 66253 timeout: 3503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.353364:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 12 pid: 66253 timeout: 3503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.353378:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 12 pid: 66253 timeout: 3503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.353389:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:2.0:1788838009.353392:0:7497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1788838009.353396:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.353407:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.353414:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838009.353452:0:7497:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 12 pid: 66253 timeout: 3503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838009.353514:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2405:x1875729116385792:12345-192.168.203.30@tcp:102:ldlm_bl.0 Request processed in 190us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838009.353532:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2538 00010000:00010000:0.0:1788838009.353843:0:76060:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838009.353852:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838009.354035:0:76060:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1788838009.354046:0:76060:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 1788838010 -> 1788838010 00000004:00010000:0.0:1788838009.354049:0:76060:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 1788838010 -> 1788838010 00000004:00010000:0.0:1788838009.354052:0:76060:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 1788838010 -> 1788838010 00000004:00010000:0.0:1788838009.354054:0:76060:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1788838009.354066:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008723d156 reply state 00000000de8fdbc7 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838009.354083:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838009.354091:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:0.0:1788838009.354094:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838009.354098:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788838009.354173:0:76060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff632e67b80 x1875729116385664/t103079215112(0) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:665/0 lens 488/456 e 0 to 0 dl 1788838020 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838009.354236:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:66364:x1875729116385664:12345-192.168.203.30@tcp:36:touch.0 Request processed in 6832us (9261us total) trans 103079215112 rc 0/0 00000100:00100000:0.0:1788838009.354245:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1096 00000100:00100000:3.0:1788838009.356727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838009.364331:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116386048 00000100:00100000:0.0:1788838009.364356:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116386048 00000100:00100000:0.0:1788838009.364500:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:0.0:1788838009.364517:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:66364:x1875729116386048:12345-192.168.203.30@tcp:35:touch.0 00010000:00000080:0.0:1788838009.366943:0:85392:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640ef2680 x1875729116386048/t103079215113(0) o35->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:665/0 lens 392/456 e 0 to 0 dl 1788838020 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838009.367057:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+14:66364:x1875729116386048:12345-192.168.203.30@tcp:35:touch.0 Request processed in 2544us (10343us total) trans 103079215113 rc 0/0 00000100:00100000:0.0:1788838009.367068:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 219 00010000:00010000:1.0:1788838009.791917:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838010.816118:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838011.265239:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134983936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838011.265367:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838011.265542:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134983936 00000100:00100000:2.0:1788838011.265555:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134983936 00000100:00100000:2.0:1788838011.267172:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1788838011.267194:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134983936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838011.267246:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838011.267359:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134983936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838011.267368:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:0.0:1788838011.268513:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134984064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838011.268582:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838011.269034:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134983936:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788838011.270947:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838011.270996:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134984064 00000100:00100000:1.0:1788838011.271011:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134984064 00000100:00080000:2.0:1788838011.271317:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838011.272086:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:1.0:1788838011.272104:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134984064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838011.272150:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838011.273201:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134984064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (3677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838011.273221:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:0.0:1788838011.273562:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134984064:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1788838011.719414:0:86484:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788838011.719499:0:86484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.719517:0:86484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.719525:0:86484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.719550:0:86484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.719577:0:86484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788838011.719584:0:86484:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788838011.719622:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788838011.719628:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788838011.719635:0:86484:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788838011.719671:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff640eec000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788838011.719769:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838011.719782:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838011.719848:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4c00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788838011.719854:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838011.719864:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838011.719871:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838011.719878:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788838011.719880:0:63563:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788838011.719883:0:63563:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788838011.719924:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838011.719931:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838011.719952:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838011.719970:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc7e53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7e5a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838011.719983:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838011.719985:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838011.719987:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838011.719995:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838011.720020:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134984320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838011.720108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838011.720178:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134984320 00000100:00100000:0.0:1788838011.720186:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134984320 00000100:00100000:0.0:1788838011.720244:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1788838011.720254:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729134984320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838011.720269:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838011.720289:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059f4400/0x88da08396ccc7e5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7e53 expref: 24 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838011.720303:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838011.720340:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3646:x1875729134984320:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838011.720349:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1788838011.720408:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134984320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838011.720780:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729134984192:0@lo:39:umount.0 00000100:00100000:2.0:1788838011.720855:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838011.721077:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134984192 00000100:00100000:0.0:1788838011.721084:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134984192 00000100:00100000:0.0:1788838011.721132:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1788838011.721140:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729134984192:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788838011.721185:0:66255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7f6b 00000100:00080000:0.0:1788838011.721213:0:66255:0:(import.c:65:import_set_state_nolock()) ffff8ff6049ba800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1788838011.721278:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff5071ca680 x1875729134984192/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:667/0 lens 224/224 e 0 to 0 dl 1788838022 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838011.721331:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1875729134984192:12345-0@lo:39:umount.0 Request processed in 192us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838011.721339:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000020:00000080:0.0:1788838011.721349:0:66255:0:(genops.c:885:class_export_put()) final put ffff8ff6049b8800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788838011.721371:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6049b8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788838011.721448:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6049ba800 for lustre-MDT0000 00000100:00080000:0.0:1788838011.721570:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff640eec000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788838011.721582:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729134984192:0@lo:39:umount.0 00010000:00010000:1.0:1788838011.721709:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788838011.721733:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788838011.721740:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788838011.721748:0:86484:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788838011.722840:0:86484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722861:0:86484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722869:0:86484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722877:0:86484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722901:0:86484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838011.722907:0:86484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722944:0:86484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722950:0:86484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722957:0:86484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722970:0:86484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788838011.722976:0:86484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722983:0:86484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722990:0:86484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.722997:0:86484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723008:0:86484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788838011.723013:0:86484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723019:0:86484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723036:0:86484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723043:0:86484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723061:0:86484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788838011.723065:0:86484:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788838011.723109:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788838011.723117:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723125:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838011.723129:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723139:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838011.723147:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838011.723152:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838011.723155:0:6535:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788838011.723158:0:6535:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1788838011.723203:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723211:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838011.723242:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723250:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc7d6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7d7a expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723268:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838011.723272:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723278:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4800 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838011.723281:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723288:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838011.723295:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838011.723300:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838011.723302:0:6535:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788838011.723304:0:6535:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788838011.723319:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723325:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838011.723336:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723342:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4800/0x88da08396ccc7e92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7e99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723362:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838011.723365:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723371:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5200 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838011.723374:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723381:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838011.723388:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838011.723393:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788838011.723395:0:6535:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788838011.723397:0:6535:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788838011.723412:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723417:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838011.723423:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723429:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5200/0x88da08396ccc7e45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7e4c expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723439:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838011.723441:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723453:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838011.723456:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723463:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838011.723469:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838011.723474:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838011.723476:0:6535:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788838011.723478:0:6535:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788838011.723490:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723497:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838011.723503:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723510:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc7d5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc7d65 expref: -99 pid: 85159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723519:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838011.723521:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838011.723523:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838011.723550:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134984832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838011.723639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838011.723703:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838011.723720:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134984448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838011.723745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838011.723786:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134984832 00000100:00100000:1.0:1788838011.723793:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134984832 00000100:00100000:1.0:1788838011.723869:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134984448 00000100:00100000:1.0:1788838011.723872:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134984448 00000100:00100000:1.0:1788838011.723909:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1788838011.723929:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729134984832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838011.723944:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838011.723962:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4800/0x88da08396ccc7d65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7d5e expref: 24 pid: 85166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.723977:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838011.724015:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3645:x1875729134984832:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838011.724023:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1788838011.724042:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1788838011.724048:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3645:x1875729134984448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838011.724055:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838011.724064:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8000/0x88da08396ccc7d7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7d6c expref: 22 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838011.724072:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838011.724092:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3645:x1875729134984448:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838011.724098:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1788838011.724138:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134984448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838011.724147:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729134984832:0@lo:103:ldlm_bl.0 00000020:01000004:1.0:1788838011.724197:0:86484:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788838011.724202:0:86484:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1788838011.724209:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788838011.724216:0:86484:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1788838011.727775:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838011.727814:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838011.727847:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134984576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838011.727967:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838011.728045:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838011.728053:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134984704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838011.728080:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838011.728128:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134984576 00000100:00100000:0.0:1788838011.728138:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134984576 00000100:00100000:0.0:1788838011.728209:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134984704 00000100:00100000:0.0:1788838011.728212:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134984704 00000100:00100000:0.0:1788838011.728243:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1788838011.728253:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624eacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3643:x1875729134984576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838011.728272:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838011.728313:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc7e99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7e92 expref: 22 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838011.728335:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838011.728377:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624eacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3643:x1875729134984576:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838011.728386:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1788838011.728447:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1788838011.728454:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3643:x1875729134984704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838011.728461:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838011.728485:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5400/0x88da08396ccc7e4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7e45 expref: 20 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838011.728496:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838011.728520:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:3643:x1875729134984704:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838011.728526:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00010000:00010000:0.0:1788838011.728549:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838011.728590:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134984704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838011.728599:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729134984576:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1788838011.737181:0:86484:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1788838011.739926:0:85160:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:3.0:1788838011.740033:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740048:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740057:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740063:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838011.740068:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740076:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740100:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8ff61254c700) 00010000:00010000:3.0:1788838011.740104:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838011.740109:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740130:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccc82ba lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740164:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740170:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740176:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740181:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838011.740184:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740189:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740198:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:3.0:1788838011.740201:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838011.740203:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838011.740208:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc82cf lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788838011.740374:0:86484:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1788838011.740385:0:86484:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff604960800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838011.740631:0:86484:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff604966800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838011.740636:0:86484:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff604962800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838011.740640:0:86484:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff627d19000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838011.740647:0:86484:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff627d1f000 fdcf066d-ff07-4b2e-96ab-52415ed6bf72 192.168.203.30@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 103079215113 stale:0 00000020:00080000:0.0:1788838011.740663:0:86484:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8ff503ca19b8) has exports, disconnecting them 00000020:00080000:0.0:1788838011.740670:0:86484:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff604960800), last request at 1788837975 00000020:00000080:0.0:1788838011.740679:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7f64 00000100:00080000:0.0:1788838011.740689:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff604963800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838011.741212:0:86484:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff604960800): rc 0 00000020:00000080:0.0:1788838011.741216:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff604960800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788838011.741243:0:86484:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff604966800), last request at 1788838006 00000020:00000080:0.0:1788838011.741248:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7f5d 00000100:00080000:0.0:1788838011.741254:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff604967000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788838011.741300:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604960800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788838011.741379:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff604963800 for lustre-MDT0000 00010000:00010000:1.0:1788838011.741525:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788838011.741588:0:86484:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff604966800): rc 0 00000020:00000080:0.0:1788838011.741591:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff604966800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788838011.741603:0:86484:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff604962800), last request at 1788838006 00000020:00000080:0.0:1788838011.741607:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7f56 00000100:00080000:0.0:1788838011.741614:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff604963000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788838011.741641:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604966800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788838011.741685:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff604967000 for lustre-MDT0000 00010000:00010000:1.0:1788838011.741752:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788838011.742126:0:86484:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff604962800): rc 0 00000020:00000080:0.0:1788838011.742129:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff604962800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788838011.742175:0:86484:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff627d19000), last request at 1788837970 00000020:00000080:0.0:1788838011.742184:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7dc7 00000100:00080000:0.0:1788838011.742197:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff5036b5000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788838011.742221:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788838011.742256:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604962800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788838011.742306:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff604963000 for lustre-MDT0000 00000020:00080000:0.0:1788838011.742607:0:86484:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff627d19000): rc 0 00000020:00000080:0.0:1788838011.742610:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff627d19000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1788838011.742657:0:86484:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.30@tcp (ffff8ff627d1f000), last request at 1788838009 00000020:00000080:0.0:1788838011.742661:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7dc0 00000020:00010000:0.0:1788838011.742669:0:86484:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff627d1f000: total 1 00000100:00080000:0.0:1788838011.742673:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff61d4bc800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788838011.742696:0:63563:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff627d1f000: total 1 00010000:00010000:2.0:1788838011.742774:0:63563:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff627d1f000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1788838011.742846:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f200/0x88da08396ccc82a5 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc0c expref: 7 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838011.742879:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccc8289 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc05 expref: 6 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838011.742903:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc82c1 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 5 pid: 66253 timeout: 3503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838011.742947:0:63563:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff627d1f000, canceled 3 locks, left on hash table 0. 00000020:00000080:3.0:1788838011.743988:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d19000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00080000:0.0:1788838011.751589:0:86484:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff627d1f000): rc 0 00000004:00000080:0.0:1788838011.751604:0:86484:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f5181d87ae0 00000100:00080000:0.0:1788838011.751634:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788838011.751654:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788838011.752547:0:86484:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788838011.752583:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff608213000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788838011.752642:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134984960:0@lo:39:umount.0 00000100:00100000:0.0:1788838011.752727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838011.752857:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788838011.754113:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5036b5000 for lustre-MDT0000 00000100:00080000:1.0:1788838011.755308:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788838011.755317:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:1.0:1788838011.755341:0:86484:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788838011.755418:0:86484:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788838011.755458:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff6048e0000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788838011.755484:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788838011.755487:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:1.0:1788838011.755498:0:86484:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788838011.755559:0:86484:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788838011.755568:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff640eeb800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788838011.757196:0:86484:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff503ca19b8) has no exports 00000100:00100000:3.0:1788838011.757395:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134985088:0@lo:9:umount.0 00000100:00100000:3.0:1788838011.757541:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838011.757597:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134985216:0@lo:9:umount.0 00000100:00100000:3.0:1788838011.757640:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838011.759719:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134984960 00000100:00100000:3.0:1788838011.759739:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134984960 00000100:00100000:3.0:1788838011.759844:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:3.0:1788838011.759855:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729134984960:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788838011.759899:0:8471:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7df8 00000100:00080000:3.0:1788838011.759910:0:8471:0:(import.c:65:import_set_state_nolock()) ffff8ff6057c3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788838011.759945:0:8471:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411434 00000100:00100000:3.0:1788838011.760182:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3642:x1875729134984960:12345-0@lo:39:umount.0 Request processed in 327us (7454us total) trans 77309411435 rc 0/0 00000100:00100000:3.0:1788838011.760189:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00080000:3.0:1788838011.760257:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff608213000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788838011.760265:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134984960:0@lo:39:umount.0 00010000:00010000:1.0:1788838011.760926:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838011.761040:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134985088 00000100:00100000:1.0:1788838011.761050:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134985088 00000100:00100000:1.0:1788838011.761125:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134985216 00000100:00100000:1.0:1788838011.761129:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134985216 00000100:00100000:1.0:1788838011.761157:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5923 00000100:00100000:1.0:1788838011.761166:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729134985088:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788838011.761197:0:26218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7e22 00000100:00080000:1.0:1788838011.761206:0:26218:0:(import.c:65:import_set_state_nolock()) ffff8ff62ceab000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788838011.761265:0:26218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:1.0:1788838011.761446:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729134985088:12345-0@lo:9:umount.0 Request processed in 279us (3906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838011.761470:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5923 00000100:00100000:1.0:1788838011.761506:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:1.0:1788838011.761513:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729134985216:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788838011.761527:0:26218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7e30 00000100:00080000:1.0:1788838011.761533:0:26218:0:(import.c:65:import_set_state_nolock()) ffff8ff6057c0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788838011.761563:0:26218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:1.0:1788838011.761656:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729134985216:12345-0@lo:9:umount.0 Request processed in 144us (4016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838011.761663:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00000100:00080000:1.0:1788838011.761712:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6048e0000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788838011.761728:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788838011.761730:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788838011.761734:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134985088:0@lo:9:umount.0 00000100:00080000:1.0:1788838011.761750:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff640eeb800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788838011.761760:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788838011.761762:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788838011.761765:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134985216:0@lo:9:umount.0 00000100:00080000:3.0:1788838011.762138:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838011.762148:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788838011.764747:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838011.767979:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788838011.779247:0:86484:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff503ca19b8) has no exports 00000100:00100000:3.0:1788838011.785910:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729134985344:0@lo:400:kworker.0 00000100:00100000:3.0:1788838011.786036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838011.786085:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134985856:0@lo:400:kworker.0 00000100:00100000:3.0:1788838011.786124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838011.786172:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838011.786178:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134985728:0@lo:400:kworker.0 00000100:00100000:3.0:1788838011.786199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838011.786244:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134985472:0@lo:400:kworker.0 00000100:00100000:3.0:1788838011.786286:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838011.786309:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729134985984:0@lo:400:kworker.0 00000100:00100000:3.0:1788838011.786346:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838011.786368:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838011.786373:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729134985600:0@lo:400:kworker.0 00000100:00100000:3.0:1788838011.786410:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838011.786463:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134985344 00000100:00100000:3.0:1788838011.786473:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134985344 00000100:00100000:3.0:1788838011.786515:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134985728 00000100:00100000:3.0:1788838011.786517:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134985728 00000100:00100000:3.0:1788838011.786548:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134985472 00000100:00100000:3.0:1788838011.786550:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134985472 00000100:00100000:3.0:1788838011.786563:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134985984 00000100:00100000:3.0:1788838011.786565:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134985984 00000100:00100000:3.0:1788838011.786572:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134985600 00000100:00100000:3.0:1788838011.786574:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134985600 00000100:00100000:3.0:1788838011.786588:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1788838011.786597:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134985728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838011.786654:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134985728:12345-0@lo:400:kworker.0 Request processed in 57us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838011.786662:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1788838011.786680:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1788838011.786685:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134985472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838011.786711:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134985472:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838011.786724:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1788838011.786736:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1788838011.786739:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875729134985344:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838011.786745:0:66253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838011.786769:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875729134985344:12345-0@lo:400:kworker.0 Request processed in 28us (734us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838011.786775:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1788838011.786785:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1788838011.786788:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875729134985984:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838011.786792:0:66253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838011.786825:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875729134985984:12345-0@lo:400:kworker.0 Request processed in 35us (478us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838011.786831:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1788838011.786845:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1788838011.786849:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875729134985600:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838011.786853:0:66253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838011.786869:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875729134985600:12345-0@lo:400:kworker.0 Request processed in 19us (459us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838011.786874:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00080000:3.0:1788838011.786909:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838011.786953:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838011.786963:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838011.786967:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788838011.796685:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134985856 00000100:00100000:1.0:1788838011.796715:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134985856 00000100:00100000:1.0:1788838011.796831:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:1.0:1788838011.796845:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1875729134985856:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788838011.796861:0:23765:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788838011.797002:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1875729134985856:12345-0@lo:400:kworker.0 Request processed in 161us (10875us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788838011.797010:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00100000:1.0:1788838011.798976:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134985728:0@lo:400:kworker.0 00000100:00080000:1.0:1788838011.799025:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788838011.799032:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788838011.799036:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788838011.799043:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838011.799048:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3369 00000100:00080000:1.0:1788838011.799063:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838011.799115:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61fc28380 x1875729134986112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838011.799154:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729134985344:0@lo:400:kworker.0 00000100:00080000:1.0:1788838011.799174:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788838011.799177:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788838011.799180:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788838011.799189:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838011.799193:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3369 00000100:00080000:1.0:1788838011.799197:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838011.799215:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61fc2a300 x1875729134986240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838011.799226:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134985856:0@lo:400:kworker.0 00000100:00100000:1.0:1788838011.799286:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134986112:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788838011.799369:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838011.799411:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134986240:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788838011.799449:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838011.805938:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134986240 00000100:00100000:1.0:1788838011.805963:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134986240 00000100:00100000:1.0:1788838011.806066:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:1.0:1788838011.806082:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134986240:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788838011.806123:0:8471:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788838011.808268:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838011.808284:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3369 00000100:00080000:3.0:1788838011.808317:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838011.808898:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff503648700 x1875729134986368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838011.809034:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729134985600:0@lo:400:kworker.0 00000100:00100000:3.0:1788838011.809060:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134986368:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788838011.809167:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838011.809284:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134985472:0@lo:400:kworker.0 00000100:00080000:3.0:1788838011.809298:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838011.809304:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838011.809308:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788838011.809312:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838011.809315:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3369 00000100:00080000:3.0:1788838011.809321:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838011.809337:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639c5f480 x1875729134986496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838011.809351:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729134985984:0@lo:400:kworker.0 00000020:00000080:2.0:1788838011.810417:0:63563:0:(genops.c:885:class_export_put()) final put ffff8ff627d1f000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:2.0:1788838011.810468:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d1f000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-MDT0000 00000020:00000080:2.0:1788838011.810699:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff61d4bc800 for lustre-MDT0000 00000100:00100000:2.0:1788838011.810742:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134986112 00000100:00100000:2.0:1788838011.810759:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134986112 00000100:00100000:2.0:1788838011.810864:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134986368 00000100:00100000:2.0:1788838011.810872:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134986368 00000100:00100000:2.0:1788838011.810911:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1788838011.811477:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134986496:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788838011.811579:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838011.811978:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134986496 00000100:00100000:3.0:1788838011.811985:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134986496 00000100:00100000:2.0:1788838011.814626:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134986112:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788838011.814704:0:66253:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788838011.814990:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134986112:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 381us (15616us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838011.818565:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1788838011.818584:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134986368:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788838011.818617:0:66254:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788838011.819373:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134986368:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 165us (9579us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838011.819385:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1788838011.819445:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1788838011.819452:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134986496:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788838011.819467:0:66254:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788838011.819513:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134986496:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 60us (7934us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838011.819519:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00010000:00010000:3.0:1788838011.819572:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838011.819576:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838011.819579:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838011.819983:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838011.819990:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838011.819995:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134986496:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788838011.820012:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838011.820016:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838011.820019:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134986368:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788838011.820034:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838011.820038:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838011.820041:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134986112:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788838011.827122:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1788838011.829420:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134986240:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 23327us (29956us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838011.829440:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00080000:2.0:1788838011.829894:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838011.829902:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838011.829907:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134986240:0@lo:38:ptlrpcd_00_03.0 00000020:00000080:0.0:1788838011.850931:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7ddc 00000020:00000080:0.0:1788838011.850953:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff503544000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788838011.850977:0:86484:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788838011.851169:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503544000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788838011.851239:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838011.851257:0:86484:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788838011.851263:0:86484:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ff6271cb370) has no exports 00010000:00010000:2.0:1788838011.851635:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838011.851669:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7dd5 00000020:00000080:1.0:1788838011.851675:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff62c81b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788838011.851733:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838011.851742:0:86484:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788838011.851745:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff610294000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788838011.851747:0:86484:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff610294000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788838011.851757:0:86484:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788838011.851987:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62c81b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788838011.852102:0:86484:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff611ab3d20 - data ffff8ff633dd05e8/ffff8ff6049b0400 00000020:01000000:1.0:1788838011.852264:0:86484:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff640f9cf00 - data ffff8ff63fcd0d80/ffff8ff632f84800 00000100:00080000:2.0:1788838011.964283:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788838011.964296:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788838011.964318:0:86484:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ff632e66d80 x1875729134984960/t77309411435(77309411435) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838021 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838011.964357:0:86484:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788838011.972063:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788838011.972096:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:2.0:1788838011.972114:0:86484:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838011.972117:0:86484:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788838011.972549:0:85178:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788838011.972556:0:85178:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:0.0:1788838011.972571:0:85178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:2.0:1788838011.973417:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788838011.973424:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:2.0:1788838011.973445:0:86484:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838011.973447:0:86484:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788838011.973785:0:85180:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788838011.973790:0:85180:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:1.0:1788838011.973837:0:85180:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:2.0:1788838011.974929:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7d8f 00000020:00000080:2.0:1788838011.974943:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff62ceab800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788838011.975727:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7da4 00000020:00000080:2.0:1788838011.975737:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff62ceae800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788838011.975744:0:86484:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788838011.975752:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838011.975767:0:86484:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788838011.975772:0:86484:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8ff503ca3370) has no exports 00000004:01000000:2.0:1788838011.976055:0:86484:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788838011.976066:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7e29 00000020:00000080:2.0:1788838011.976072:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff6104df800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788838011.976077:0:86484:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788838011.976081:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838011.976090:0:86484:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788838011.976093:0:86484:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8ff502720000) has no exports 00000020:00000080:2.0:1788838011.976100:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7e1b 00000020:00000080:2.0:1788838011.976105:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff61d4bb000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788838011.976580:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788838011.976591:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceae800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788838011.976597:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104df800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788838011.976602:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff61d4bb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788838011.976743:0:86484:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788838011.976749:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788838011.976754:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:2.0:1788838011.976761:0:86484:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838011.976763:0:86484:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788838011.976899:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838011.976911:0:86484:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788838011.976929:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7e0d 00000020:00000080:2.0:1788838011.976953:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff62ceaf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838011.978690:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff640eeb800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788838011.978709:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff6048e2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838011.978713:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6048e2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788838011.978865:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788838011.981241:0:86484:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788838011.981256:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838011.981277:0:86484:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788838011.981284:0:86484:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8ff502723370) has no exports 00000020:00000080:2.0:1788838011.981294:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7e06 00000020:00000080:2.0:1788838011.981306:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff608210800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788838011.981783:0:86484:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788838011.981789:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788838011.981977:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:2.0:1788838011.981986:0:86484:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838011.981989:0:86484:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788838011.982037:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838011.982048:0:86484:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788838011.982070:0:86484:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788838011.982078:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7df1 00000020:00000080:2.0:1788838011.982084:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff503540000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788838011.982089:0:86484:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788838011.982094:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838011.982099:0:86484:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788838011.982102:0:86484:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8ff610240000) has no exports 00000020:00000080:2.0:1788838011.982107:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7dea 00000020:00000080:2.0:1788838011.982111:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff608210000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788838011.984232:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceaf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788838011.984253:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff608210800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788838011.984260:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6048e0000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788838011.984270:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff62cea8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838011.984273:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62cea8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788838011.984278:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838011.984424:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503540000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788838011.984430:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff608210000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788838012.005438:0:86484:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788838012.005452:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788838012.005459:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788838012.005470:0:86484:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788838012.005570:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838012.005594:0:86484:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838012.005641:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838012.005645:0:86484:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838012.005652:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff61d4bb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838012.005657:0:86484:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff61d4bb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788838012.005674:0:86484:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838012.005853:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7dab 00000020:00000080:0.0:1788838012.005862:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff62cead800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788838012.005870:0:86484:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788838012.005874:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838012.005881:0:86484:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788838012.005885:0:86484:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ff503ca0000) has no exports 00000020:00000080:0.0:1788838012.005925:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838012.005929:0:86484:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788838012.005934:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7db2 00000020:00000080:0.0:1788838012.005939:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff62ceaf000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788838012.005949:0:86484:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff604fe2800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788838012.005953:0:86484:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff604fe2800 3 00000020:01000004:0.0:1788838012.005956:0:86484:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff604fe2800 from lustre-MDT0000 00000020:00000080:0.0:1788838012.005976:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838012.005979:0:86484:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788838012.005982:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff62ceac800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788838012.005984:0:86484:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceac800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788838012.005991:0:86484:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788838012.006033:0:86484:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788838012.006037:0:86484:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788838012.006040:0:86484:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788838012.006042:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838012.006045:0:86484:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788838012.006054:0:86484:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff509c66000 57943c9a-ca27-46d8-8845-5d2bce640e45 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838012.006065:0:86484:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff509c63000 4043f878-3455-4729-a2a8-e06e8394cc00 192.168.203.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838012.006070:0:86484:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8ff503ca4d28) has exports, disconnecting them 00000020:00080000:0.0:1788838012.006076:0:86484:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ff509c66000), last request at 1788837970 00000020:00000080:0.0:1788838012.006114:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7d50 00000020:00010000:0.0:1788838012.006120:0:86484:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff509c66000: total 2 00000100:00080000:0.0:1788838012.006125:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff509c60000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838012.006139:0:86484:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff509c66000): rc 0 00000020:00080000:0.0:1788838012.006143:0:86484:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.30@tcp (ffff8ff509c63000), last request at 1788837969 00000020:00010000:0.0:1788838012.006191:0:6535:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff509c66000: total 2 00010000:00010000:0.0:1788838012.006216:0:6535:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff509c66000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788838012.006252:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059f5200/0x88da08396ccc7ea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7ea0 expref: 14 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006268:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc7f25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7f1e expref: 13 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006279:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059f4c00/0x88da08396ccc7eb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7eae expref: 12 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006289:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc7f17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7f10 expref: 11 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006301:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712cc00/0x88da08396ccc7ed1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7eca expref: 10 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006329:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5c00/0x88da08396ccc7f33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7f2c expref: 9 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006340:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059f5e00/0x88da08396ccc7ec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7ebc expref: 8 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006350:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059f5c00/0x88da08396ccc7f41 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7f3a expref: 7 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006361:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059f5000/0x88da08396ccc7f4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7f48 expref: 6 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006371:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712d200/0x88da08396ccc7edf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7ed8 expref: 5 pid: 85167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006382:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059f5600/0x88da08396ccc7eed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7ee6 expref: 4 pid: 85165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006393:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5a00/0x88da08396ccc7efb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7ef4 expref: 3 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006403:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5600/0x88da08396ccc7f09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc7f02 expref: 2 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838012.006411:0:6535:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff509c66000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788838012.006429:0:6535:0:(genops.c:885:class_export_put()) final put ffff8ff509c66000/57943c9a-ca27-46d8-8845-5d2bce640e45 00010000:00010000:0.0:1788838012.006435:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838012.006437:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838012.006439:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788838012.006454:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7d49 00000020:00010000:0.0:1788838012.006457:0:86484:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff509c63000: total 3 00000100:00080000:0.0:1788838012.006460:0:86484:0:(import.c:65:import_set_state_nolock()) ffff8ff509c60800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838012.006478:0:86484:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff509c63000): rc 0 00000020:00080000:0.0:1788838012.006483:0:86484:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ff503ca4d28) has no exports 00000020:00000080:1.0:1788838012.006571:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff608213000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788838012.006582:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff509c62800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788838012.006585:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c62800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788838012.006594:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838012.006667:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62cead800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788838012.006670:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff62ceaa000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788838012.006678:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceaa000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788838012.006681:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788838012.006711:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceaf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788838012.006715:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c66000/57943c9a-ca27-46d8-8845-5d2bce640e45 for MGS 00000020:00000080:1.0:1788838012.006751:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff509c60000 for MGS 00000020:00010000:3.0:1788838012.007622:0:6534:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff509c63000: total 0 00010000:00010000:3.0:1788838012.007629:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838012.007702:0:6534:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff509c63000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1788838012.007733:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712c200/0x88da08396ccc7e8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbc6 expref: 5 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838012.007761:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc7e7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbb8 expref: 4 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838012.007777:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc7e76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbb1 expref: 3 pid: 85170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838012.007966:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059f4000/0x88da08396ccc7e84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cbbf expref: 2 pid: 85166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838012.007982:0:6534:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff509c63000, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1788838012.007999:0:6534:0:(genops.c:885:class_export_put()) final put ffff8ff509c63000/4043f878-3455-4729-a2a8-e06e8394cc00 00010000:00010000:3.0:1788838012.008016:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838012.008018:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838012.008021:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838012.008072:0:85170:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8ff505b6b600:85170] 3 exiting: rc = 0 00000020:00000080:0.0:1788838012.008170:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c63000/4043f878-3455-4729-a2a8-e06e8394cc00 for MGS 00000020:00000080:0.0:1788838012.008203:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff509c60800 for MGS 00000100:00100000:3.0:1788838012.008353:0:85165:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ff6396b9c00:85165] 0 exiting: rc = 1 00000100:00100000:2.0:1788838012.029606:0:85167:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ff6396b9a00:85167] 2 exiting: rc = 0 00000100:00100000:2.0:1788838012.029783:0:85166:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ff63a279600:85166] 1 exiting: rc = 0 00000100:00100000:0.0:1788838012.030009:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030029:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030047:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030061:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030074:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030085:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030098:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030112:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030126:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030138:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030149:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030163:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030178:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030192:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030206:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030217:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030228:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030239:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030251:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030263:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030276:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030291:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030301:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030313:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030323:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030333:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030344:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030383:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030420:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030434:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030444:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030455:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030469:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030481:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030494:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030506:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030520:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030533:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030544:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030558:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030567:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030574:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030580:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030586:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030592:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030598:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030605:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030618:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030631:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030643:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030656:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030669:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030681:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030694:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030705:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030719:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030730:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030742:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030755:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030768:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030782:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030858:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030894:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838012.030906:0:86484:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788838012.034207:0:86484:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff610f248a0 - data ffff8ff63fd0a870/ffff8ff632d87400 00000020:01000000:0.0:1788838012.034517:0:86484:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff610f249c0 - data ffff8ff63fcfe1b0/ffff8ff62ba7c400 00000020:00000080:0.0:1788838012.035194:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7d42 00000020:00000080:0.0:1788838012.035209:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff63f78d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788838012.035268:0:86484:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff604fe2800 from MGS, refs=2 00000020:01000004:0.0:1788838012.035273:0:86484:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff604fe2800 2 00000020:01000004:0.0:1788838012.035277:0:86484:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff604fe2800 from MGS 00000020:00000080:0.0:1788838012.035304:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838012.035313:0:86484:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788838012.035316:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff63f78e000/MGS 00000020:00000080:0.0:1788838012.035319:0:86484:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff63f78e000/MGS for MGS 00000020:01000000:0.0:1788838012.035330:0:86484:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788838012.035542:0:86484:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788838012.035548:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838012.035562:0:86484:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788838012.035570:0:86484:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ff640ee8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838012.035577:0:86484:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8ff6395619b8) has exports, disconnecting them 00000020:00080000:0.0:1788838012.035583:0:86484:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ff640ee8800), last request at 1788837970 00000020:00000080:0.0:1788838012.035588:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7e68 00000020:00080000:0.0:1788838012.035600:0:86484:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff640ee8800): rc 0 00000020:00000080:0.0:1788838012.035605:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff640ee8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788838012.036440:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff63f78d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788838012.037558:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640ee8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788838012.037948:0:86484:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788838012.037953:0:86484:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788838012.037959:0:86484:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788838012.037969:0:86484:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788838012.038288:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838012.038317:0:86484:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788838012.038332:0:86484:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff604fe2800 1 00000020:00000080:1.0:1788838012.038345:0:86484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc7d34 00000020:00000080:1.0:1788838012.038360:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff63f78f000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788838012.038370:0:86484:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788838012.038379:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838012.038387:0:86484:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1788838012.038699:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff640eec000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788838012.038717:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff640eeb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788838012.038723:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640eeb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788838012.038730:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788838012.038922:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff63f78f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1788838012.039601:0:86484:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ff6271ccd28) has no exports 00000020:00000080:1.0:1788838012.090167:0:86484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838012.090186:0:86484:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788838012.090195:0:86484:0:(genops.c:885:class_export_put()) final put ffff8ff604fe7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788838012.090201:0:86484:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604fe7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788838012.090209:0:86484:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788838012.090388:0:86484:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ff604fe3800 00000020:02000400:1.0:1788838012.090609:0:86484:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000400:00000100:3.0:1788838012.481939:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116386176 offset 0 length 224: 4 00000100:00100000:3.0:1788838012.481997:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838012.482037:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838012.482060:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838012.482094:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838012.482132:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116386432 00000100:00100000:3.0:1788838012.482145:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116386432 00000100:00100000:3.0:1788838012.482234:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116386304 00000100:00100000:3.0:1788838012.482237:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116386304 00000100:00100000:3.0:1788838012.482259:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1107 00000100:00100000:3.0:1788838012.482271:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116386432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838012.482508:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1104 00000100:00100000:1.0:1788838012.482518:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1875729116386304:12345-192.168.203.30@tcp:400:kworker.0 00000020:00080000:1.0:1788838012.482527:0:66254:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.30@tcp 00000100:00100000:0.0:1788838012.485999:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116386688 00000100:00100000:0.0:1788838012.486014:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116386688 00000100:00100000:0.0:1788838012.486080:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116386560 00000100:00100000:0.0:1788838012.486083:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116386560 00000100:00100000:0.0:1788838012.486118:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2457 00000100:00100000:0.0:1788838012.486129:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116386688:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838012.486346:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116386432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 4074us (4345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838012.486358:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1107 00000100:00100000:1.0:1788838012.486726:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1875729116386304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 4205us (4661us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788838012.486735:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1104 00000100:00100000:0.0:1788838012.486820:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116386688:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 692us (4780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838012.486845:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2457 00000100:00100000:0.0:1788838012.486865:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2458 00000100:00100000:0.0:1788838012.486873:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff641348850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116386560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838012.486907:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff641348850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116386560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (4813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838012.486926:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2458 00000100:00080000:3.0:1788838012.487631:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838012.487638:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838012.487642:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838012.490563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838012.491321:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116386816 00000100:00100000:2.0:1788838012.491351:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116386816 00000100:00100000:2.0:1788838012.491551:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1105 00000100:00100000:2.0:1788838012.491563:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116386816:12345-192.168.203.30@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1788838012.491598:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838012.516122:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116386816:12345-192.168.203.30@tcp:38:ptlrpcd_01_01.0 Request processed in 24543us (25560us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838012.516146:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1105 00010000:00010000:3.0:1788838012.871660:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838013.886896:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838014.909006:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838015.933223:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838016.381245:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134986624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838016.381389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838016.381627:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134986752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838016.381659:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838016.381764:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134986624 00000100:00100000:2.0:1788838016.381778:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134986624 00000100:00100000:2.0:1788838016.381903:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134986752 00000100:00100000:2.0:1788838016.381907:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134986752 00000100:00100000:2.0:1788838016.381930:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:2.0:1788838016.381941:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134986624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838016.381984:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838016.382055:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134986624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838016.382062:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:2.0:1788838016.382084:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1788838016.382090:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134986752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838016.382105:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838016.382136:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134986752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838016.382142:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00080000:3.0:1788838016.382216:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838016.382222:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838016.382273:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134986752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838016.382316:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134986624:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788838016.893098:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838016.893108:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838016.893114:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838016.893127:0:86008:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3405 00000100:00080000:3.0:1788838016.893136:0:86008:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838016.893146:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838016.893177:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639c5ca80 x1875729134987008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838016.893230:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838016.893253:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838016.893255:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838016.893259:0:86008:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3405 00000100:00080000:3.0:1788838016.893262:0:86008:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838016.893267:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838016.893280:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639c5e300 x1875729134987264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838016.893300:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838016.893304:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838016.893306:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838016.893310:0:86008:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3405 00000100:00080000:3.0:1788838016.893313:0:86008:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838016.893317:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838016.893330:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639c5c000 x1875729134987520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838016.893356:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838016.893360:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838016.893362:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838016.893365:0:86008:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3405 00000100:00080000:3.0:1788838016.893368:0:86008:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838016.893372:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838016.893386:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639c5dc00 x1875729134987648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838016.893431:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134987392:0@lo:400:kworker.0 00000100:00100000:1.0:1788838016.893643:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134986880:0@lo:400:kworker.0 00000400:00000100:1.0:1788838016.893717:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729134986880 offset 0 length 224: 4 00000100:00100000:1.0:1788838016.893822:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134987136:0@lo:400:kworker.0 00000100:00100000:1.0:1788838016.893866:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838016.893917:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134987136 00000100:00100000:1.0:1788838016.893927:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134987136 00000100:00100000:1.0:1788838016.894010:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1788838016.894021:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134987136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838016.894078:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134987136:12345-0@lo:400:kworker.0 Request processed in 59us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838016.894086:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00080000:1.0:1788838016.894111:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838016.894150:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134987136:0@lo:400:kworker.0 00000100:00100000:3.0:1788838016.894317:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838016.894707:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134987008:0@lo:38:kworker.0 00000100:00100000:2.0:1788838016.894745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838016.894777:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134987264:0@lo:38:kworker.0 00000100:00100000:2.0:1788838016.894827:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838016.894852:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134987520:0@lo:38:kworker.0 00000100:00100000:2.0:1788838016.894878:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838016.894905:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134987648:0@lo:38:kworker.0 00000100:00100000:2.0:1788838016.894925:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838016.894955:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134987392 00000100:00100000:2.0:1788838016.894959:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134987392 00000100:00100000:2.0:1788838016.895005:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134987008 00000100:00100000:2.0:1788838016.895008:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134987008 00000100:00100000:2.0:1788838016.895019:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134987264 00000100:00100000:2.0:1788838016.895021:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134987264 00000100:00100000:2.0:1788838016.895028:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134987648 00000100:00100000:2.0:1788838016.895030:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134987648 00000100:00100000:2.0:1788838016.895040:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1788838016.895047:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134987392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838016.895087:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134987392:12345-0@lo:400:kworker.0 Request processed in 41us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838016.895094:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1788838016.895107:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1788838016.895111:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134987008:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838016.895134:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838016.895162:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134987008:12345-0@lo:38:kworker.0 Request processed in 49us (416us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838016.895167:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1788838016.895176:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1788838016.895180:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134987264:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838016.895195:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838016.895215:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134987264:12345-0@lo:38:kworker.0 Request processed in 33us (387us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838016.895220:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1788838016.895229:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1788838016.895233:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134987648:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838016.895240:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838016.895257:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134987648:12345-0@lo:38:kworker.0 Request processed in 23us (331us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838016.895262:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00080000:2.0:1788838016.895287:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838016.895292:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838016.895296:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134987008:0@lo:38:kworker.0 00000100:00080000:2.0:1788838016.895304:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838016.895308:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838016.895310:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134987264:0@lo:38:kworker.0 00000100:00080000:2.0:1788838016.895317:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838016.895320:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838016.895323:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134987648:0@lo:38:kworker.0 00000100:00100000:2.0:1788838016.895372:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134987392:0@lo:400:kworker.0 00000100:00100000:1.0:1788838016.895933:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134987520 00000100:00100000:1.0:1788838016.895940:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134987520 00000100:00100000:1.0:1788838016.895987:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00100000:1.0:1788838016.895994:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134987520:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838016.896008:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838016.896061:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134987520:12345-0@lo:38:kworker.0 Request processed in 67us (1181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838016.896067:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00080000:1.0:1788838016.896103:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838016.896286:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838016.896292:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838016.896296:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134987520:0@lo:38:kworker.0 00010000:00010000:3.0:1788838016.957060:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788838017.599647:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116386944 offset 0 length 224: 4 00000100:00100000:3.0:1788838017.599700:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838017.599738:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838017.599864:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116387328 00000100:00100000:0.0:1788838017.599888:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116387328 00000100:00100000:3.0:1788838017.599917:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838017.599951:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838017.599978:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116387456 00000100:00100000:3.0:1788838017.599982:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116387456 00000100:00100000:0.0:1788838017.599988:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2459 00000100:00100000:0.0:1788838017.600003:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116387328:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838017.600019:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2460 00000100:00100000:3.0:1788838017.600030:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116387456:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:1.0:1788838017.600138:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838017.600144:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838017.600221:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116387456:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 193us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838017.600229:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2460 00000100:00100000:3.0:1788838017.600255:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116387200 00000100:00100000:3.0:1788838017.600259:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116387200 00000100:00100000:3.0:1788838017.600294:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116387072 00000100:00100000:3.0:1788838017.600297:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116387072 00000100:00100000:3.0:1788838017.600314:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1110 00000100:00100000:3.0:1788838017.600320:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116387200:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838017.600619:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1109 00000100:00100000:2.0:1788838017.600627:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116387072:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:2.0:1788838017.600651:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838017.610084:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116387328:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 10066us (10364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838017.610104:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2459 00000100:00080000:0.0:1788838017.610311:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838017.616743:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116387200:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 16401us (16982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838017.617571:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1110 00000100:00100000:2.0:1788838017.627248:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116387072:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 26597us (27272us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838017.627274:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1109 00000001:00100000:3.0:1788838017.921480:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788838017.921498:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff6057c6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838017.921780:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6057c6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788838017.921902:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6057c0000 for lustre-OST0001 00000001:00100000:2.0:1788838017.923864:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788838017.923896:0:75678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411435 is committed 00000020:00000080:2.0:1788838017.923903:0:75678:0:(genops.c:885:class_export_put()) final put ffff8ff509c65000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788838017.927489:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788838017.927503:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff62ceaa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838017.927587:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c65000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788838017.927670:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6057c3800 for lustre-MDT0001 00000020:00000080:3.0:1788838017.931254:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceaa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788838017.931360:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff62ceab000 for lustre-OST0000 00010000:00010000:2.0:1788838017.984842:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838019.006576:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838020.029051:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838021.053091:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838021.502667:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838021.502701:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134987776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838021.502776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838021.502907:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134987776 00000100:00100000:2.0:1788838021.502917:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134987776 00000100:00100000:2.0:1788838021.502990:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:2.0:1788838021.502999:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134987776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838021.503031:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838021.503084:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134987776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838021.503091:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00080000:1.0:1788838021.503366:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838021.503381:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134987904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838021.503409:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838021.503466:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134987776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838021.503552:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134987904 00000100:00100000:0.0:1788838021.503556:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134987904 00000100:00100000:0.0:1788838021.503599:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:0.0:1788838021.503606:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134987904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838021.503622:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838021.503673:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134987904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838021.503690:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00080000:1.0:1788838021.503866:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838021.503890:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134987904:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788838022.013326:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838022.013333:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838022.013337:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838022.013345:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3410 00000100:00080000:2.0:1788838022.013351:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788838022.013357:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838022.013381:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071c8380 x1875729134988160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838022.013436:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838022.013439:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838022.013441:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838022.013445:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3410 00000100:00080000:2.0:1788838022.013447:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788838022.013451:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838022.013462:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071c9500 x1875729134988416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838022.013487:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838022.013491:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838022.013492:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838022.013495:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3410 00000100:00080000:2.0:1788838022.013498:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788838022.013501:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838022.013513:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071caa00 x1875729134988672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838022.013539:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838022.013543:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838022.013544:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838022.013548:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3410 00000100:00080000:2.0:1788838022.013550:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788838022.013554:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838022.013565:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637d54a80 x1875729134989056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838022.013720:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134988160:0@lo:38:kworker.0 00000100:00100000:2.0:1788838022.013791:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838022.013859:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134988416:0@lo:38:kworker.0 00000100:00100000:2.0:1788838022.013883:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838022.013898:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134988672:0@lo:38:kworker.0 00000100:00100000:2.0:1788838022.013922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838022.013937:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134989056:0@lo:38:kworker.0 00000100:00100000:2.0:1788838022.013954:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838022.013985:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729134988288:0@lo:400:kworker.0 00000100:00100000:2.0:1788838022.014006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838022.014023:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788838022.014029:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134988032:0@lo:400:kworker.0 00000400:00000100:2.0:1788838022.014046:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729134988032 offset 0 length 224: 4 00000100:00100000:2.0:1788838022.014067:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134988928:0@lo:400:kworker.0 00000100:00100000:2.0:1788838022.014089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838022.014117:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134988928 00000100:00100000:2.0:1788838022.014125:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134988928 00000100:00100000:2.0:1788838022.014166:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1788838022.014174:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134988928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838022.014218:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134988928:12345-0@lo:400:kworker.0 Request processed in 44us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838022.014223:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1788838022.014260:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134988928:0@lo:400:kworker.0 00000100:00100000:2.0:1788838022.014288:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134988800:0@lo:400:kworker.0 00000100:00100000:2.0:1788838022.014308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838022.014325:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838022.014330:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134988544:0@lo:400:kworker.0 00000100:00100000:2.0:1788838022.014348:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838022.014370:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134988800 00000100:00100000:2.0:1788838022.014374:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134988800 00000100:00100000:2.0:1788838022.014395:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462 00000100:00100000:2.0:1788838022.014400:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134988800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838022.014428:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134988800:12345-0@lo:400:kworker.0 Request processed in 28us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838022.014433:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462 00000100:00100000:2.0:1788838022.014456:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134988800:0@lo:400:kworker.0 00000100:00100000:1.0:1788838022.014547:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134988672 00000100:00100000:1.0:1788838022.014551:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134988672 00000100:00100000:1.0:1788838022.014579:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00100000:1.0:1788838022.014584:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134988672:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838022.014601:0:8471:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838022.014635:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134988672:12345-0@lo:38:kworker.0 Request processed in 49us (711us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838022.014640:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00100000:1.0:1788838022.014663:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134988160 00000100:00100000:1.0:1788838022.014666:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134988160 00000100:00100000:1.0:1788838022.014681:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134988416 00000100:00100000:1.0:1788838022.014684:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134988416 00000100:00100000:1.0:1788838022.014691:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134989056 00000100:00100000:1.0:1788838022.014693:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134989056 00000100:00100000:1.0:1788838022.014710:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134988288 00000100:00100000:1.0:1788838022.014712:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134988288 00000100:00100000:1.0:1788838022.014736:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134988544 00000100:00100000:1.0:1788838022.014738:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134988544 00000100:00100000:1.0:1788838022.014751:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1788838022.014757:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729134988288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838022.014820:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729134988288:12345-0@lo:400:kworker.0 Request processed in 39us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838022.014827:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1788838022.014842:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1788838022.014859:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134988544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838022.014893:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134988544:12345-0@lo:400:kworker.0 Request processed in 45us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838022.014899:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1788838022.014912:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1788838022.014917:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134988160:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838022.014926:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838022.014950:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134988160:12345-0@lo:38:kworker.0 Request processed in 32us (1159us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838022.014956:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1788838022.014966:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1788838022.014970:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134988416:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838022.014978:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838022.015001:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134988416:12345-0@lo:38:kworker.0 Request processed in 29us (1117us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838022.015005:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1788838022.015023:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1788838022.015027:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134989056:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838022.015036:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838022.015059:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134989056:12345-0@lo:38:kworker.0 Request processed in 31us (1103us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838022.015064:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00080000:1.0:1788838022.015079:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838022.015101:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134988544:0@lo:400:kworker.0 00000100:00100000:2.0:1788838022.016584:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729134988288:0@lo:400:kworker.0 00000100:00080000:2.0:1788838022.016617:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838022.016622:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838022.016626:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134988160:0@lo:38:kworker.0 00000100:00080000:2.0:1788838022.016636:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838022.016650:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838022.016654:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134988416:0@lo:38:kworker.0 00000100:00080000:2.0:1788838022.016665:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838022.016668:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838022.016670:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134988672:0@lo:38:kworker.0 00000100:00080000:2.0:1788838022.016679:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838022.016694:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838022.016697:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134989056:0@lo:38:kworker.0 00010000:00010000:2.0:1788838022.078752:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788838022.716553:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116387584 offset 0 length 224: 4 00000100:00100000:3.0:1788838022.716617:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838022.716646:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838022.716671:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838022.716701:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838022.716777:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116387840 00000100:00100000:0.0:1788838022.716777:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116387712 00000100:00100000:1.0:1788838022.716793:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116387840 00000100:00100000:0.0:1788838022.716793:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116387712 00000100:00100000:0.0:1788838022.716918:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1113 00000100:00080000:3.0:1788838022.716926:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838022.717004:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116387968 00000100:00100000:3.0:1788838022.717022:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116387968 00000100:00100000:2.0:1788838022.717025:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116388096 00000100:00100000:2.0:1788838022.717034:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116388096 00000100:00100000:0.0:1788838022.717087:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116387712:12345-192.168.203.30@tcp:38:kworker.0 00000100:00100000:3.0:1788838022.717100:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5925 00000100:00100000:3.0:1788838022.717113:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2403:x1875729116387968:12345-192.168.203.30@tcp:9:kworker.0 00010000:00020000:0.0:1788838022.717122:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:3.0:1788838022.717160:0:8460:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc818d 00000100:00080000:3.0:1788838022.717178:0:8460:0:(import.c:65:import_set_state_nolock()) ffff8ff6104d8000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788838022.717190:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1113 00000100:00100000:1.0:1788838022.717205:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116387840:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838022.717226:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116387712:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 143us (579us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838022.717234:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1113 00000100:00100000:1.0:1788838022.717254:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116387840:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 56us (638us total) trans 0 rc 0/0 00000001:00000004:3.0:1788838022.717260:0:8460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:1.0:1788838022.717263:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1113 00010000:00010000:1.0:1788838022.717307:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838022.717489:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+2:2403:x1875729116387968:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 377us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838022.717499:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5925 00000100:00080000:3.0:1788838022.719654:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838022.719664:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838022.719936:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5926 00000100:00100000:2.0:1788838022.719960:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2403:x1875729116388096:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1788838022.720007:0:26217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8194 00000100:00080000:2.0:1788838022.720023:0:26217:0:(import.c:65:import_set_state_nolock()) ffff8ff50345e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788838022.720093:0:26217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969449 00010000:00010000:3.0:1788838022.720240:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838022.720329:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+2:2403:x1875729116388096:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 382us (3626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838022.720337:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5926 00010000:00010000:3.0:1788838023.101116:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838024.125046:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838025.149960:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838026.173104:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838026.624370:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838026.624408:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134989184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838026.624525:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838026.624591:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134989184 00000100:00100000:0.0:1788838026.624600:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134989184 00000100:00100000:0.0:1788838026.624670:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:0.0:1788838026.624679:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134989184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838026.624715:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838026.625031:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134989184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 351us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838026.625040:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00080000:0.0:1788838026.625066:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838026.625155:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134989184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838026.626535:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134989312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838026.626608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838026.626676:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134989312 00000100:00100000:3.0:1788838026.626692:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134989312 00000100:00100000:3.0:1788838026.626754:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1788838026.626764:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134989312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838026.626826:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838026.626874:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134989312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838026.626882:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1788838026.626930:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134989312:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788838026.627933:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838027.139856:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838027.139866:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838027.139871:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838027.139884:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3416 00000100:00080000:2.0:1788838027.139891:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788838027.139900:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838027.139933:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637d56a00 x1875729134989568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838027.139980:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838027.139985:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1788838027.139986:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134989440:0@lo:400:kworker.0 00000100:00080000:2.0:1788838027.139997:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838027.140004:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3416 00000100:00080000:2.0:1788838027.140008:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788838027.140015:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838027.140035:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637d57100 x1875729134989824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838027.140070:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000400:00000100:1.0:1788838027.140070:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729134989440 offset 0 length 224: 4 00000100:00080000:2.0:1788838027.140077:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838027.140079:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838027.140084:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3416 00000100:00080000:2.0:1788838027.140087:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788838027.140093:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838027.140108:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637d55180 x1875729134990080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838027.140136:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1788838027.140146:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134990336:0@lo:400:kworker.0 00000100:00080000:2.0:1788838027.140147:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838027.140152:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838027.140158:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3416 00000100:00080000:2.0:1788838027.140161:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788838027.140166:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838027.140180:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637d55880 x1875729134990464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838027.140196:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838027.140216:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134989568:0@lo:38:kworker.0 00000100:00100000:1.0:1788838027.140227:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838027.140236:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134990208:0@lo:400:kworker.0 00000100:00100000:2.0:1788838027.140262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838027.140301:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134989824:0@lo:38:kworker.0 00000100:00100000:1.0:1788838027.140329:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838027.140340:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838027.140368:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134990080:0@lo:38:kworker.0 00000100:00100000:1.0:1788838027.140375:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134990336 00000100:00100000:1.0:1788838027.140396:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134990336 00000100:00100000:2.0:1788838027.140400:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838027.140420:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134990464:0@lo:38:kworker.0 00000100:00100000:2.0:1788838027.140445:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838027.140478:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134989696:0@lo:400:kworker.0 00000100:00100000:2.0:1788838027.140503:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838027.140521:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838027.140526:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729134989952:0@lo:400:kworker.0 00000100:00100000:2.0:1788838027.140546:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838027.140610:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134990208 00000100:00100000:1.0:1788838027.140614:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134990208 00000100:00100000:1.0:1788838027.140643:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463 00000100:00100000:1.0:1788838027.140653:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134990336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838027.140774:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134990080 00000100:00100000:0.0:1788838027.140780:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134990080 00000100:00100000:0.0:1788838027.140835:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00100000:0.0:1788838027.140848:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134990080:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838027.140875:0:8472:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838027.140922:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134990080:12345-0@lo:38:kworker.0 Request processed in 72us (523us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838027.140930:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00100000:1.0:1788838027.142639:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134990336:12345-0@lo:400:kworker.0 Request processed in 1974us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838027.142655:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463 00000100:00100000:1.0:1788838027.142694:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464 00000100:00100000:1.0:1788838027.142707:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134990208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838027.142780:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729134990208:12345-0@lo:400:kworker.0 Request processed in 79us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838027.142786:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1788838027.143566:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134989568 00000100:00100000:0.0:1788838027.143582:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134989568 00000100:00100000:0.0:1788838027.143638:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134989824 00000100:00100000:0.0:1788838027.143642:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134989824 00000100:00100000:0.0:1788838027.143653:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134990464 00000100:00100000:0.0:1788838027.143657:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134990464 00000100:00100000:0.0:1788838027.143666:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134989696 00000100:00100000:0.0:1788838027.143669:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134989696 00000100:00100000:0.0:1788838027.143719:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134989952 00000100:00100000:0.0:1788838027.143723:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134989952 00000100:00100000:2.0:1788838027.144214:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1788838027.144234:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134989696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838027.144354:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134989696:12345-0@lo:400:kworker.0 Request processed in 130us (3849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838027.144363:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1788838027.144389:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1788838027.144394:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134989568:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838027.144421:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838027.144458:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134989568:12345-0@lo:38:kworker.0 Request processed in 62us (4196us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838027.144465:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1788838027.144477:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1788838027.144481:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134989824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838027.144490:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838027.144534:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134989824:12345-0@lo:38:kworker.0 Request processed in 51us (4194us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838027.144540:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1788838027.144553:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1788838027.144557:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134990464:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838027.144566:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838027.144591:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134990464:12345-0@lo:38:kworker.0 Request processed in 32us (4145us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838027.144597:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1788838027.144661:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134989696:0@lo:400:kworker.0 00000100:00080000:3.0:1788838027.145317:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838027.145325:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838027.145330:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134989568:0@lo:38:kworker.0 00000100:00080000:3.0:1788838027.145344:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838027.145348:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838027.145352:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134989824:0@lo:38:kworker.0 00000100:00080000:3.0:1788838027.145362:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838027.145366:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838027.145369:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134990080:0@lo:38:kworker.0 00000100:00080000:3.0:1788838027.145381:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838027.145385:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838027.145389:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134990464:0@lo:38:kworker.0 00000100:00080000:3.0:1788838027.145478:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838027.145865:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134990208:0@lo:400:kworker.0 00000100:00100000:1.0:1788838027.145884:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729134990336:0@lo:400:kworker.0 00000100:00100000:0.0:1788838027.146683:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1788838027.146705:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729134989952:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788838027.148592:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838027.153021:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729134989952:12345-0@lo:400:kworker.0 Request processed in 6303us (12456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838027.153043:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1788838027.155531:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729134989952:0@lo:400:kworker.0 00010000:00010000:1.0:1788838027.198118:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838027.839591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:3.0:1788838027.839640:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116388224 offset 0 length 224: 4 00000100:00100000:3.0:1788838027.839673:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838027.839739:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116388352 00000100:00100000:3.0:1788838027.839750:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116388352 00000100:00100000:2.0:1788838027.839785:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116388480 00000100:00100000:2.0:1788838027.839793:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116388480 00000100:00100000:3.0:1788838027.839913:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1117 00000100:00100000:3.0:1788838027.839925:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116388352:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:3.0:1788838027.839958:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838027.839979:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1116 00000100:00100000:2.0:1788838027.839990:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116388480:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838027.840051:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116388352:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 126us (476us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838027.840055:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116388480:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 66us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838027.840065:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1117 00000100:00100000:2.0:1788838027.840072:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1116 00000100:00080000:2.0:1788838027.840102:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788838028.223922:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788838028.862878:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116388608 offset 0 length 520: 4 00000100:00100000:3.0:1788838028.862926:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838028.862955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838028.862986:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116388736 00000100:00100000:3.0:1788838028.862998:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116388736 00000100:00100000:3.0:1788838028.863038:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116388864 00000100:00100000:3.0:1788838028.863040:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116388864 00000100:00100000:3.0:1788838028.863078:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1117 00000100:00100000:3.0:1788838028.863089:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116388864:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838028.863181:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116388864:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838028.863190:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1117 00000100:00100000:3.0:1788838028.863219:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1118 00000100:00100000:3.0:1788838028.863224:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116388736:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:3.0:1788838028.863263:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838028.863288:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116388736:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 63us (363us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838028.863313:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1118 00000001:00100000:0.0:1788838029.186904:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:0.0:1788838029.186917:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff50345b800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:1.0:1788838029.187104:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50345b800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-OST0001 00000020:00000080:1.0:1788838029.187191:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50345e000 for lustre-OST0001 00000001:00100000:2.0:1788838029.190135:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:2.0:1788838029.190149:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff6104d9800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:2.0:1788838029.195598:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104d9800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-OST0000 00000020:00000080:2.0:1788838029.195872:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6104d8000 for lustre-OST0000 00010000:00010000:1.0:1788838029.245586:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838030.269094:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838031.295115:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838031.752904:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134990592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838031.753021:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838031.756496:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134990592 00000100:00100000:0.0:1788838031.756516:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134990592 00000100:00100000:0.0:1788838031.756814:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:0.0:1788838031.756828:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134990592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838031.756878:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838031.757148:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134990592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 323us (4127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838031.757168:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00080000:2.0:1788838031.757430:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838031.757464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134990720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838031.758515:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838031.760247:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134990592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838031.760467:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134990720 00000100:00100000:1.0:1788838031.760476:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134990720 00000100:00100000:1.0:1788838031.760554:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:1.0:1788838031.760565:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134990720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838031.760605:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838031.760961:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729134990720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 396us (2450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838031.760993:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:3.0:1788838031.761348:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729134990720:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788838031.762360:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00000400:0.0:1788838032.256105:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838016/real 1788838016] req@ffff8ff639c5ea00 x1875729134986880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838032 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838032.256143:0:3646:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8ff639c5ea00 x1875729134986880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838032 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838032.256384:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788838032.256390:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788838032.256394:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788838032.256396:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788838032.256401:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff639c5ea00 x1875729134986880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838032 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838032.256411:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff5071c8a80 x1875729134988032/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838038 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838032.256426:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff637d54a80 x1875729134989440/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838043 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788838032.256435:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788838032.256438:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788838032.256439:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788838032.256441:0:3646:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1788838032.256466:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134989440:0@lo:400:kworker.0 00000100:00100000:0.0:1788838032.256472:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134986880:0@lo:400:kworker.0 00000100:00100000:3.0:1788838032.256627:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134988032:0@lo:400:kworker.0 00000100:00080000:3.0:1788838032.256655:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838032.256660:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788838032.256663:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838032.256668:0:63434:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3364 00000100:00080000:3.0:1788838032.256678:0:63434:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838032.256711:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63333fb80 x1875729134990848/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838032.256742:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838032.256746:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838032.256748:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838032.256752:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3421 00000100:00080000:3.0:1788838032.256754:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838032.256758:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838032.256774:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63333f100 x1875729134990976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838032.256838:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838032.256842:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838032.256844:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838032.256855:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3421 00000100:00080000:3.0:1788838032.256857:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838032.256862:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838032.256875:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6270bdc00 x1875729134991232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838032.256891:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838032.256894:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838032.256896:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838032.256899:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3421 00000100:00080000:3.0:1788838032.256902:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838032.256905:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838032.256916:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6270bca80 x1875729134991488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838032.256944:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838032.256948:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838032.256949:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838032.256953:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3421 00000100:00080000:3.0:1788838032.256955:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838032.256958:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838032.256968:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6270bed80 x1875729134991872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838032.257313:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134991616:0@lo:400:kworker.0 00000100:00100000:3.0:1788838032.257395:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838032.257444:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838032.257456:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134991744:0@lo:400:kworker.0 00000100:00100000:3.0:1788838032.257481:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838032.257917:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729134990848:0@lo:250:kworker.0 00000400:00000100:0.0:1788838032.257948:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729134990848 offset 0 length 520: 4 00000100:00100000:0.0:1788838032.257987:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134990976:0@lo:38:kworker.0 00000100:00100000:0.0:1788838032.258030:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838032.258054:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134991232:0@lo:38:kworker.0 00000100:00100000:0.0:1788838032.258448:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838032.258479:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134991488:0@lo:38:kworker.0 00000100:00100000:0.0:1788838032.258508:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838032.258529:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134991872:0@lo:38:kworker.0 00000100:00100000:0.0:1788838032.258553:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838032.258581:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134990976 00000100:00100000:0.0:1788838032.258589:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134991104:0@lo:400:kworker.0 00000100:00100000:2.0:1788838032.258591:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134990976 00000100:00100000:0.0:1788838032.258614:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838032.258674:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134991616 00000100:00100000:1.0:1788838032.258679:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134991616 00000100:00100000:1.0:1788838032.258720:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134991744 00000100:00100000:1.0:1788838032.258723:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134991744 00000100:00100000:1.0:1788838032.258746:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:1.0:1788838032.258755:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134991616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838032.258851:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134991616:12345-0@lo:400:kworker.0 Request processed in 98us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838032.258859:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:1.0:1788838032.258877:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:1.0:1788838032.258884:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134991744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838032.258915:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134991744:12345-0@lo:400:kworker.0 Request processed in 32us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838032.258921:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:0.0:1788838032.259064:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838032.259071:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729134991360:0@lo:400:kworker.0 00000100:00100000:0.0:1788838032.259097:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838032.260826:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134991232 00000100:00100000:2.0:1788838032.260842:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134991232 00000100:00100000:2.0:1788838032.260897:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134991872 00000100:00100000:2.0:1788838032.260900:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134991872 00000100:00100000:2.0:1788838032.260910:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134991104 00000100:00100000:2.0:1788838032.260913:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134991104 00000100:00100000:2.0:1788838032.260947:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134991360 00000100:00100000:2.0:1788838032.260950:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134991360 00000100:00100000:0.0:1788838032.260958:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1788838032.260968:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134991104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838032.261068:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729134991104:12345-0@lo:400:kworker.0 Request processed in 102us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838032.261377:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1788838032.261391:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729134991360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838032.261436:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729134991360:12345-0@lo:400:kworker.0 Request processed in 51us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838032.262558:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1788838032.262608:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1788838032.262616:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134990976:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838032.262645:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838032.262725:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134990976:12345-0@lo:38:kworker.0 Request processed in 109us (4694us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838032.262732:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1788838032.262747:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1788838032.262771:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134991232:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838032.262793:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838032.262834:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134991232:12345-0@lo:38:kworker.0 Request processed in 62us (4386us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838032.262841:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1788838032.262853:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:0.0:1788838032.262858:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134991872:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838032.262867:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838032.262892:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134991872:12345-0@lo:38:kworker.0 Request processed in 33us (4339us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838032.262898:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:0.0:1788838032.262930:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134991488 00000100:00100000:0.0:1788838032.262938:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134991488 00000100:00100000:0.0:1788838032.263083:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00100000:0.0:1788838032.263090:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134991488:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838032.263100:0:8471:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838032.263131:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134991488:12345-0@lo:38:kworker.0 Request processed in 41us (4622us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838032.263137:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00100000:0.0:1788838032.263390:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729134991360:0@lo:400:kworker.0 00000100:00100000:0.0:1788838032.263407:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729134991104:0@lo:400:kworker.0 00000100:00080000:0.0:1788838032.263453:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838032.263459:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838032.263462:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134990976:0@lo:38:kworker.0 00000100:00080000:0.0:1788838032.263482:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838032.263486:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838032.263489:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134991232:0@lo:38:kworker.0 00000100:00080000:0.0:1788838032.263499:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838032.263503:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838032.263506:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134991488:0@lo:38:kworker.0 00000100:00080000:0.0:1788838032.263515:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838032.263519:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838032.263521:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134991872:0@lo:38:kworker.0 00000100:00100000:0.0:1788838032.263916:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134991744:0@lo:400:kworker.0 00000100:00100000:0.0:1788838032.263933:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134991616:0@lo:400:kworker.0 00000100:00100000:2.0:1788838032.268381:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00080000:2.0:1788838032.268452:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788838032.317151:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838033.341200:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838033.998244:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838033.998347:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838033.998382:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116389120 00000100:00100000:0.0:1788838033.998395:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116389120 00000100:00100000:0.0:1788838033.998478:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116388992 00000100:00100000:0.0:1788838033.998482:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116388992 00000100:00100000:0.0:1788838033.998507:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1120 00000100:00100000:0.0:1788838033.998518:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116389120:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838033.998618:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116389120:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 102us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838033.998628:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1120 00000100:00100000:0.0:1788838033.998665:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1122 00000100:00100000:0.0:1788838033.998684:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116388992:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:0.0:1788838033.998711:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838033.998741:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116388992:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 57us (394us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838033.998748:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1122 00000100:00080000:0.0:1788838033.998782:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788838034.366682:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838035.392107:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838036.414131:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838036.862939:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134992000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838036.863053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838036.863186:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134992000 00000100:00100000:3.0:1788838036.863199:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134992000 00000100:00100000:3.0:1788838036.863294:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:3.0:1788838036.863308:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134992000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838036.863357:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838036.863416:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134992000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838036.863424:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00080000:0.0:1788838036.863493:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838036.863546:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134992000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838036.863816:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838036.863826:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134992128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838036.863865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838036.863907:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134992128 00000100:00100000:2.0:1788838036.863911:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134992128 00000100:00100000:2.0:1788838036.863948:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1788838036.863955:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134992128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838036.863990:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838036.864030:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134992128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838036.864038:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00080000:2.0:1788838036.864056:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838036.864078:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134992128:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1788838037.061428:0:87103:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788838037.061442:0:87103:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788838037.061445:0:87103:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788838037.061588:0:87103:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ff605444800 00000020:01000004:3.0:1788838037.062006:0:87103:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788838037.062029:0:87103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788838037.062050:0:87103:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ff6271c8000) 00000020:00000080:3.0:1788838037.062073:0:87103:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788838037.266395:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788838037.270215:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.271143:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788838037.271555:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.271790:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.272096:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788838037.272539:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788838037.272736:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788838037.273024:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.273292:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.273474:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788838037.273761:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.274064:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788838037.274269:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.277309:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.278272:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.278481:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.278705:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.278961:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.279191:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.279429:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.279730:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.280066:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.280299:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.280503:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.280722:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.280947:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.281121:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.281303:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.281486:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.281669:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.281969:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.282165:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.282461:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.282634:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.282862:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.283072:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.283263:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.283463:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.283679:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.283980:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.284165:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.284440:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.284652:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.284886:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788838037.285105:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.285343:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788838037.286431:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.286716:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.286991:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.287464:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.287667:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788838037.288025:0:87103:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788838037.289302:0:87103:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788838037.289559:0:87103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788838037.289568:0:87103:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788838037.289581:0:87103:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc82dd 00000020:01000004:2.0:1788838037.289589:0:87103:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788838037.289601:0:87103:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788838037.289607:0:87103:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff605444800 from MGS 00000020:01000004:2.0:1788838037.289610:0:87103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788838037.289620:0:87103:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ff610240000) 00000020:00000080:2.0:1788838037.289632:0:87103:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1788838037.289688:0:87103:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff605444800 from MGS, refs=2 00080000:01000000:2.0:1788838037.289692:0:87103:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788838037.289695:0:87103:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc82eb 00010000:00010000:2.0:1788838037.289863:0:87103:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788838037.294722:0:87103:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788838037.295692:0:87107:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788838037.295762:0:87103:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788838037.295823:0:87103:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788838037.296488:0:87103:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788838037.296756:0:87103:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788838037.296986:0:87103:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788838037.296993:0:87103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788838037.300519:0:87103:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788838037.300534:0:87103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788838037.302589:0:87103:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788838037.302601:0:87103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788838037.316523:0:87103:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788838037.316559:0:87103:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788838037.316561:0:87103:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788838037.316566:0:87103:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788838037.316572:0:87103:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 57, was 0): CONNECTING 00000100:00100000:0.0:1788838037.316578:0:87103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00080000:0.0:1788838037.373270:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838037.373282:0:63434:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788838037.373285:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838037.373289:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838037.373295:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838037.373306:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3426 00000100:00080000:0.0:1788838037.373312:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838037.373346:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838037.373399:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff632e64a80 x1875729134992256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838037.373484:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134992384:0@lo:400:kworker.0 00000100:00100000:3.0:1788838037.373573:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838037.373666:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134992384 00000100:00100000:1.0:1788838037.373675:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134992384 00000100:00100000:1.0:1788838037.373737:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1788838037.373759:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134992384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838037.373886:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134992256:0@lo:38:kworker.0 00000100:00100000:2.0:1788838037.373918:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788838037.373966:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838037.373979:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134992256 00000100:00100000:2.0:1788838037.373983:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134992256 00000100:00100000:2.0:1788838037.374009:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1788838037.374015:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134992256:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838037.374036:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838037.374075:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134992256:12345-0@lo:38:kworker.0 Request processed in 58us (154us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838037.374082:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00080000:2.0:1788838037.374126:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838037.374131:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838037.374134:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134992256:0@lo:38:kworker.0 00000100:00080000:0.0:1788838037.374306:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838037.374310:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838037.374313:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838037.374318:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3426 00000100:00080000:0.0:1788838037.374321:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838037.374326:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838037.374346:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff632e64380 x1875729134992512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838037.374408:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134992640:0@lo:400:kworker.0 00000100:00100000:2.0:1788838037.374439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838037.374480:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134992640 00000100:00100000:2.0:1788838037.374484:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134992640 00000100:00100000:2.0:1788838037.374519:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1788838037.374526:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134992640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838037.374562:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729134992640:12345-0@lo:400:kworker.0 Request processed in 36us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838037.374568:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00080000:2.0:1788838037.374586:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838037.374605:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729134992640:0@lo:400:kworker.0 00000100:00100000:2.0:1788838037.374623:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134992512:0@lo:38:kworker.0 00000100:00100000:2.0:1788838037.374647:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838037.374672:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134992512 00000100:00100000:2.0:1788838037.374683:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134992512 00000100:00100000:2.0:1788838037.374703:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1788838037.374707:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134992512:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838037.374720:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838037.374762:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729134992512:12345-0@lo:38:kworker.0 Request processed in 53us (114us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838037.374768:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00080000:2.0:1788838037.374793:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838037.374814:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838037.374817:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134992512:0@lo:38:kworker.0 00000100:00100000:1.0:1788838037.377980:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729134992384:12345-0@lo:400:kworker.0 Request processed in 4221us (4392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838037.378000:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:3.0:1788838037.381891:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729134992384:0@lo:400:kworker.0 00000100:00080000:0.0:1788838037.382167:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838037.382174:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838037.382179:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838037.382185:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3426 00000100:00080000:0.0:1788838037.382190:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838037.382197:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838037.382339:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff632e64700 x1875729134992768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838037.382405:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838037.382409:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838037.382411:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838037.382415:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3426 00000100:00080000:0.0:1788838037.382417:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838037.382438:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838037.382451:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63333f100 x1875729134993152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838037.382603:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134992896:0@lo:400:kworker.0 00000100:00100000:1.0:1788838037.382680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838037.382722:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838037.382729:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134993024:0@lo:400:kworker.0 00000100:00100000:1.0:1788838037.382764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838037.382850:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134992896 00000100:00100000:2.0:1788838037.382857:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134992896 00000100:00100000:2.0:1788838037.382907:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134993024 00000100:00100000:2.0:1788838037.382911:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134993024 00000100:00100000:2.0:1788838037.382936:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:2.0:1788838037.382944:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134992896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838037.383002:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134992896:12345-0@lo:400:kworker.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838037.383009:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00100000:2.0:1788838037.383023:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468 00000100:00100000:2.0:1788838037.383028:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134993024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838037.383049:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729134993024:12345-0@lo:400:kworker.0 Request processed in 22us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838037.383054:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468 00000100:00100000:2.0:1788838037.383082:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134993024:0@lo:400:kworker.0 00000100:00100000:2.0:1788838037.383091:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729134992896:0@lo:400:kworker.0 00000100:00100000:2.0:1788838037.383119:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134992768:0@lo:38:kworker.0 00000100:00100000:2.0:1788838037.383145:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838037.383163:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134993152:0@lo:38:kworker.0 00000100:00100000:2.0:1788838037.383182:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838037.383210:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134992768 00000100:00100000:2.0:1788838037.383214:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134992768 00000100:00100000:1.0:1788838037.383327:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134993152 00000100:00100000:1.0:1788838037.383331:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134993152 00000100:00100000:1.0:1788838037.383352:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1788838037.383356:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134993152:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838037.383375:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838037.383404:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134993152:12345-0@lo:38:kworker.0 Request processed in 47us (221us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838037.383409:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1788838037.383540:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00100000:2.0:1788838037.383545:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134992768:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838037.383556:0:8472:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838037.383581:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134992768:12345-0@lo:38:kworker.0 Request processed in 35us (436us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838037.383586:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00080000:3.0:1788838037.383656:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838037.383661:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838037.383664:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134992768:0@lo:38:kworker.0 00000100:00080000:3.0:1788838037.383670:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838037.383673:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838037.383693:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134993152:0@lo:38:kworker.0 00010000:00010000:0.0:1788838037.436964:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838038.461562:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838039.100593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838039.100850:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116389376 00000100:00100000:2.0:1788838039.100864:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116389376 00000100:00080000:0.0:1788838039.100916:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838039.100947:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1123 00000100:00100000:2.0:1788838039.100959:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116389376:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838039.101050:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116389376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 93us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838039.101059:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1123 00000100:00100000:3.0:1788838039.103818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838039.103953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838039.105021:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116389248 00000100:00100000:2.0:1788838039.105038:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116389248 00000100:00100000:2.0:1788838039.105110:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1126 00000100:00100000:2.0:1788838039.105119:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116389248:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:2.0:1788838039.105147:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838039.105212:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116389248:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 92us (1420us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838039.105235:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1126 00000100:00100000:1.0:1788838039.105523:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116389504 00000100:00100000:1.0:1788838039.105530:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116389504 00000100:00100000:1.0:1788838039.105571:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1788838039.105578:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1875729116389504:12345-192.168.203.30@tcp:250:kworker.0 00010000:00080000:1.0:1788838039.105598:0:87108:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4043f878-3455-4729-a2a8-e06e8394cc00@192.168.203.30@tcp t0 exp 0000000000000000 cur 3433 last 0 00000020:00000080:1.0:1788838039.105625:0:87108:0:(genops.c:1385:class_connect()) connect: client 4043f878-3455-4729-a2a8-e06e8394cc00, cookie 0x88da08396ccc82f2 00000100:00080000:1.0:1788838039.105905:0:87108:0:(import.c:65:import_set_state_nolock()) ffff8ff604fe6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838039.105959:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+5:2403:x1875729116389504:12345-192.168.203.30@tcp:250:kworker.0 Request processed in 380us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838039.105969:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00010000:00010000:3.0:1788838039.487217:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838040.510523:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838040.645610:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838040.649140:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116389632 00000100:00100000:1.0:1788838040.649155:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116389632 00000100:00100000:1.0:1788838040.649232:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1788838040.649244:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+5:42411:x1875729116389632:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838040.649281:0:87111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838040.649315:0:87111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff607461800/0x88da08396ccc82f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc1a expref: -99 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838040.649343:0:87111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff607461800/0x88da08396ccc82f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc1a expref: 6 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838040.649356:0:87111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff607461800/0x88da08396ccc82f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc1a expref: 6 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838040.649375:0:87111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff607461800, rc 0) 00000100:00100000:1.0:1788838040.650040:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116389632:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 795us (4439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838040.650048:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:0.0:1788838040.665093:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838040.671511:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116389760 00000100:00100000:1.0:1788838040.671527:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116389760 00000100:00100000:1.0:1788838040.671607:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:1.0:1788838040.671618:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116389760:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788838040.671717:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116389760:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 Request processed in 101us (6632us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838040.671734:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:3.0:1788838040.687651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838040.687738:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116389888 00000100:00100000:1.0:1788838040.687748:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116389888 00000100:00100000:1.0:1788838040.687864:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1788838040.687875:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116389888:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838040.687892:0:87111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838040.687928:0:87111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff607460600/0x88da08396ccc8300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc21 expref: -99 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838040.687955:0:87111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff607460600/0x88da08396ccc8300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc21 expref: 7 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838040.687967:0:87111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff607460600/0x88da08396ccc8300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc21 expref: 7 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838040.687976:0:87111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff607460600, rc 0) 00000100:00100000:1.0:1788838040.688035:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+7:42411:x1875729116389888:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 161us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838040.688043:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1788838040.690296:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838040.690427:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116390016 00000100:00100000:2.0:1788838040.690436:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116390016 00000100:00100000:2.0:1788838040.690489:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1788838040.690498:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+7:42411:x1875729116390016:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788838040.691040:0:87112:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788838040.691131:0:87110:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 109 20000000:01000000:2.0:1788838040.692958:0:87113:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788838040.692968:0:87113:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788838040.692972:0:87113:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788838040.692974:0:87113:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788838040.693146:0:87113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788838040.694914:0:87110:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788838040.695057:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116390016:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 4552us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838040.695076:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1788838040.697933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838040.698139:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116390144 00000100:00100000:0.0:1788838040.698150:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116390144 00000100:00100000:0.0:1788838040.698195:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1788838040.698217:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116390144:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838040.698371:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116390144:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 156us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838040.698379:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1788838040.702977:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838040.703249:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116390272 00000100:00100000:3.0:1788838040.703262:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116390272 00000100:00100000:3.0:1788838040.703380:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1788838040.703393:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116390272:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838040.703414:0:87110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838040.703440:0:87110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff600031800/0x88da08396ccc8307 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc28 expref: -99 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838040.703466:0:87110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600031800/0x88da08396ccc8307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc28 expref: 9 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838040.703477:0:87110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff600031800/0x88da08396ccc8307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc28 expref: 9 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838040.703505:0:87110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600031800, rc 0) 00000100:00100000:3.0:1788838040.703566:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116390272:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 176us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838040.703573:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1788838040.708343:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838040.708517:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116390400 00000100:00100000:1.0:1788838040.708527:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116390400 00000100:00100000:1.0:1788838040.708628:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1788838040.708637:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116390400:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838040.709033:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116390400:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 396us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838040.709042:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1788838040.711101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838040.711170:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116390528 00000100:00100000:3.0:1788838040.711179:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116390528 00000100:00100000:3.0:1788838040.711237:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1788838040.711246:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116390528:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838040.711380:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116390528:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 135us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838040.711388:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1788838040.718435:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838040.719080:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116390656 00000100:00100000:1.0:1788838040.719091:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116390656 00000100:00100000:1.0:1788838040.719149:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:1.0:1788838040.719159:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116390656:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838040.719175:0:87111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838040.719193:0:87111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff607461a00/0x88da08396ccc830e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc2f expref: -99 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838040.719251:0:87111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff607461a00/0x88da08396ccc830e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc2f expref: 10 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838040.719262:0:87111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff607461a00/0x88da08396ccc830e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc2f expref: 10 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838040.719271:0:87111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff607461a00, rc 0) 00000100:00100000:1.0:1788838040.719330:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116390656:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 173us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838040.719338:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1788838040.722964:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838040.723062:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116390784 00000100:00100000:0.0:1788838040.723083:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116390784 00000100:00100000:0.0:1788838040.723148:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1788838040.723158:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116390784:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838040.723302:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116390784:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 145us (349us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788838040.723311:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00010000:00010000:0.0:1788838041.533318:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838041.981256:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134993280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838041.981353:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838041.981504:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134993280 00000100:00100000:1.0:1788838041.981514:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134993280 00000100:00100000:1.0:1788838041.981595:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:1.0:1788838041.981605:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134993280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838041.981636:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838041.981704:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134993280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838041.981720:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:1.0:1788838041.981774:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134993280:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788838041.982123:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838041.982483:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838041.982496:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134993408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838041.982541:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838041.983059:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134993408 00000100:00100000:1.0:1788838041.983066:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134993408 00000100:00100000:1.0:1788838041.983126:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:1.0:1788838041.983135:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134993408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838041.983167:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838041.983229:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134993408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838041.983251:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:0.0:1788838041.983346:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134993408:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788838041.983523:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838042.492938:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838032/real 1788838032] req@ffff8ff63333fb80 x1875729134990848/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838042.492975:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ff63333fb80 x1875729134990848/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838042.493000:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838042.493009:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788838042.493016:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729134990848:0@lo:250:kworker.0 10000000:01000000:0.0:1788838042.493036:0:87103:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788838042.493075:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5a00/0x88da08396ccc7f3a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7f41 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493086:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5a00/0x88da08396ccc7f3a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7f41 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493092:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788838042.493111:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493121:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5a00/0x88da08396ccc7f3a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7f41 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493137:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5000/0x88da08396ccc7ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7ea7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493144:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5000/0x88da08396ccc7ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7ea7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493149:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838042.493153:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493158:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5000/0x88da08396ccc7ea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7ea7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493168:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8200/0x88da08396ccc7ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7ec3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493175:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8200/0x88da08396ccc7ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7ec3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493180:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838042.493195:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493199:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8200/0x88da08396ccc7ebc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7ec3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493218:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4e00/0x88da08396ccc7ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7eed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493225:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4e00/0x88da08396ccc7ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7eed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493230:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838042.493233:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493237:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4e00/0x88da08396ccc7ee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7eed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493245:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5400/0x88da08396ccc7ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7efb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493251:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5400/0x88da08396ccc7ef4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7efb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493257:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838042.493260:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493263:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5400/0x88da08396ccc7ef4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7efb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493271:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4e00/0x88da08396ccc7f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7f17 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493278:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4e00/0x88da08396ccc7f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7f17 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493285:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838042.493297:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493303:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4e00/0x88da08396ccc7f10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7f17 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493314:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc7f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7f25 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493320:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc7f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7f25 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493325:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838042.493337:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493340:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc7f1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7f25 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493351:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5800/0x88da08396ccc7f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7f4f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493357:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5800/0x88da08396ccc7f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7f4f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493362:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838042.493365:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493368:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059f5800/0x88da08396ccc7f48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7f4f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493380:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc7eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7eb5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493386:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc7eae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7eb5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493402:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838042.493406:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493411:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc7eae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7eb5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493426:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4200/0x88da08396ccc7eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7ed1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493433:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4200/0x88da08396ccc7eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7ed1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493438:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838042.493450:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493454:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4200/0x88da08396ccc7eca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7ed1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493466:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4600/0x88da08396ccc7ed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7edf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493472:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4600/0x88da08396ccc7ed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7edf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493478:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838042.493482:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493486:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059f4600/0x88da08396ccc7ed8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7edf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493497:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4000/0x88da08396ccc7f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7f09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493514:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4000/0x88da08396ccc7f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7f09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493519:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838042.493534:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493539:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4000/0x88da08396ccc7f02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7f09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.493548:0:87103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc7f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc7f33 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838042.493554:0:87103:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc7f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc7f33 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838042.493560:0:87103:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838042.493563:0:87103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838042.493565:0:87103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc7f2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc7f33 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788838042.493586:0:87103:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 57, was 0): DISCONN 00000100:00080000:0.0:1788838042.493592:0:87103:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838042.493597:0:87103:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3426 00000100:00080000:0.0:1788838042.493602:0:87103:0:(import.c:589:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838042.493608:0:87103:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838042.493638:0:87103:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63333fb80 x1875729134993536/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838042.493663:0:87103:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1788838042.493751:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729134993536:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788838042.493830:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.493923:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134993536 00000100:00100000:0.0:1788838042.493936:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134993536 00000100:00100000:0.0:1788838042.493971:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788838042.493978:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3642:x1875729134993536:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788838042.494000:0:87110:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo t0 exp 0000000000000000 cur 3436 last 0 00000020:00000080:0.0:1788838042.494028:0:87110:0:(genops.c:1385:class_connect()) connect: client 57943c9a-ca27-46d8-8845-5d2bce640e45, cookie 0x88da08396ccc8315 00000100:00080000:0.0:1788838042.494161:0:87110:0:(import.c:65:import_set_state_nolock()) ffff8ff602d1a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838042.494216:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+5:3642:x1875729134993536:12345-0@lo:250:mount.lustre.0 Request processed in 238us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838042.494225:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788838042.494440:0:3642:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 25 00000100:00080000:3.0:1788838042.494450:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:3.0:1788838042.494456:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788838042.494460:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788838042.494464:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788838042.494466:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788838042.494493:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788838042.494502:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729134993536:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1788838042.494566:0:87103:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1788838042.494575:0:87103:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788838042.494607:0:87103:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788838042.494612:0:87103:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788838042.494727:0:87103:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788838042.494760:0:87103:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788838042.494764:0:87103:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788838042.494766:0:87103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788838042.494767:0:87103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838042.494769:0:87103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838042.494770:0:87103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838042.494771:0:87103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838042.494772:0:87103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838042.494774:0:87103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788838042.494776:0:87103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838042.494777:0:87103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788838042.494779:0:87103:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788838042.494781:0:87103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788838042.494783:0:87103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788838042.494784:0:87103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838042.494785:0:87103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838042.494786:0:87103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838042.494787:0:87103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838042.494788:0:87103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838042.494789:0:87103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788838042.494822:0:87103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838042.494823:0:87103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788838042.494839:0:87103:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788838042.494960:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134993664:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788838042.495001:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.495035:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838042.495091:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134993664 00000100:00100000:3.0:1788838042.495096:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134993664 00000100:00100000:3.0:1788838042.495133:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788838042.495141:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+5:87103:x1875729134993664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788838042.495175:0:87111:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788838042.495178:0:87111:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788838042.495180:0:87111:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1788838042.495186:0:87111:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00080000:1.0:1788838042.495821:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838042.495827:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838042.495830:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838042.495835:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3431 00000100:00080000:1.0:1788838042.495839:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838042.495845:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838042.495868:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61fc28700 x1875729134993792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838042.495911:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838042.495914:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838042.495915:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838042.495919:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3431 00000100:00080000:1.0:1788838042.495921:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838042.495925:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838042.495932:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134993792:0@lo:38:kworker.0 00000100:00100000:1.0:1788838042.495934:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838042.495947:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729134993920:0@lo:400:kworker.0 00000100:00100000:0.0:1788838042.495975:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838042.495998:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.496030:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134993792 00000100:00100000:0.0:1788838042.496035:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134993792 00000100:00100000:1.0:1788838042.496038:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134993920 00000100:00100000:1.0:1788838042.496043:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134993920 00000100:00100000:0.0:1788838042.496062:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1788838042.496069:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134993792:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788838042.496084:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1788838042.496092:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729134993920:12345-0@lo:400:kworker.0 00010000:00020000:0.0:1788838042.496098:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838042.496145:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134993792:12345-0@lo:38:kworker.0 Request processed in 75us (168us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838042.496148:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729134993920:12345-0@lo:400:kworker.0 Request processed in 55us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838042.496157:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00080000:0.0:1788838042.496187:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838042.496191:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838042.496195:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729134993792:0@lo:38:kworker.0 00000100:00080000:2.0:1788838042.496223:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838042.496230:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639c5ea00 x1875729134994048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838042.496253:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134994048:0@lo:38:kworker.0 00000100:00100000:0.0:1788838042.496278:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788838042.496323:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838042.496326:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838042.496328:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838042.496342:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3431 00000100:00080000:0.0:1788838042.496406:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838042.496411:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838042.496427:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff633277100 x1875729134994304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838042.496448:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134994304:0@lo:38:kworker.0 00000100:00100000:0.0:1788838042.496477:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.496507:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134994304 00000100:00100000:0.0:1788838042.496510:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134994304 00000100:00100000:0.0:1788838042.496531:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00100000:0.0:1788838042.496535:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134994304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838042.496546:0:8471:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838042.496577:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134994304:12345-0@lo:38:kworker.0 Request processed in 39us (99us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838042.496583:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00080000:0.0:1788838042.496609:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838042.496613:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838042.496616:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729134994304:0@lo:38:kworker.0 00000100:00080000:0.0:1788838042.496647:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838042.496651:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838042.496652:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838042.496656:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3431 00000100:00080000:0.0:1788838042.496659:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838042.496663:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838042.496671:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134994432:0@lo:400:kworker.0 00000100:00100000:0.0:1788838042.496705:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.496756:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd2d500 x1875729134994560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838042.496775:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134994560:0@lo:38:kworker.0 00000100:00100000:0.0:1788838042.496820:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838042.497127:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134994048 00000100:00100000:2.0:1788838042.497132:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134994048 00000020:01000000:0.0:1788838042.497171:0:63434:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.130@tcp 10000000:01000000:0.0:1788838042.497185:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1788838042.497188:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788838042.497190:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788838042.497191:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838042.497193:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838042.497194:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838042.497195:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838042.497197:0:63434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788838042.497199:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838042.497201:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788838042.497227:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788838042.497233:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788838042.497235:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788838042.497236:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788838042.497238:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838042.497239:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838042.497240:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838042.497241:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838042.497242:0:63434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788838042.497243:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838042.497244:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788838042.497252:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134994688:0@lo:253:kworker.0 00000100:00100000:0.0:1788838042.497289:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788838042.497336:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788838042.497341:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788838042.497343:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788838042.497355:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788838042.497356:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838042.497364:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838042.497365:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838042.497366:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838042.497367:0:63434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838042.497368:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838042.497369:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788838042.497381:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788838042.497406:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134994688 00000100:00100000:0.0:1788838042.497410:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134994688 00000100:00100000:0.0:1788838042.497439:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788838042.497446:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff507117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+6:3644:x1875729134994688:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788838042.497465:0:87110:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788838042.497479:0:87110:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788838042.497594:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff633275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134994176:0@lo:400:kworker.0 00000100:00100000:0.0:1788838042.497620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.497639:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134994944:0@lo:253:kworker.0 00000100:00100000:0.0:1788838042.497664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.497689:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729134993920:0@lo:400:kworker.0 00000100:00100000:0.0:1788838042.497703:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838042.497707:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134994816:0@lo:253:kworker.0 00000100:00100000:0.0:1788838042.497744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.497763:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134994560 00000100:00100000:0.0:1788838042.497766:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134994560 00000100:00100000:3.0:1788838042.497915:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134994176 00000100:00100000:3.0:1788838042.497920:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134994176 00000100:00100000:1.0:1788838042.504264:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1788838042.504407:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1788838042.504417:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134994048:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838042.504443:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838042.504538:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134994048:12345-0@lo:38:kworker.0 Request processed in 120us (8258us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838042.504545:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00080000:2.0:1788838042.504575:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838042.504972:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838042.504980:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838042.504986:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729134994048:0@lo:38:kworker.0 00000100:00100000:0.0:1788838042.505011:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:0.0:1788838042.505021:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134994560:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838042.505036:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838042.505085:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729134994560:12345-0@lo:38:kworker.0 Request processed in 64us (8287us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838042.505091:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00080000:0.0:1788838042.505131:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838042.505136:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838042.505139:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729134994560:0@lo:38:kworker.0 00000100:00100000:0.0:1788838042.505168:0:87108:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788838042.505177:0:87108:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1788838042.505317:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134994944 00000100:00100000:0.0:1788838042.505325:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134994944 00000100:00100000:0.0:1788838042.505737:0:87108:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788838042.505748:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134994816 00000100:00100000:0.0:1788838042.505752:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134994816 00000100:00100000:0.0:1788838042.505933:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788838042.505942:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff507114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3646:x1875729134994944:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788838042.505974:0:87114:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1788838042.506529:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134994432 00000100:00100000:1.0:1788838042.506538:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134994432 00000100:00100000:1.0:1788838042.506586:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469 00000100:00100000:1.0:1788838042.506595:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134994432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838042.506679:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729134994432:12345-0@lo:400:kworker.0 Request processed in 85us (9972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838042.506687:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469 00000100:00100000:1.0:1788838042.506751:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729134994432:0@lo:400:kworker.0 00000100:00100000:3.0:1788838042.508313:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1788838042.508334:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134994176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838042.508434:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729134994176:12345-0@lo:400:kworker.0 Request processed in 110us (10812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.508441:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1788838042.508543:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff633275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729134994176:0@lo:400:kworker.0 20000000:01000000:3.0:1788838042.515320:0:87110:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788838042.515333:0:87110:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788838042.515527:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:87103:x1875729134993664:12345-0@lo:253:mount.lustre.0 Request processed in 20383us (20522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.515540:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788838042.515604:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff507117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+7:3644:x1875729134994688:12345-0@lo:253:kworker.0 Request processed in 18159us (18314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.515628:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 20000000:01000000:2.0:1788838042.515689:0:87112:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788838042.515694:0:87112:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788838042.515724:0:87112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.515743:0:87112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff607461800/0x88da08396ccc82f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc1a expref: 9 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.515750:0:87112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.515786:0:87112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff607461800/0x88da08396ccc82f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc1a expref: 9 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.515829:0:87112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff607461800/0x88da08396ccc82f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc1a expref: 9 pid: 87111 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838042.515844:0:87112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87112:1875729134995072:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788838042.516786:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788838042.516821:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff507117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+6:3646:x1875729134994816:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788838042.517578:0:87110:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788838042.517599:0:87110:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788838042.517847:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134993664:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788838042.517923:0:87103:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788838042.517926:0:87103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788838042.517928:0:87103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838042.517929:0:87103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838042.517930:0:87103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838042.517932:0:87103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838042.517933:0:87103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838042.517934:0:87103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838042.517935:0:87103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838042.517937:0:87103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838042.517939:0:87103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788838042.517961:0:87103:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff605444800 from lustre-MDT0000 10000000:01000000:3.0:1788838042.517991:0:87103:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788838042.517994:0:87103:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788838042.518003:0:87103:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ff605444800 10000000:01000000:3.0:1788838042.518007:0:87103:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788838042.518013:0:87103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ff605444800 10000000:01000000:3.0:1788838042.518016:0:87103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788838042.518019:0:87103:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff605444800 from 1 10000000:01000000:3.0:1788838042.518022:0:87103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788838042.518056:0:87103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.518067:0:87103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.518229:0:87103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838042.518253:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134995200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838042.518324:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838042.518433:0:87112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a2c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838042.518994:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff627f0af00 going to sleep for 11 seconds 00000020:01000004:2.0:1788838042.519165:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788838042.519169:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788838042.519170:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838042.519172:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838042.519173:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838042.519174:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838042.519175:0:3644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838042.519177:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838042.519178:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788838042.519252:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729134994688:0@lo:253:kworker.0 00000100:00100000:2.0:1788838042.519301:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134995200 00000100:00100000:2.0:1788838042.519307:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134995200 00000100:00100000:2.0:1788838042.519449:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788838042.519460:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff507114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+7:87103:x1875729134995200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838042.519475:0:87111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838042.519494:0:87111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5e600/0x88da08396ccc832a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8323 expref: -99 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.519517:0:87111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5e600/0x88da08396ccc832a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8323 expref: 8 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.519528:0:87111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5e600/0x88da08396ccc832a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8323 expref: 8 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.519536:0:87111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5e600, rc 0) 00000100:00100000:2.0:1788838042.519590:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff507114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:87103:x1875729134995200:12345-0@lo:101:mount.lustre.0 Request processed in 132us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838042.519597:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788838042.519646:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134995200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838042.519660:0:87103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.519668:0:87103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838042.519683:0:87103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788838042.519695:0:87103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.519719:0:87103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838042.519728:0:87103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788838042.519732:0:87103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788838042.519737:0:87103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ff605444800 10000000:01000000:2.0:1788838042.519739:0:87103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788838042.519743:0:87103:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788838042.519745:0:87103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788838042.519766:0:87103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.519773:0:87103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.519781:0:87103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838042.519819:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134995328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838042.525057:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838042.525142:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a2c70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838042.525362:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838042.525472:0:87112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87112:1875729134995072:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788838042.525506:0:87112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838042.525641:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116390912 00000100:00100000:1.0:1788838042.525651:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116390912 00010000:00010000:1.0:1788838042.525691:0:10364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff607461800/0x88da08396ccc82f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc1a expref: 10 pid: 87111 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838042.525745:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2539 00000100:00100000:1.0:1788838042.525755:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116390912:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838042.525771:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838042.525777:0:10364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff607461800/0x88da08396ccc82f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc1a expref: 10 pid: 87111 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525790:0:10364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff607461800/0x88da08396ccc82f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc1a expref: 10 pid: 87111 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525830:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607461800/0x88da08396ccc82f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc1a expref: 10 pid: 87111 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525851:0:10364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525876:0:10364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788838042.525893:0:10364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010199555s 00010000:00010000:1.0:1788838042.525898:0:10364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525905:0:10364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525911:0:10364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525917:0:10364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525923:0:10364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838042.525926:0:10364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525933:0:10364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525952:0:10364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.525960:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838042.526012:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4043f878-3455-4729-a2a8-e06e8394cc00+9:2404:x1875729116390912:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 257us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838042.526020:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2539 00000100:00100000:0.0:1788838042.526596:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134995328 00000100:00100000:0.0:1788838042.526604:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134995328 00000100:00100000:0.0:1788838042.526663:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788838042.526671:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:87103:x1875729134995328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838042.526686:0:87111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838042.526717:0:87111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc8338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8331 expref: -99 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.526743:0:87111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc8338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8331 expref: 9 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.526754:0:87111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc8338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8331 expref: 9 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.526762:0:87111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8200, rc 0) 00000100:00100000:0.0:1788838042.526841:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:87103:x1875729134995328:12345-0@lo:101:mount.lustre.0 Request processed in 171us (6990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838042.526848:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788838042.526896:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134995328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838042.526914:0:87103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.526922:0:87103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838042.527002:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134995456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838042.527034:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.527066:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549f00 going to sleep for 11 seconds 00010000:00010000:2.0:1788838042.527194:0:87112:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.527213:0:87112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.527219:0:87112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc831c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838042.527561:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134995456 00000100:00100000:1.0:1788838042.527567:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134995456 00000100:00100000:1.0:1788838042.527608:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788838042.527616:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:87103:x1875729134995456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838042.527866:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87103:x1875729134995456:12345-0@lo:501:mount.lustre.0 Request processed in 155us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838042.527875:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788838042.528040:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134995456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838042.528078:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134995584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838042.528120:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.528195:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549f00 going to sleep for 11 seconds 20000000:01000000:3.0:1788838042.528499:0:87110:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788838042.528516:0:87110:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788838042.528867:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff507117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:3646:x1875729134994816:12345-0@lo:253:kworker.0 Request processed in 12068us (31120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.528876:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788838042.528906:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134995584 00000100:00100000:3.0:1788838042.528911:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134995584 20000000:01000000:0.0:1788838042.529000:0:87112:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788838042.529006:0:87112:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788838042.529025:0:87112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.529039:0:87112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788838042.529049:0:87112:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010199555s 00010000:00010000:0.0:1788838042.529053:0:87112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.529074:0:87112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.529080:0:87112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.529102:0:87112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.529109:0:87112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838042.529114:0:87112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.529122:0:87112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.529136:0:87112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.529143:0:87112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.529149:0:87112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc833f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788838042.529407:0:87114:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:2.0:1788838042.529915:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788838042.529918:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838042.529920:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838042.529921:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838042.529922:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838042.529923:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838042.529925:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838042.529926:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838042.529927:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788838042.529932:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134994816:0@lo:253:kworker.0 00000100:00100000:3.0:1788838042.533658:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788838042.533686:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:87103:x1875729134995584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838042.534954:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:87103:x1875729134995584:12345-0@lo:503:mount.lustre.0 Request processed in 1274us (6824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.534967:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788838042.535193:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134995584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838042.535545:0:87115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87115:1875729134995712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838042.535596:0:87115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.537484:0:87115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838042.538570:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134995712 00000100:00100000:2.0:1788838042.538582:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134995712 00000100:00100000:2.0:1788838042.538728:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788838042.538739:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:87115:x1875729134995712:12345-0@lo:502:llog_process_th.0 20000000:01000000:0.0:1788838042.540500:0:87114:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788838042.540513:0:87114:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788838042.540527:0:87112:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788838042.540530:0:87112:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788838042.540553:0:87112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.540569:0:87112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788838042.540579:0:87112:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010199555s 00010000:00010000:0.0:1788838042.540585:0:87112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.540666:0:87112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.540674:0:87112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.540681:0:87112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.540688:0:87112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838042.540692:0:87112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.540701:0:87112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.540731:0:87112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.540759:0:87112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.540766:0:87112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9400/0x88da08396ccc8346 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838042.541315:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff507114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+9:3646:x1875729134994944:12345-0@lo:253:kworker.0 Request processed in 35370us (43645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838042.541327:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:2.0:1788838042.541468:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788838042.541472:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788838042.541473:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838042.541474:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838042.541476:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838042.541477:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838042.541478:0:3646:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838042.541480:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838042.541481:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788838042.541485:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134994944:0@lo:253:kworker.0 00000100:00100000:2.0:1788838042.542051:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:87115:x1875729134995712:12345-0@lo:502:llog_process_th.0 Request processed in 3313us (6454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838042.542067:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788838042.542449:0:87115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87115:1875729134995712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788838042.542567:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838042.542579:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838042.542581:0:87115:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788838042.542586:0:87115:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788838042.542659:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838042.542675:0:87115:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ff639560000) 00000020:00000080:1.0:1788838042.542699:0:87115:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1788838042.542705:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788838042.542832:0:87115:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788838042.542840:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8354 00000020:00000080:1.0:1788838042.543174:0:87115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788838042.543180:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838042.543184:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838042.543254:0:87115:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788838042.543258:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838042.543263:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838042.543264:0:87115:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788838042.543268:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838042.543276:0:87115:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ff6395619b8) 00000020:00000080:1.0:1788838042.543289:0:87115:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1788838042.543292:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788838042.543294:0:87115:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788838042.543297:0:87115:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788838042.543303:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788838042.543360:0:87115:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff605444800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788838042.543375:0:87115:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ff608224d28) 00000020:00000080:1.0:1788838042.543385:0:87115:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1788838042.543442:0:87115:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788838042.543448:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8369 00000020:00000080:1.0:1788838042.543539:0:87115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788838042.543546:0:87115:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788838042.543550:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88da08396ccc8370 00080000:01000000:1.0:1788838042.543555:0:87115:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788838042.543558:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8377 00010000:00010000:3.0:1788838042.557239:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838042.647378:0:87115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1788838042.647552:0:87115:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: fdcf066d-ff07-4b2e-96ab-52415ed6bf72 idx: 0 lr: 98784247815 srv lr: 103079215104 lx: 0 gen 23 00000001:00080000:0.0:1788838042.647596:0:87115:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 22 00000001:00000004:0.0:1788838042.647623:0:87115:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:0.0:1788838042.647739:0:87115:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788838042.648031:0:87115:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff639549300: xid 1875729116382336, transno 103079215108, client gen 23, slot idx 0 00000001:00080000:0.0:1788838042.648045:0:87115:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff6395499c0: xid 1875729116382080, transno 103079215107, client gen 23, slot idx 1 00000020:00000080:0.0:1788838042.650124:0:87115:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ff624ff19b8) 00000020:00000080:0.0:1788838042.650150:0:87115:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1788838042.651018:0:87115:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788838042.651027:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8393 00000020:00000080:0.0:1788838042.655460:0:87115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788838042.659148:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88da08396ccc839a 00000020:00000080:0.0:1788838042.659629:0:87115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788838042.659641:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838042.659647:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.659649:0:87115:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788838042.659659:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838042.659661:0:87115:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788838042.659663:0:87115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838042.659665:0:87115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838042.659666:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838042.659669:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.659671:0:87115:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838042.659673:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838042.659678:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.659679:0:87115:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788838042.659683:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788838042.659734:0:87115:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788838042.659751:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838042.659754:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.659755:0:87115:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788838042.659758:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838042.659761:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.659762:0:87115:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788838042.659765:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838042.659979:0:87115:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:0.0:1788838042.660004:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838042.660018:0:87115:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ff624ff3370) 00000020:00000080:0.0:1788838042.660035:0:87115:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788838042.660039:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838042.660097:0:87115:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788838042.660101:0:87115:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788838042.660106:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc83a8 00010000:00080000:0.0:1788838042.660132:0:87115:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff627d59000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788838042.665147:0:87115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788838042.666059:0:87115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788838042.666076:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788838042.666119:0:87115:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788838042.666146:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc83af 00000100:00080000:3.0:1788838042.666157:0:87115:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838042.666163:0:87115:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ff627d59000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838042.666216:0:87115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6270bdc00 x1875729134995840/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838042.666251:0:87115:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788838042.666317:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838042.666321:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838042.666323:0:87115:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788838042.666326:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788838042.666330:0:87115:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788838042.666332:0:87115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788838042.666334:0:87115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788838042.666336:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788838042.666339:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838042.666340:0:87115:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788838042.666343:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788838042.666350:0:87115:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788838042.666353:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838042.666355:0:87115:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788838042.666358:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788838042.666362:0:87115:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1788838042.666391:0:87115:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788838042.666394:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788838042.666408:0:87115:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ff6271ccd28) 00000020:00000080:3.0:1788838042.666426:0:87115:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788838042.666431:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788838042.666503:0:87115:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788838042.666510:0:87115:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788838042.666515:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc83bd 00010000:00080000:3.0:1788838042.666546:0:87115:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff5036b5800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788838042.666766:0:87115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1788838042.667505:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134995840:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838042.667588:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.667895:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134995840 00000100:00100000:3.0:1788838042.667903:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134995840 00000100:00100000:3.0:1788838042.667941:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00100000:3.0:1788838042.667949:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729134995840:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788838042.667984:0:37907:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3436 last 0 00000020:00000080:3.0:1788838042.668017:0:37907:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc83c4 00000004:00100000:3.0:1788838042.668030:0:37907:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838042.668111:0:37907:0:(import.c:65:import_set_state_nolock()) ffff8ff62cead800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838042.668162:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729134995840:12345-0@lo:38:llog_process_th.0 Request processed in 213us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.668170:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00100000:3.0:1788838042.668373:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838042.668383:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1788838042.668391:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788838042.668396:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788838042.668398:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff627d59000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788838042.668438:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134995840:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838042.672924:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134995968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838042.673014:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.673073:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134995968 00000100:00100000:3.0:1788838042.673081:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134995968 00000100:00100000:3.0:1788838042.673123:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:3.0:1788838042.673133:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729134995968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838042.673172:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838042.673571:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729134995968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 438us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.673579:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00100000:2.0:1788838042.673678:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134995968:0@lo:41:osp-pre-1-0.0 00000040:01000000:0.0:1788838042.673938:0:87115:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788838042.673965:0:87115:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788838042.674056:0:87115:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:0.0:1788838042.675134:0:87115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838042.675161:0:87115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:0.0:1788838042.675301:0:87115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:3.0:1788838042.675885:0:87121:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:3.0:1788838042.675891:0:87121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788838042.676038:0:87121:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1788838042.676055:0:87121:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788838042.676175:0:87121:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:3.0:1788838042.676179:0:87121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788838042.678131:0:87115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838042.678146:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788838042.678254:0:87115:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788838042.678280:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc83cb 00000100:00080000:0.0:1788838042.678291:0:87115:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788838042.678296:0:87115:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff5036b5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838042.678335:0:87115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a89500 x1875729134996096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838042.678392:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134996096:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788838042.678470:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788838042.678539:0:87115:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788838042.678604:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838042.678608:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.678610:0:87115:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788838042.678613:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838042.678616:0:87115:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788838042.678617:0:87115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838042.678619:0:87115:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838042.678620:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838042.678623:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.678624:0:87115:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838042.678627:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788838042.678631:0:87115:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788838042.678635:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.678636:0:87115:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788838042.678639:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838042.678643:0:87115:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1788838042.678663:0:87115:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788838042.678666:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838042.678688:0:87115:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ff503ca4d28) 00000020:00000080:0.0:1788838042.678704:0:87115:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788838042.678720:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838042.678788:0:87115:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788838042.678794:0:87115:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788838042.678817:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc83d9 00010000:00080000:0.0:1788838042.678844:0:87115:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff5036b3000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00000100:00100000:2.0:1788838042.678996:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134996096 00000100:00100000:2.0:1788838042.679003:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134996096 00000100:00100000:2.0:1788838042.679032:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5927 00000100:00100000:2.0:1788838042.679040:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3642:x1875729134996096:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788838042.679066:0:26206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3436 last 0 00000020:00000080:2.0:1788838042.679101:0:26206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc83e0 00002000:00100000:2.0:1788838042.679117:0:26206:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ff611a89000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788838042.679122:0:26206:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788838042.679125:0:26206:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788838042.679212:0:26206:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788838042.679233:0:26206:0:(import.c:65:import_set_state_nolock()) ffff8ff509c61000 : changing import state from RECOVER to FULL 00010000:00010000:0.0:1788838042.679573:0:87115:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1788838042.679636:0:87115:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788838042.679649:0:87115:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788838042.679751:0:87115:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:0.0:1788838042.681075:0:87115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838042.681106:0:87115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:0.0:1788838042.681391:0:87115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000100:00100000:2.0:1788838042.682402:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729134996096:12345-0@lo:8:llog_process_th.0 Request processed in 3353us (3923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838042.682417:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5927 00000100:00100000:3.0:1788838042.682439:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838042.682453:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788838042.682463:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788838042.682469:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788838042.682474:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5036b5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788838042.682488:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788838042.682496:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134996096:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1788838042.682502:0:87121:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788838042.682575:0:87121:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3436701776635ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788838042.682582:0:87121:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788838042.682670:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838042.682682:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134996224:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788838042.682733:0:87123:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:0.0:1788838042.682737:0:87123:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788838042.682747:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.682783:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134996224 00000100:00100000:3.0:1788838042.682788:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134996224 00000100:00100000:3.0:1788838042.682851:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:3.0:1788838042.682862:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729134996224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838042.682882:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838042.682931:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729134996224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.682938:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00080000:3.0:1788838042.682956:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838042.683015:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729134996224:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788838042.683268:0:87123:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000020:00000080:0.0:1788838042.684209:0:87115:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838042.684221:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788838042.684259:0:87115:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788838042.684281:0:87115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc83e7 00000100:00080000:0.0:1788838042.684289:0:87115:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788838042.684294:0:87115:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ff5036b3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838042.684454:0:87115:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a8ad80 x1875729134996352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838042.684507:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134996352:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788838042.684578:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788838042.684629:0:87115:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788838042.684682:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838042.684687:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.684689:0:87115:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788838042.684692:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838042.684702:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.684704:0:87115:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788838042.684721:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788838042.684723:0:87115:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788838042.684725:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838042.684728:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.684729:0:87115:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788838042.684731:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838042.684733:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.684734:0:87115:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788838042.684738:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788838042.684767:0:87115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87115:1875729134996480:0@lo:502:llog_process_th.0 00000004:00080000:1.0:1788838042.684846:0:87104:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788838042.684862:0:87115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.684895:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134996480 00000100:00100000:0.0:1788838042.684901:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134996480 00000100:00100000:0.0:1788838042.684947:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788838042.684957:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+8:87115:x1875729134996480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838042.685071:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+8:87115:x1875729134996480:12345-0@lo:502:llog_process_th.0 Request processed in 114us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838042.685078:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788838042.685120:0:87115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff637f4a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838042.685140:0:87115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87115:1875729134996480:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788838042.685149:0:87123:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000020:01000000:0.0:1788838042.685160:0:87115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838042.685163:0:87115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838042.685165:0:87115:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788838042.685168:0:87115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788838042.685266:0:87103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788838042.685295:0:87103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788838042.685354:0:87103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.685367:0:87103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838042.685375:0:87103:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff605444800 from 1 10000000:01000000:1.0:1788838042.685378:0:87103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788838042.685408:0:87103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.685416:0:87103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838042.685422:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134996352 00000100:00100000:3.0:1788838042.685426:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134996352 00010000:00010000:1.0:1788838042.685427:0:87103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838042.685440:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134996608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838042.685451:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5928 00000100:00100000:3.0:1788838042.685456:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875729134996352:12345-0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788838042.685475:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788838042.685477:0:8460:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3436 last 0 00000100:00100000:1.0:1788838042.685494:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a48de40 going to sleep for 11 seconds 00000020:00000080:3.0:1788838042.685500:0:8460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc83f5 00002000:00100000:3.0:1788838042.685513:0:8460:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ff509c76800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788838042.685517:0:8460:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788838042.685520:0:8460:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788838042.685539:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134996608 00000100:00100000:2.0:1788838042.685543:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134996608 00002000:00080000:3.0:1788838042.685571:0:8460:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1788838042.685580:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838042.685585:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:87103:x1875729134996608:12345-0@lo:101:mount.lustre.0 00000100:00080000:3.0:1788838042.685593:0:8460:0:(import.c:65:import_set_state_nolock()) ffff8ff509c75000 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1788838042.685593:0:87111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838042.685605:0:87111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc83fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc83ee expref: -99 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.685624:0:87111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc83fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc83ee expref: 9 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838042.685629:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729134996352:12345-0@lo:8:llog_process_th.0 Request processed in 173us (1052us total) trans 0 rc 0/0 00010000:00010000:2.0:1788838042.685634:0:87111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc83fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc83ee expref: 9 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838042.685636:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5928 00010000:00010000:2.0:1788838042.685643:0:87111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5f600, rc 0) 00000100:00100000:3.0:1788838042.685665:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838042.685672:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:2.0:1788838042.685674:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:87103:x1875729134996608:12345-0@lo:101:mount.lustre.0 Request processed in 89us (199us total) trans 0 rc 0/0 00000100:00080000:3.0:1788838042.685678:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:2.0:1788838042.685680:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788838042.685683:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788838042.685685:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5036b3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788838042.685689:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788838042.685693:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729134996352:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788838042.685722:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134996608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838042.685734:0:87103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.685743:0:87103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838042.685754:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838042.685761:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134996736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838042.685787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.685829:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134996736 00000100:00100000:3.0:1788838042.685837:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134996736 00000100:00100000:3.0:1788838042.685868:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:3.0:1788838042.685873:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729134996736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838042.685886:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838042.685920:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729134996736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.685927:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00080000:3.0:1788838042.685942:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838042.685970:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729134996736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838042.687053:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134996864:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788838042.687112:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838042.687157:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608fd5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838042.687232:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134996864 00000100:00100000:0.0:1788838042.687238:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134996864 00000040:00080000:3.0:1788838042.687275:0:87123:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:3.0:1788838042.687280:0:87123:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788838042.687280:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788838042.687289:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+9:87103:x1875729134996864:12345-0@lo:256:mount.lustre.0 00000004:00080000:3.0:1788838042.687305:0:87123:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 20000000:01000000:0.0:1788838042.687330:0:87114:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788838042.687348:0:87114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788838042.687352:0:87114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788838042.687355:0:87114:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788838042.687357:0:87114:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 112 00000004:00080000:3.0:1788838042.687362:0:87123:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3436706564287ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788838042.687368:0:87123:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788838042.687440:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+9:87103:x1875729134996864:12345-0@lo:256:mount.lustre.0 Request processed in 151us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838042.687448:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788838042.689013:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134996864:0@lo:256:mount.lustre.0 00000004:00080000:1.0:1788838042.690033:0:87104:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:3.0:1788838042.690111:0:87103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788838042.690128:0:87103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.690141:0:87103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838042.690149:0:87103:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff605444800 from 1 10000000:01000000:3.0:1788838042.690152:0:87103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838042.690194:0:87103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.690199:0:87103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.690218:0:87103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838042.690235:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134996992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838042.690284:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.690315:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a31a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838042.690390:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134996992 00000100:00100000:2.0:1788838042.690396:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134996992 00000100:00100000:2.0:1788838042.690439:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788838042.690448:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:87103:x1875729134996992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838042.690461:0:87111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838042.690474:0:87111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5fe00/0x88da08396ccc840a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8403 expref: -99 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.690494:0:87111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5fe00/0x88da08396ccc840a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8403 expref: 10 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.690502:0:87111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5fe00/0x88da08396ccc840a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8403 expref: 10 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838042.690508:0:87111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5fe00, rc 0) 00000100:00100000:2.0:1788838042.690568:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87103:x1875729134996992:12345-0@lo:101:mount.lustre.0 Request processed in 122us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838042.690573:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788838042.690629:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134996992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838042.690638:0:87103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.690645:0:87103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838042.690695:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134997120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838042.690735:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.690757:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a31a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838042.691254:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134997120 00000100:00100000:1.0:1788838042.691262:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134997120 00000100:00100000:1.0:1788838042.691475:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788838042.691485:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87103:x1875729134997120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838042.691613:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87103:x1875729134997120:12345-0@lo:501:mount.lustre.0 Request processed in 129us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838042.691621:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788838042.691698:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134997120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838042.691762:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134997248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838042.691844:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.691868:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a31a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838042.691993:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134997248 00000100:00100000:1.0:1788838042.691998:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134997248 00000100:00100000:1.0:1788838042.692030:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788838042.692036:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87103:x1875729134997248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838042.692123:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87103:x1875729134997248:12345-0@lo:503:mount.lustre.0 Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838042.692130:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788838042.692215:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134997248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838042.693056:0:87125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87125:1875729134997376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838042.693102:0:87125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838042.693130:0:87125:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608fd5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788838042.693334:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134997376 00000100:00100000:0.0:1788838042.693340:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134997376 00000100:00100000:0.0:1788838042.693384:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788838042.693392:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87125:x1875729134997376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838042.694279:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87125:x1875729134997376:12345-0@lo:502:llog_process_th.0 Request processed in 884us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838042.694291:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788838042.694430:0:87125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87125:1875729134997376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838042.694469:0:87125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838042.694480:0:87125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838042.694482:0:87125:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788838042.694490:0:87125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff605444800 00000020:00000080:2.0:1788838042.694492:0:87125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788838042.694502:0:87125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838042.694504:0:87125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838042.694505:0:87125:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788838042.694507:0:87125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838042.694519:0:87125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838042.694520:0:87125:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788838042.694524:0:87125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff605444800 00000020:00000080:2.0:1788838042.694526:0:87125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788838042.694674:0:87125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87125:1875729134997504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838042.694731:0:87125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838042.694786:0:87125:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608fd5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788838042.695284:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134997504 00000100:00100000:3.0:1788838042.695294:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134997504 00000100:00100000:3.0:1788838042.695494:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788838042.695503:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87125:x1875729134997504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838042.695644:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87125:x1875729134997504:12345-0@lo:502:llog_process_th.0 Request processed in 141us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.695651:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788838042.695844:0:87125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d29180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87125:1875729134997504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838042.695895:0:87125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838042.695902:0:87125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838042.695904:0:87125:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788838042.695908:0:87125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788838042.696343:0:87103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788838042.696371:0:87103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788838042.696471:0:87103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.696483:0:87103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838042.696542:0:87103:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788838042.696545:0:87103:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ff605444800 10000000:01000000:3.0:1788838042.696548:0:87103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ff605444800 10000000:01000000:3.0:1788838042.696552:0:87103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788838042.696557:0:87103:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff605444800 from 1 10000000:01000000:3.0:1788838042.696560:0:87103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788838042.696591:0:87103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.696599:0:87103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.696609:0:87103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838042.696627:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134997632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838042.696670:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.696705:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a31ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838042.696740:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134997632 00000100:00100000:3.0:1788838042.696746:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134997632 00000100:00100000:3.0:1788838042.696786:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788838042.696794:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:87103:x1875729134997632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838042.696823:0:87108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838042.696835:0:87108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff600030200/0x88da08396ccc8418 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8411 expref: -99 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.696869:0:87108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600030200/0x88da08396ccc8418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8411 expref: 11 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.696999:0:87108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff600030200/0x88da08396ccc8418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8411 expref: 11 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.697009:0:87108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030200, rc 0) 00000100:00100000:3.0:1788838042.697045:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87103:x1875729134997632:12345-0@lo:101:mount.lustre.0 Request processed in 252us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.697052:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788838042.697089:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134997632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838042.697101:0:87103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.697110:0:87103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838042.697161:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134997760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838042.697255:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838042.697278:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134997760 00000100:00100000:3.0:1788838042.697279:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a31ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838042.697283:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134997760 00000100:00100000:1.0:1788838042.697531:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788838042.697541:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87103:x1875729134997760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838042.697655:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87103:x1875729134997760:12345-0@lo:501:mount.lustre.0 Request processed in 116us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838042.697661:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788838042.701120:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134997760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838042.701208:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134997888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838042.701281:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.701331:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a31ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838042.703504:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134997888 00000100:00100000:1.0:1788838042.703519:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134997888 00000100:00100000:1.0:1788838042.703585:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788838042.703601:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87103:x1875729134997888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838042.703818:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87103:x1875729134997888:12345-0@lo:503:mount.lustre.0 Request processed in 218us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838042.703828:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788838042.704223:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134997888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838042.710992:0:87127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87127:1875729134998016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838042.711093:0:87127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.711139:0:87127:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff61836acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838042.711404:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134998016 00000100:00100000:1.0:1788838042.711414:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134998016 00000100:00100000:1.0:1788838042.711490:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788838042.711501:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87127:x1875729134998016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838042.711642:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87127:x1875729134998016:12345-0@lo:502:llog_process_th.0 Request processed in 142us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838042.711649:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788838042.712950:0:87127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87127:1875729134998016:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788838042.713029:0:87127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788838042.713045:0:87127:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ff503ca0000) 00000020:00000080:0.0:1788838042.713072:0:87127:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788838042.713172:0:87127:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff605444800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788838042.713176:0:87127:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff605444800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788838042.713179:0:87127:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff605444800 4 00010000:00080000:0.0:1788838042.713994:0:87127:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff6104de800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788838042.717591:0:87127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1788838042.717963:0:87127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788838042.718023:0:87127:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788838042.718039:0:87127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88da08396ccc8426 00000100:00080000:0.0:1788838042.718053:0:87127:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788838042.718060:0:87127:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff6104de800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838042.718101:0:87127:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a88000 x1875729134998144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838042.718130:0:87127:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788838042.719226:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729134998144:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788838042.719311:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838042.719387:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134998144 00000100:00100000:2.0:1788838042.719394:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134998144 00000100:00100000:2.0:1788838042.719433:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1788838042.719441:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134998144:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788838042.719507:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729134998144:12345-0@lo:38:llog_process_th.0 Request processed in 65us (196us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788838042.719514:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1788838042.719559:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788838042.719567:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6104de800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838042.719571:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788838042.719575:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729134998144:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838042.721603:0:87127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87127:1875729134998272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838042.721679:0:87127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.721726:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134998272 00000100:00100000:0.0:1788838042.721732:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134998272 00000100:00100000:0.0:1788838042.721781:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788838042.721789:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87127:x1875729134998272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838042.722118:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87127:x1875729134998272:12345-0@lo:502:llog_process_th.0 Request processed in 327us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838042.722127:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788838042.722278:0:87127:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff61836acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838042.722304:0:87127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87127:1875729134998272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838042.722354:0:87127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87127:1875729134998400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838042.722390:0:87127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.722418:0:87127:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838042.722515:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134998400 00000100:00100000:1.0:1788838042.722519:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134998400 00000100:00100000:1.0:1788838042.722548:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788838042.722556:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87127:x1875729134998400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838042.722624:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87127:x1875729134998400:12345-0@lo:502:llog_process_th.0 Request processed in 69us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838042.722631:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788838042.723143:0:87127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:87127:1875729134998400:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788838042.723170:0:87127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788838042.723431:0:87103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788838042.723473:0:87103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788838042.723494:0:87103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838042.723506:0:87103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788838042.723563:0:87103:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788838042.723566:0:87103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838042.723567:0:87103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838042.723568:0:87103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838042.723569:0:87103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838042.723571:0:87103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838042.723572:0:87103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838042.723573:0:87103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838042.723575:0:87103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838042.723576:0:87103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788838042.723580:0:87103:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788838042.723582:0:87103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788838042.723584:0:87103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838042.723585:0:87103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838042.723585:0:87103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838042.723587:0:87103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838042.723588:0:87103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838042.723589:0:87103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838042.723590:0:87103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838042.723591:0:87103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838042.723596:0:87103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788838042.723617:0:87103:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788838042.723630:0:87103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134998528:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788838042.723676:0:87103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838042.723705:0:87103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a31a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788838042.723737:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134998528 00000100:00100000:3.0:1788838042.723742:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134998528 00000100:00100000:3.0:1788838042.723778:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788838042.723786:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87103:x1875729134998528:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788838042.723842:0:87108:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788838042.723857:0:87108:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788838042.735265:0:87108:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788838042.735313:0:87108:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788838042.737998:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:87103:x1875729134998528:12345-0@lo:253:mount.lustre.0 Request processed in 14205us (14314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838042.738012:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788838042.738078:0:87103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:87103:1875729134998528:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788838042.738092:0:87103:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788838042.738095:0:87103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788838042.738097:0:87103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838042.738098:0:87103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838042.738099:0:87103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838042.738100:0:87103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838042.738101:0:87103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838042.738102:0:87103:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838042.738103:0:87103:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838042.738104:0:87103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838042.738106:0:87103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788838042.738123:0:87103:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788838042.746688:0:87112:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788838042.746724:0:87112:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788838042.747396:0:87112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.747416:0:87112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc83fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc83ee expref: 10 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.747424:0:87112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.747468:0:87112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc83fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc83ee expref: 10 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.747491:0:87112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc83fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc83ee expref: 10 pid: 87111 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838042.747507:0:87112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87112:1875729134998656:0@lo:104: 00000100:00100000:1.0:1788838042.747572:0:87112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838042.747615:0:87112:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6190abe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838042.747640:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134998656 00000100:00100000:1.0:1788838042.747646:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134998656 00000100:00100000:1.0:1788838042.747689:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788838042.747697:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:87112:x1875729134998656:12345-0@lo:104: 00010000:00010000:1.0:1788838042.747720:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.747789:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788838042.747816:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:87112:x1875729134998656:12345-0@lo:104: Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838042.747824:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00010000:1.0:1788838042.747846:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838042.747851:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.747860:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461800 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838042.747864:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.747872:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838042.747890:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838042.747896:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838042.747922:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.747928:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838042.747945:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.747952:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607461800/0x88da08396ccc83ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc83fc expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838042.747973:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838042.747975:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838042.747976:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838042.747987:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134998784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838042.748019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.748888:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134998784 00000100:00100000:0.0:1788838042.748897:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134998784 00010000:00010000:0.0:1788838042.748931:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc83fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc83ee expref: 11 pid: 87111 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838042.749000:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1788838042.749010:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:3646:x1875729134998784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838042.749024:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838042.749028:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc83fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc83ee expref: 11 pid: 87111 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749040:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc83fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc83ee expref: 11 pid: 87111 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749063:0:6532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749071:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788838042.749089:0:6532:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010199555s 00010000:00010000:0.0:1788838042.749094:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749101:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749109:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749115:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749133:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838042.749138:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749146:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749156:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749167:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838042.749241:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:3646:x1875729134998784:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838042.749248:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1788838042.749300:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729134998784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838042.749335:0:87112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc83fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc83ee expref: 10 pid: 87111 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838042.749346:0:87112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87112:1875729134998656:0@lo:104: 00010000:00010000:0.0:1788838042.749363:0:87112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749375:0:87112:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749382:0:87112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838042.749399:0:87112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607460800/0x88da08396ccc842d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788838042.760301:0:87103:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:3.0:1788838042.760629:0:87103:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788838042.760691:0:87133:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:2.0:1788838042.760705:0:87133:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:2.0:1788838042.761388:0:87134:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788838042.762072:0:87134:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788838042.763424:0:87103:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788838042.765312:0:87134:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788838042.765410:0:87134:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788838042.770995:0:87103:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788838042.771048:0:87103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788838042.771629:0:87103:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788838042.771639:0:87103:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788838042.771679:0:87103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788838042.772402:0:87135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87135:1875729134998912:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838042.772486:0:87135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.772534:0:87135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838042.772605:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134998912 00000100:00100000:2.0:1788838042.772613:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134998912 00000100:00100000:2.0:1788838042.772671:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:2.0:1788838042.772681:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87135:x1875729134998912:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838042.772787:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87135:x1875729134998912:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838042.772794:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:0.0:1788838042.773321:0:87135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87135:1875729134998912:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788838042.773366:0:87135:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788838042.773401:0:87135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87135:1875729134999040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838042.773445:0:87135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.773473:0:87135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838042.773534:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134999040 00000100:00100000:2.0:1788838042.773540:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134999040 00000100:00100000:2.0:1788838042.773577:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:2.0:1788838042.773585:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87135:x1875729134999040:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838042.773700:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87135:x1875729134999040:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838042.773719:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:0.0:1788838042.773924:0:87135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87135:1875729134999040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838042.773991:0:87135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87135:1875729134999168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838042.774016:0:87135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838042.774037:0:87135:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838042.774086:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134999168 00000100:00100000:2.0:1788838042.774091:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134999168 00000100:00100000:2.0:1788838042.774125:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00100000:2.0:1788838042.774132:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87135:x1875729134999168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838042.774198:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87135:x1875729134999168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 67us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838042.774206:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00100000:0.0:1788838042.774340:0:87135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87135:1875729134999168:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788838042.774392:0:87135:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838042.776007:0:87103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788838042.778665:0:87103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788838042.780447:0:87103:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788838042.780587:0:87103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838042.783264:0:87135:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788838042.783372:0:87135:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788838042.783378:0:87135:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:1.0:1788838042.783671:0:87103:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00010000:00080000:3.0:1788838042.790937:0:87103:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215108 00010000:00080000:3.0:1788838042.791959:0:87136:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87136 00010000:02000000:3.0:1788838042.791979:0:87136:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788838042.791983:0:87136:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788838042.791987:0:87136:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788838042.792200:0:87103:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788838042.792229:0:87103:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788838042.792258:0:87103:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788838042.792298:0:87103:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788838042.793319:0:87103:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838042.793563:0:87103:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788838043.581025:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838043.837512:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838043.837644:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116391040 00000100:00100000:1.0:1788838043.837655:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116391040 00000100:00100000:1.0:1788838043.837721:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:1.0:1788838043.837731:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116391040:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838043.837749:0:87110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838043.837771:0:87110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff607461000/0x88da08396ccc8434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc36 expref: -99 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.837903:0:87110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff607461000/0x88da08396ccc8434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc36 expref: 10 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.837916:0:87110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff607461000/0x88da08396ccc8434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc36 expref: 10 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.837928:0:87110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff607461000, rc 0) 00000100:00100000:1.0:1788838043.837990:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607538c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116391040:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 259us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.837997:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 10000000:01000000:1.0:1788838043.848031:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788838043.848040:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff605444800 from 113 10000000:01000000:1.0:1788838043.848044:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788838043.848091:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.848103:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.848114:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.848158:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.848235:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.848271:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838043.849861:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134999296 00000100:00100000:2.0:1788838043.849880:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134999296 00000100:00100000:2.0:1788838043.849957:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788838043.849968:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:6544:x1875729134999296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838043.849992:0:87114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838043.850018:0:87114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5f000/0x88da08396ccc8442 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc843b expref: -99 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.850054:0:87114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5f000/0x88da08396ccc8442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc843b expref: 11 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.850065:0:87114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5f000/0x88da08396ccc8442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc843b expref: 11 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.850074:0:87114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5f000, rc 0) 00000100:00100000:2.0:1788838043.850161:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729134999296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838043.850168:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788838043.856887:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.856923:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.856952:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838043.857042:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.857125:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838043.857176:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.857565:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134999424 00000100:00100000:0.0:1788838043.857573:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134999424 00000100:00100000:0.0:1788838043.857617:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788838043.857625:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729134999424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788838043.857644:0:87110:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788838043.857660:0:87110:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788838043.857663:0:87110:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 113 00000100:00100000:0.0:1788838043.857754:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729134999424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.857762:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788838043.859458:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788838043.859527:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788838043.859538:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.859548:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838043.859558:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788838043.859561:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff503592800 from 52 10000000:01000000:0.0:1788838043.859569:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788838043.859600:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc8449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.859608:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc8449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.859618:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc8449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838043.859635:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.859684:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838043.859725:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.859752:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134999552 00000100:00100000:0.0:1788838043.859757:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134999552 00000100:00100000:0.0:1788838043.859932:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788838043.859943:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729134999552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.859959:0:87114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838043.859972:0:87114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9000/0x88da08396ccc8450 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8449 expref: -99 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.859997:0:87114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9000/0x88da08396ccc8450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8449 expref: 12 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.860008:0:87114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9000/0x88da08396ccc8450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8449 expref: 12 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.860213:0:87114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9000, rc 0) 00000100:00100000:0.0:1788838043.860255:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134999552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 313us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.860270:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788838043.860311:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.860326:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc8449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8450 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.860341:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc8449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8450 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838043.860399:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.860428:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838043.860443:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.860456:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134999680 00000100:00100000:0.0:1788838043.860459:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134999680 00000100:00100000:0.0:1788838043.860482:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788838043.860489:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134999680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.860605:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134999680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.860612:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788838043.860638:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.860664:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.861586:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838043.861623:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.861640:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134999808 00000100:00100000:0.0:1788838043.861646:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134999808 00000100:00100000:0.0:1788838043.861686:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788838043.861716:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134999808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.863544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838043.863576:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116391168 00000100:00100000:2.0:1788838043.863584:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116391168 00000100:00100000:2.0:1788838043.863622:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:2.0:1788838043.863630:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116391168:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788838043.863653:0:87108:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788838043.863670:0:87108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788838043.863679:0:87108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788838043.863682:0:87108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788838043.863685:0:87108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788838043.863687:0:87108:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 113 00000100:00100000:0.0:1788838043.864418:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134999808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2713us (2829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.864432:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788838043.865474:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838043.867159:0:87197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788838043.867256:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788838043.867286:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838043.867298:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc8449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8450 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.867311:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc8449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8450 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838043.867322:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788838043.867325:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff503592800 from 110 10000000:01000000:2.0:1788838043.867328:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788838043.870340:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ec00/0x88da08396ccc8457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.870358:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ec00/0x88da08396ccc8457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.870370:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ec00/0x88da08396ccc8457 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838043.870403:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.870474:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838043.870515:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476840 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.872680:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729134999936 00000100:00100000:0.0:1788838043.874832:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729134999936 00000100:00100000:0.0:1788838043.874908:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788838043.874919:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729134999936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.874936:0:87110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838043.874952:0:87110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc845e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8457 expref: -99 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.874981:0:87110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc845e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8457 expref: 13 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.874993:0:87110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc845e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8457 expref: 13 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.875002:0:87110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9c00, rc 0) 00000100:00100000:0.0:1788838043.875095:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729134999936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (4621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.875102:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788838043.875138:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729134999936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838043.875156:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ec00/0x88da08396ccc8457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc845e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.875166:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ec00/0x88da08396ccc8457 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc845e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.875231:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.875268:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.875296:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5025530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.875310:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135000064 00000100:00100000:1.0:1788838043.875327:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135000064 00000100:00100000:1.0:1788838043.875350:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788838043.875356:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135000064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788838043.875368:0:87111:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788838043.875383:0:87111:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788838043.875387:0:87111:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788838043.875390:0:87111:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788838043.875392:0:87111:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788838043.875395:0:87111:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 113 00000100:00100000:1.0:1788838043.875464:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135000064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.875485:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788838043.875520:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788838043.875585:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788838043.875592:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ec00/0x88da08396ccc8457 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc845e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.875600:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ec00/0x88da08396ccc8457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc845e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838043.875608:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788838043.875611:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788838043.875613:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788838043.875631:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461400/0x88da08396ccc8465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.875638:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff607461400/0x88da08396ccc8465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.875645:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff607461400/0x88da08396ccc8465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.875657:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.875679:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.875692:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5025530c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.875736:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135000192 00000100:00100000:0.0:1788838043.875740:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135000192 00000100:00100000:0.0:1788838043.875774:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788838043.875780:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135000192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.875787:0:87114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838043.875861:0:87114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc846c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8465 expref: -99 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.875884:0:87114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc846c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8465 expref: 14 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.875892:0:87114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc846c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8465 expref: 14 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.875899:0:87114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8a00, rc 0) 00000100:00100000:0.0:1788838043.875926:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135000192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.875933:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788838043.876174:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838043.876185:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff607461400/0x88da08396ccc8465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc846c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.876194:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff607461400/0x88da08396ccc8465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc846c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.876256:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.876279:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.876307:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5025530c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.877268:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135000320 00000100:00100000:0.0:1788838043.877276:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135000320 00000100:00100000:0.0:1788838043.877331:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788838043.877339:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135000320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.877508:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135000320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.877516:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788838043.878219:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.878272:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.878338:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.878366:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5025530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.878382:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135000448 00000100:00100000:1.0:1788838043.878387:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135000448 00000100:00100000:1.0:1788838043.878415:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788838043.878421:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135000448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.881210:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135000448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2782us (2873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.881223:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788838043.881287:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff633277100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.884132:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116391168:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 Request processed in 20489us (20585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.884150:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:1.0:1788838043.888036:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838043.888144:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116391296 00000100:00100000:3.0:1788838043.888152:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116391296 00000100:00100000:3.0:1788838043.888191:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1131 00000100:00100000:3.0:1788838043.888199:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116391296:12345-192.168.203.30@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1788838043.888230:0:66254:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'fdcf066d-ff07-4b2e-96ab-52415ed6bf72' at ffff8ff640ee8800, cookie 0x88da08396ccc837e 00010000:00080000:3.0:1788838043.888235:0:66254:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp recovering/t103079215109 exp ffff8ff640ee8800 cur 3437 last 1788838042 00010000:02000400:3.0:1788838043.888242:0:66254:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1788838043.888248:0:66254:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1788838043.888268:0:66254:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788838043.888419:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff6049ba800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838043.888487:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116391296:12345-192.168.203.30@tcp:38:ll_cfg_requeue.0 Request processed in 287us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838043.888495:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1131 00000040:00080000:0.0:1788838043.889519:0:87198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788838043.890030:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788838043.890059:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788838043.890073:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461400/0x88da08396ccc8465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc846c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.890086:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff607461400/0x88da08396ccc8465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc846c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838043.890123:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788838043.890127:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff503592800 from 1 10000000:01000000:1.0:1788838043.890130:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788838043.890184:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461200/0x88da08396ccc8473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.890192:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff607461200/0x88da08396ccc8473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.890204:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff607461200/0x88da08396ccc8473 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.890231:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.890320:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.890382:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.890600:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135000576 00000100:00100000:0.0:1788838043.890611:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135000576 00000100:00100000:0.0:1788838043.890670:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788838043.890682:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135000576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.890697:0:87114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838043.890733:0:87114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc847a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8473 expref: -99 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.890765:0:87114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc847a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8473 expref: 15 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.890777:0:87114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc847a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8473 expref: 15 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.892053:0:87114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9800, rc 0) 00000100:00100000:0.0:1788838043.892142:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135000576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1461us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.892150:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788838043.893405:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838043.893447:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff607461200/0x88da08396ccc8473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc847a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.893461:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff607461200/0x88da08396ccc8473 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc847a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838043.893479:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788838043.893484:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461200/0x88da08396ccc8473 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc847a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.893490:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff607461200/0x88da08396ccc8473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc847a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838043.893498:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788838043.893500:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff503592800 from 7 10000000:01000000:2.0:1788838043.893503:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838043.893532:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc8481 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.893538:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc8481 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.893547:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc8481 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838043.893565:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.893611:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838043.893646:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.893716:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135000704 00000100:00100000:1.0:1788838043.893724:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135000704 00000100:00100000:1.0:1788838043.893775:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788838043.893902:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135000704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838043.893916:0:87111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838043.893930:0:87111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff607461c00/0x88da08396ccc8488 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8481 expref: -99 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.893951:0:87111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff607461c00/0x88da08396ccc8488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8481 expref: 16 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.893960:0:87111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff607461c00/0x88da08396ccc8488 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8481 expref: 16 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.893981:0:87111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff607461c00, rc 0) 00000100:00100000:1.0:1788838043.894036:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135000704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 252us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.894042:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788838043.894291:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838043.894311:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc8481 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8488 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.894320:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc8481 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8488 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838043.894375:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.894404:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838043.894432:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.894477:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135000832 00000100:00100000:1.0:1788838043.894482:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135000832 00000100:00100000:1.0:1788838043.894514:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788838043.894522:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135000832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.894640:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135000832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.894647:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788838043.894719:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.894746:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.894784:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838043.894838:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.894882:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135000960 00000100:00100000:1.0:1788838043.894886:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135000960 00000100:00100000:1.0:1788838043.894922:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788838043.894928:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135000960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.895005:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135000960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.895011:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788838043.895099:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135000960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838043.895906:0:87199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788838043.896069:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788838043.896091:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788838043.896103:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc8481 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8488 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.896114:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc8481 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8488 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838043.896140:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788838043.896144:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff63f7ce800 from 52 10000000:01000000:1.0:1788838043.896147:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838043.896189:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607460a00/0x88da08396ccc848f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.896197:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff607460a00/0x88da08396ccc848f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.896207:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff607460a00/0x88da08396ccc848f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.896228:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.896274:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.896312:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838043.896368:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135001088 00000100:00100000:2.0:1788838043.896373:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135001088 00000100:00100000:2.0:1788838043.896411:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788838043.896419:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135001088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838043.896430:0:87110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838043.896442:0:87110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5e400/0x88da08396ccc8496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc848f expref: -99 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.896462:0:87110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5e400/0x88da08396ccc8496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc848f expref: 17 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.896471:0:87110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5e400/0x88da08396ccc8496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc848f expref: 17 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.896487:0:87110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5e400, rc 0) 00000100:00100000:2.0:1788838043.896527:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135001088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838043.896534:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788838043.896727:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838043.896741:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff607460a00/0x88da08396ccc848f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8496 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.896749:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff607460a00/0x88da08396ccc848f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8496 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.896824:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.896850:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.896866:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838043.897288:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135001216 00000100:00100000:2.0:1788838043.897294:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135001216 00000100:00100000:2.0:1788838043.897321:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788838043.897328:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135001216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.897459:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135001216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838043.897466:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788838043.897527:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.897563:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.897608:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838043.897642:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.897694:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135001344 00000100:00100000:1.0:1788838043.897707:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135001344 00000100:00100000:1.0:1788838043.897745:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788838043.897752:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135001344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.897859:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135001344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.897865:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788838043.897951:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.899218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838043.899489:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116383104 00000100:00100000:2.0:1788838043.899496:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116383104 00000100:00100000:2.0:1788838043.899609:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1132 00000100:00100000:2.0:1788838043.899620:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116383104:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00080000:2.0:1788838043.899637:0:76060:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 103079215109, current: 103079215109, replaying 00000100:00100000:2.0:1788838043.899650:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116383104:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 33us (437us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838043.899656:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1132 00010000:00080000:1.0:1788838043.899794:0:87136:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000040:00080000:0.0:1788838043.900529:0:87200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788838043.900739:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788838043.900766:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838043.900777:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607460a00/0x88da08396ccc848f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8496 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.900995:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff607460a00/0x88da08396ccc848f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8496 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838043.901074:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788838043.901149:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788838043.901152:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788838043.901202:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ee00/0x88da08396ccc849d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.901211:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ee00/0x88da08396ccc849d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.901222:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ee00/0x88da08396ccc849d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838043.901249:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.901328:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838043.901413:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.901531:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135001472 00000100:00100000:0.0:1788838043.901538:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135001472 00000100:00100000:0.0:1788838043.901633:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788838043.901643:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135001472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.901657:0:87108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838043.901671:0:87108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc84a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc849d expref: -99 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.901692:0:87108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc84a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc849d expref: 18 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.901722:0:87108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc84a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc849d expref: 18 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.901730:0:87108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9e00, rc 0) 00000100:00100000:0.0:1788838043.901774:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135001472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.901780:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788838043.901891:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838043.901905:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ee00/0x88da08396ccc849d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.901914:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ee00/0x88da08396ccc849d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc84a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838043.901970:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.901995:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838043.902404:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.902461:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135001600 00000100:00100000:1.0:1788838043.902467:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135001600 00000100:00100000:1.0:1788838043.902506:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788838043.902514:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135001600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.902663:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135001600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.902670:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788838043.902715:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.902748:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.903266:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.903285:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50379be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.903298:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135001728 00000100:00100000:1.0:1788838043.903302:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135001728 00000100:00100000:1.0:1788838043.903322:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788838043.903328:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135001728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.903961:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135001728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 630us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.903970:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788838043.904238:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838043.906517:0:87201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1788838043.906650:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1788838043.906677:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788838043.906688:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ee00/0x88da08396ccc849d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.906709:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ee00/0x88da08396ccc849d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838043.906719:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788838043.906723:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff63f7ce800 from 7 10000000:01000000:1.0:1788838043.906726:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788838043.906766:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607460000/0x88da08396ccc84ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.906773:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff607460000/0x88da08396ccc84ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.906783:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff607460000/0x88da08396ccc84ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.911379:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.911491:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.911742:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50379be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.912128:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135001856 00000100:00100000:0.0:1788838043.912138:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135001856 00000100:00100000:1.0:1788838043.912377:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788838043.912387:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135001856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838043.912409:0:87110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838043.912436:0:87110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff607460e00/0x88da08396ccc84b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc84ab expref: -99 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.912489:0:87110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff607460e00/0x88da08396ccc84b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc84ab expref: 19 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.912501:0:87110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff607460e00/0x88da08396ccc84b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc84ab expref: 19 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.912511:0:87110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff607460e00, rc 0) 00000100:00100000:1.0:1788838043.912563:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135001856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.912571:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788838043.912623:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838043.912641:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff607460000/0x88da08396ccc84ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84b2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.912653:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff607460000/0x88da08396ccc84ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc84b2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.912742:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.912771:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.912836:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50379be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838043.912997:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135001984 00000100:00100000:3.0:1788838043.913002:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135001984 00000100:00100000:3.0:1788838043.913039:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788838043.913048:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62749b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135001984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838043.913196:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62749b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135001984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838043.913204:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788838043.913234:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135001984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838043.913268:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838043.913316:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838043.913331:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505b6d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838043.913344:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135002112 00000100:00100000:3.0:1788838043.913347:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135002112 00000100:00100000:3.0:1788838043.913368:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788838043.913373:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135002112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838043.913455:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135002112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838043.913462:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788838043.913506:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838043.915011:0:87202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788838043.915670:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788838043.915710:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788838043.915723:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607460000/0x88da08396ccc84ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84b2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838043.915736:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff607460000/0x88da08396ccc84ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84b2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838043.915747:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788838043.915750:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627f9a800 from 52 10000000:01000000:3.0:1788838043.915753:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788838043.915837:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030400/0x88da08396ccc84b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838043.915846:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff600030400/0x88da08396ccc84b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838043.915859:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff600030400/0x88da08396ccc84b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838043.915906:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838043.915988:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838043.916032:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505b6d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.916368:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135002240 00000100:00100000:1.0:1788838043.916378:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135002240 00000100:00100000:1.0:1788838043.916430:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788838043.916441:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62749bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135002240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838043.916458:0:87110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838043.916478:0:87110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff607460c00/0x88da08396ccc84c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc84b9 expref: -99 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.916508:0:87110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff607460c00/0x88da08396ccc84c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc84b9 expref: 20 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.916521:0:87110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff607460c00/0x88da08396ccc84c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc84b9 expref: 20 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.916530:0:87110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff607460c00, rc 0) 00000100:00100000:1.0:1788838043.916589:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62749bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135002240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.916596:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788838043.916689:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838043.916716:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff600030400/0x88da08396ccc84b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84c0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.916733:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff600030400/0x88da08396ccc84b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc84c0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838043.916854:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.916882:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838043.916908:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.917031:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135002368 00000100:00100000:1.0:1788838043.917036:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135002368 00000100:00100000:1.0:1788838043.917068:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788838043.917084:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135002368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.917326:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135002368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.917334:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788838043.917399:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.917430:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838043.917471:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838043.917494:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.917534:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135002496 00000100:00100000:1.0:1788838043.917539:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135002496 00000100:00100000:1.0:1788838043.917568:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788838043.917574:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62749a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135002496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.917642:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62749a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135002496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.917648:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788838043.917725:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838043.918965:0:87203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788838043.919309:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788838043.919353:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838043.919367:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030400/0x88da08396ccc84b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84c0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.919378:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff600030400/0x88da08396ccc84b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84c0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838043.919388:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788838043.919391:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788838043.919394:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788838043.919429:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461600/0x88da08396ccc84c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.919437:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff607461600/0x88da08396ccc84c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.919447:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff607461600/0x88da08396ccc84c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.919471:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.919531:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.919565:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5044650c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838043.919729:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135002624 00000100:00100000:2.0:1788838043.919736:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135002624 00000100:00100000:2.0:1788838043.919861:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788838043.919871:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135002624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838043.919885:0:87108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838043.919897:0:87108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5f200/0x88da08396ccc84ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc84c7 expref: -99 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.919919:0:87108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5f200/0x88da08396ccc84ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc84c7 expref: 21 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.919930:0:87108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5f200/0x88da08396ccc84ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc84c7 expref: 21 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.919952:0:87108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5f200, rc 0) 00000100:00100000:2.0:1788838043.919997:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135002624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838043.920003:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788838043.920977:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.921001:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff607461600/0x88da08396ccc84c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84ce expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.921012:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff607461600/0x88da08396ccc84c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc84ce expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838043.921104:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.921148:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838043.921521:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.921558:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135002752 00000100:00100000:1.0:1788838043.921564:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135002752 00000100:00100000:1.0:1788838043.921596:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788838043.921605:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135002752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.921971:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135002752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.921981:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788838043.922464:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.922509:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.922557:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838043.922617:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838043.922645:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135002880 00000100:00100000:1.0:1788838043.922649:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135002880 00000100:00100000:1.0:1788838043.922713:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788838043.922721:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135002880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.924043:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135002880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1314us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838043.924058:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788838043.924312:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135002880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838043.925739:0:87204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788838043.926494:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788838043.926520:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788838043.926532:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607461600/0x88da08396ccc84c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84ce expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.926544:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff607461600/0x88da08396ccc84c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84ce expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838043.926554:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788838043.926557:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff627f9a800 from 7 10000000:01000000:0.0:1788838043.926560:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788838043.926596:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc84d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.926604:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc84d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.926615:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc84d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838043.926643:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.926725:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838043.926836:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838043.927033:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135003008 00000100:00100000:2.0:1788838043.927042:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135003008 00000100:00100000:2.0:1788838043.927249:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788838043.927259:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135003008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838043.927274:0:87111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838043.927288:0:87111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc84dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc84d5 expref: -99 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.927385:0:87111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc84dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc84d5 expref: 22 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.927397:0:87111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc84dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc84d5 expref: 22 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.927406:0:87111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5f600, rc 0) 00000100:00100000:2.0:1788838043.927461:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135003008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838043.927468:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788838043.927539:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.927556:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc84d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84dc expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.927565:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc84d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc84dc expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838043.927643:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.927673:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838043.928022:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838043.928101:0:87114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135003136 00000100:00100000:3.0:1788838043.928107:0:87114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135003136 00000100:00100000:3.0:1788838043.928148:0:87114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788838043.928156:0:87114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135003136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838043.928828:0:87114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135003136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 671us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838043.928836:0:87114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788838043.929349:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.929398:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838043.929456:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838043.929487:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838043.929604:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135003264 00000100:00100000:3.0:1788838043.929611:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135003264 00000100:00100000:3.0:1788838043.929656:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788838043.929665:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135003264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838043.929772:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135003264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838043.929780:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788838043.930033:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838043.931727:0:87205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788838043.932322:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788838043.932355:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788838043.932370:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc84d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84dc expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838043.932387:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc84d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84dc expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838043.932400:0:6544:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788838043.932419:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ff610244d28 from 1 10000000:01000000:3.0:1788838043.932423:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788838043.932467:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc84e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838043.932477:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc84e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838043.932488:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc84e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838043.932514:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838043.932585:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838043.932641:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505b6d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.932778:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135003392 00000100:00100000:0.0:1788838043.932819:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135003392 00000100:00100000:0.0:1788838043.932868:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788838043.932878:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135003392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.932890:0:87110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838043.932902:0:87110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9600/0x88da08396ccc84ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc84e3 expref: -99 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.932927:0:87110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9600/0x88da08396ccc84ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc84e3 expref: 23 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.932938:0:87110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9600/0x88da08396ccc84ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc84e3 expref: 23 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.932946:0:87110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9600, rc 0) 00000100:00100000:0.0:1788838043.932989:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135003392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.933003:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788838043.933339:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838043.933355:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc84e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84ea expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838043.933364:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc84e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc84ea expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838043.933383:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788838043.933387:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc84e3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84ea expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838043.933394:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc84e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84ea expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838043.933402:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788838043.933404:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ff610244d28 from 1 10000000:01000000:3.0:1788838043.933415:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788838043.933436:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc84f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838043.933443:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc84f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838043.933452:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc84f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838043.933468:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838043.933497:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838043.933524:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505b6d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838043.933627:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135003520 00000100:00100000:0.0:1788838043.933633:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135003520 00000100:00100000:0.0:1788838043.933667:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788838043.933674:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135003520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838043.933683:0:87111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838043.933693:0:87111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc84f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc84f1 expref: -99 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.933719:0:87111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc84f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc84f1 expref: 24 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.933727:0:87111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc84f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc84f1 expref: 24 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838043.933733:0:87111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8400, rc 0) 00000100:00100000:0.0:1788838043.933769:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135003520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838043.933775:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788838043.933930:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838043.933942:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc84f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84f8 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838043.933949:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc84f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc84f8 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838043.934015:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838043.934043:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838043.934065:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50379be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838043.934266:0:87110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135003648 00000100:00100000:3.0:1788838043.934272:0:87110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135003648 00000100:00100000:3.0:1788838043.934541:0:87110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788838043.934572:0:87110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135003648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838043.934672:0:87110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135003648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (627us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788838043.934729:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135003648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788838043.934765:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788838043.934771:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc84f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84f8 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838043.934864:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc84f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc84f8 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838043.935392:0:87110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788838044.229039:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838044.229145:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116391424 00000100:00100000:3.0:1788838044.229159:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116391424 00000100:00100000:3.0:1788838044.229266:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1126 00000100:00100000:3.0:1788838044.229280:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116391424:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838044.229372:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116391424:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 96us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838044.229380:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1126 00000100:00080000:0.0:1788838044.230280:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788838044.606794:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838045.631017:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838046.663431:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838047.104757:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838047.104789:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135003776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838047.104903:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838047.105878:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135003904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838047.105934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838047.106790:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135003776 00000100:00100000:3.0:1788838047.106837:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135003776 00000100:00100000:3.0:1788838047.106935:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135003904 00000100:00100000:3.0:1788838047.106938:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135003904 00000100:00100000:3.0:1788838047.106964:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1788838047.106977:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135003776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838047.107029:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838047.107118:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135003776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838047.107127:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1788838047.107150:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:3.0:1788838047.107157:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135003904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838047.107176:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838047.107204:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135003904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838047.107210:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:3.0:1788838047.107268:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135003904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838047.107287:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135003776:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788838047.108204:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838047.108213:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788838047.683287:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838048.126218:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135004032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838048.126346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838048.126452:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135004032 00000100:00100000:1.0:1788838048.126463:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135004032 00000100:00100000:1.0:1788838048.126536:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:1.0:1788838048.126548:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135004032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838048.126595:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:1.0:1788838048.126873:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135004032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 326us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838048.126881:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00100000:1.0:1788838048.126944:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135004032:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788838048.127090:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838048.127096:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838048.127100:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838048.127107:0:86008:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3436 00000100:00080000:3.0:1788838048.127111:0:86008:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838048.127117:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838048.127145:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5048d0700 x1875729135004288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838048.127201:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838048.127206:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838048.127208:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838048.127212:0:86008:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3436 00000100:00080000:3.0:1788838048.127216:0:86008:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838048.127221:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838048.127236:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63f744000 x1875729135004544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838048.127256:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838048.127259:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838048.127261:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838048.127265:0:86008:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3436 00000100:00080000:3.0:1788838048.127267:0:86008:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838048.127272:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838048.127288:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63f745180 x1875729135004800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838048.127313:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838048.127316:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838048.127318:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838048.127322:0:86008:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3436 00000100:00080000:3.0:1788838048.127325:0:86008:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838048.127329:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838048.127342:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63f746680 x1875729135005184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838048.127376:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788838048.127380:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838048.127382:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff6104de800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838048.127389:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff6104de800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838048.127404:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50719ed80 x1875729135005568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838048.127435:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135004288:0@lo:38:kworker.0 00000100:00100000:3.0:1788838048.127487:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.127518:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135004544:0@lo:38:kworker.0 00000100:00100000:3.0:1788838048.127544:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.127564:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135004800:0@lo:38:kworker.0 00000100:00100000:3.0:1788838048.127587:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.127619:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135005184:0@lo:38:kworker.0 00000100:00100000:3.0:1788838048.127644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.128795:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135005568:0@lo:38:kworker.0 00000100:00100000:3.0:1788838048.128882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.128957:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135004416:0@lo:400:kworker.0 00000100:00100000:3.0:1788838048.128989:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.129011:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135005312:0@lo:400:kworker.0 00000100:00100000:3.0:1788838048.129039:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.129065:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788838048.129072:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135004672:0@lo:400:kworker.0 00000100:00100000:3.0:1788838048.129108:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.129140:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135005440:0@lo:400:kworker.0 00000100:00100000:3.0:1788838048.129164:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.129204:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135004288 00000100:00100000:3.0:1788838048.129212:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135004288 00000100:00100000:3.0:1788838048.129249:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135004544 00000100:00100000:3.0:1788838048.129252:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135004544 00000100:00100000:3.0:1788838048.129264:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135005184 00000100:00100000:3.0:1788838048.129267:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135005184 00000100:00100000:3.0:1788838048.129276:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135005568 00000100:00100000:3.0:1788838048.129279:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135005568 00000100:00100000:3.0:1788838048.129288:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135004416 00000100:00100000:3.0:1788838048.129291:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135004416 00000100:00100000:3.0:1788838048.129330:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135004672 00000100:00100000:3.0:1788838048.129333:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135004672 00000100:00100000:3.0:1788838048.130536:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1788838048.130552:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135004416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838048.130864:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135004416:12345-0@lo:400:kworker.0 Request processed in 313us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838048.130874:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1788838048.130899:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1788838048.130906:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135004672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838048.130939:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135004672:12345-0@lo:400:kworker.0 Request processed in 34us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838048.130945:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1788838048.130958:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1788838048.130964:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135004288:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788838048.131002:0:66254:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3442 last 0 00000020:00000080:3.0:1788838048.131057:0:66254:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88da08396ccc84ff 00000004:00100000:3.0:1788838048.131087:0:66254:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838048.131268:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff50345e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838048.131316:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875729135004288:12345-0@lo:38:kworker.0 Request processed in 350us (3829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838048.131324:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1788838048.131340:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1788838048.131345:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135004544:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788838048.131360:0:66254:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3442 last 0 00000020:00000080:3.0:1788838048.133045:0:66254:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88da08396ccc8506 00000004:00100000:3.0:1788838048.133076:0:66254:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838048.133141:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff63f7cf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838048.133316:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875729135004544:12345-0@lo:38:kworker.0 Request processed in 1965us (5766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838048.133330:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1788838048.134049:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1788838048.134060:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135005184:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788838048.134099:0:66254:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3442 last 0 00000020:00000080:3.0:1788838048.134149:0:66254:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x88da08396ccc850d 00000004:00100000:3.0:1788838048.134165:0:66254:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838048.134194:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff624a96800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838048.134257:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875729135005184:12345-0@lo:38:kworker.0 Request processed in 196us (6612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838048.134265:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1788838048.134280:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1788838048.134285:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135005568:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788838048.134315:0:66254:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3442 last 0 00000001:00100000:2.0:1788838048.135126:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788838048.136129:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135004160:0@lo:400:kworker.0 00000100:00100000:1.0:1788838048.136223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838048.136291:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135005056:0@lo:400:kworker.0 00000100:00100000:1.0:1788838048.136327:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838048.136377:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838048.136385:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135004928:0@lo:400:kworker.0 00000100:00100000:1.0:1788838048.136419:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838048.136463:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135005312 00000100:00100000:1.0:1788838048.136475:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135005312 00000100:00100000:1.0:1788838048.136547:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135005440 00000100:00100000:1.0:1788838048.136551:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135005440 00000100:00100000:1.0:1788838048.136576:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135005056 00000100:00100000:1.0:1788838048.136580:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135005056 00000100:00100000:1.0:1788838048.136608:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135004928 00000100:00100000:1.0:1788838048.136612:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135004928 00000100:00100000:1.0:1788838048.136640:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00100000:1.0:1788838048.136650:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135005312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838048.136732:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135005312:12345-0@lo:400:kworker.0 Request processed in 84us (7692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838048.136745:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00000100:00100000:1.0:1788838048.136764:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:1.0:1788838048.136769:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135005440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838048.136816:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135005440:12345-0@lo:400:kworker.0 Request processed in 28us (7632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838048.136821:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:1.0:1788838048.136830:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:1.0:1788838048.136835:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135005056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838048.136865:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135005056:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838048.136870:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00100000:1.0:1788838048.136879:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:1.0:1788838048.136884:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135004928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838048.136904:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135004928:12345-0@lo:400:kworker.0 Request processed in 21us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838048.136909:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00100000:1.0:1788838048.136979:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135004928:0@lo:400:kworker.0 00000100:00100000:1.0:1788838048.136992:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135005056:0@lo:400:kworker.0 00000020:00000080:3.0:1788838048.137187:0:66254:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88da08396ccc8514 00000004:00100000:3.0:1788838048.137210:0:66254:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838048.137275:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff624a92800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838048.137348:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729135005568:12345-0@lo:38:kworker.0 Request processed in 3050us (8454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838048.137360:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1788838048.137406:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135004800 00000100:00100000:3.0:1788838048.137412:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135004800 00000100:00100000:3.0:1788838048.137456:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:3.0:1788838048.137463:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135004800:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788838048.137495:0:37907:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8ff640eeb000, cookie 0x88da08396ccc8385 00010000:00080000:3.0:1788838048.137502:0:37907:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378651 exp ffff8ff640eeb000 cur 3442 last 1788838042 00000004:00100000:3.0:1788838048.137516:0:37907:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838048.137531:0:37907:0:(import.c:65:import_set_state_nolock()) ffff8ff624a95800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838048.137569:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135004800:12345-0@lo:38:kworker.0 Request processed in 106us (9981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838048.137575:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000100:00080000:3.0:1788838048.137627:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838048.137633:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838048.137636:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838048.137716:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135004672:0@lo:400:kworker.0 00000100:00100000:3.0:1788838048.137732:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135005440:0@lo:400:kworker.0 00000100:00100000:3.0:1788838048.137748:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135004416:0@lo:400:kworker.0 00000100:00100000:3.0:1788838048.137761:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135005312:0@lo:400:kworker.0 00010000:00080000:3.0:1788838048.137860:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff5048d0700 x1875729135004288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838048.137877:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00080000:3.0:1788838048.138786:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8ff5048d0700 x1875729135004288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838073 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838048.138829:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788838048.138835:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788838048.138840:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00010000:00080000:1.0:1788838048.139402:0:87136:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788838048.139413:0:87136:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 103079215109 00000020:00080000:1.0:1788838048.139422:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.139427:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215109, next_transno: 103079215109 00010000:00080000:1.0:1788838048.139433:0:87136:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (103079215109) 00000020:00080000:1.0:1788838048.139437:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.139464:0:87136:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116383104 t103079215109 from 192.168.203.30@tcp req@ffff8ff5071c9500 x1875729116383104/t0(103079215109) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:699/0 lens 528/0 e 0 to 0 dl 1788838054 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838048.139835:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135004160 00000100:00100000:2.0:1788838048.139846:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135004160 00000100:00100000:2.0:1788838048.139907:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788838048.139919:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135004160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838048.140026:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135004160:12345-0@lo:400:kworker.0 Request processed in 109us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838048.140034:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788838048.143042:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135004160:0@lo:400:kworker.0 00000004:00080000:1.0:1788838048.143543:0:87136:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3967us 00000001:00100000:2.0:1788838048.145526:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788838048.155211:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135004288:0@lo:38:kworker.0 00010000:00080000:3.0:1788838048.155270:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff63f744000 x1875729135004544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838048.155290:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00080000:3.0:1788838048.156578:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8ff63f744000 x1875729135004544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838073 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838048.156592:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788838048.156597:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788838048.156602:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788838048.156608:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135004544:0@lo:38:kworker.0 00000100:00080000:3.0:1788838048.156645:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:3.0:1788838048.156656:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788838048.156659:0:3642:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788838048.156661:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:3.0:1788838048.156664:0:3642:0:(recover.c:53:ptlrpc_replay_next()) import ffff8ff6061da800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:3.0:1788838048.156668:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788838048.157387:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135004800:0@lo:38:kworker.0 00010000:00080000:0.0:1788838048.157411:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff63f746680 x1875729135005184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838048.157439:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000100:00080000:0.0:1788838048.158314:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8ff63f746680 x1875729135005184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838073 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838048.158326:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788838048.158333:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788838048.158338:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788838048.158344:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135005184:0@lo:38:kworker.0 00010000:00080000:0.0:1788838048.158375:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff50719ed80 x1875729135005568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838048.158387:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:0.0:1788838048.158393:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788838048.158398:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788838048.158400:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6104de800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788838048.158404:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135005568:0@lo:38:kworker.0 00010000:00080000:3.0:1788838048.158842:0:87380:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1788838048.158847:0:87380:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1788838048.158852:0:87380:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1788838048.160254:0:87380:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1788838048.160445:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135005696:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788838048.160549:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838048.161068:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135005696 00000100:00100000:2.0:1788838048.161081:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135005696 00000100:00100000:2.0:1788838048.161150:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:2.0:1788838048.161161:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135005696:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788838048.161188:0:23765:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff5048d0700 x1875729135005696/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:704/0 lens 224/0 e 0 to 0 dl 1788838059 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838048.161201:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135005696:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 43us (653us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838048.161209:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00010000:00010000:0.0:1788838048.175962:0:87136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc851b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.176220:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc851b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.176239:0:87136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc851b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.176254:0:87136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.176272:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.176279:0:87136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.177552:0:87136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc851b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.177567:0:87136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc851b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.177574:0:87136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc851b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.177579:0:87136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838048.177584:0:87136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc851b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.177591:0:87136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc851b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.177605:0:87136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61d6b9000) 00010000:00010000:0.0:1788838048.177608:0:87136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838048.177613:0:87136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc851b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.177619:0:87136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc851b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838048.178103:0:87136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000365b2846 reply state 0000000020c18c47 transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.178255:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.178264:0:87136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff61d6b9f00) 00010000:00010000:0.0:1788838048.178266:0:87136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838048.178270:0:87136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788838048.178411:0:87136:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788838048.178439:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838048.178442:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000020:00080000:0.0:1788838048.178446:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838048.178449:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000001:00080000:1.0:1788838048.186579:0:87104:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215109 is committed 00010000:00010000:3.0:1788838048.187159:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.187179:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.187187:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.187194:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838048.187199:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.187207:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.187227:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff61d6b9f00) 00010000:00010000:3.0:1788838048.187230:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838048.187235:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.187242:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc8522 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838048.192300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838048.192355:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116383616 00000100:00100000:0.0:1788838048.192367:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116383616 00000100:00100000:0.0:1788838048.192437:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1137 00000100:00100000:0.0:1788838048.192450:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116383616:12345-192.168.203.30@tcp:36:rm.0 00010000:00080000:0.0:1788838048.193634:0:66254:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 103079215110, current: 103079215110, replaying 00000100:00100000:0.0:1788838048.193650:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116383616:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1202us (1362us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838048.193658:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1137 00000020:00080000:2.0:1788838048.194157:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838048.194168:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215110, next_transno: 103079215110 00010000:00080000:2.0:1788838048.194175:0:87136:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (103079215110) 00000020:00080000:2.0:1788838048.194196:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838048.194214:0:87136:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116383616 t103079215110 from 192.168.203.30@tcp req@ffff8ff626a8aa00 x1875729116383616/t0(103079215110) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:704/0 lens 512/0 e 0 to 0 dl 1788838059 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788838048.200364:0:87136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8529 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.200416:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8529 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.200444:0:87136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8529 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.200481:0:87136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.200489:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.200497:0:87136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.200663:0:87136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8537 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.200685:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8537 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.200695:0:87136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8537 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201179:0:87136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8537 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201215:0:87136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8537 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201226:0:87136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8537 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201235:0:87136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838048.201242:0:87136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8537 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201255:0:87136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8537 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201276:0:87136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff8ff63f831400) 00010000:00010000:2.0:1788838048.201280:0:87136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788838048.201287:0:87136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8537 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201294:0:87136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8537 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201339:0:87136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8529 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201347:0:87136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8529 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201356:0:87136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8529 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201363:0:87136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5e200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838048.201376:0:87136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8529 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201385:0:87136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8529 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201402:0:87136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:2.0:1788838048.201407:0:87136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838048.201410:0:87136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8529 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201419:0:87136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8529 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838048.201451:0:87136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc314da2 reply state 00000000b803652d transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201466:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.201474:0:87136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff63f831100) 00010000:00010000:2.0:1788838048.201477:0:87136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838048.201480:0:87136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788838048.201656:0:87136:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788838048.201707:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838048.201712:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000020:00080000:2.0:1788838048.201718:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838048.201720:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000100:00100000:3.0:1788838048.206328:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838048.207365:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116385408 00000100:00100000:2.0:1788838048.207380:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116385408 00000100:00100000:3.0:1788838048.208980:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1138 00000100:00100000:3.0:1788838048.209005:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2403:x1875729116385408:12345-192.168.203.30@tcp:101:touch.0 00010000:00080000:3.0:1788838048.209032:0:76060:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:3.0:1788838048.209050:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2403:x1875729116385408:12345-192.168.203.30@tcp:101:touch.0 Request processed in 52us (2734us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838048.209057:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1138 00000020:00080000:3.0:1788838048.209128:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838048.209133:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:3.0:1788838048.209138:0:87136:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:3.0:1788838048.209141:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838048.209150:0:87136:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116385408 t103079215111 from 192.168.203.30@tcp req@ffff8ff50719fb80 x1875729116385408/t0(103079215111) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:704/0 lens 752/0 e 0 to 0 dl 1788838059 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788838048.209174:0:87136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838048.209197:0:87136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4200/0x88da08396ccc853e lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc13 expref: -99 pid: 87136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.210354:0:87136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc8545 lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.210377:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc8545 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.210389:0:87136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc8545 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.210414:0:87136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.210421:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.210428:0:87136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838048.211820:0:87136:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x5:0x0], cookie = 0x88da08396ccc82c8 00000004:00080000:0.0:1788838048.211827:0:87136:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x88da08396ccc82c8 in new mfd 00010000:00010000:0.0:1788838048.211841:0:87136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc8545 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.211850:0:87136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc8545 lrc: 2/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.211858:0:87136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc8545 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.211864:0:87136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838048.211868:0:87136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc8545 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.211877:0:87136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc8545 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.211891:0:87136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff50a140700) 00010000:00010000:0.0:1788838048.211894:0:87136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838048.211899:0:87136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc8545 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.211920:0:87136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc8545 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838048.211935:0:87136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000718e0aae reply state 00000000bff91078 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.211948:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.211954:0:87136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8ff604d0d500) 00010000:00010000:0.0:1788838048.211957:0:87136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838048.211960:0:87136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838048.212478:0:87136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4200/0x88da08396ccc853e lrc: 1/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 10 pid: 87136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.212492:0:87136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff50a140700) 00010000:00010000:0.0:1788838048.212495:0:87136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838048.212498:0:87136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059f4200/0x88da08396ccc853e lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc13 expref: 10 pid: 87136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.212519:0:87136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059f4200, rc 0) 00010000:00080000:0.0:1788838048.212609:0:87136:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788838048.212638:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838048.212642:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:0.0:1788838048.212647:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838048.212650:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000100:00100000:2.0:1788838048.255956:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838048.256343:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116385664 00000100:00100000:0.0:1788838048.256357:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116385664 00000100:00100000:0.0:1788838048.256460:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1139 00000100:00100000:0.0:1788838048.256474:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2403:x1875729116385664:12345-192.168.203.30@tcp:36:touch.0 00010000:00080000:0.0:1788838048.256500:0:75504:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:0.0:1788838048.256518:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2403:x1875729116385664:12345-192.168.203.30@tcp:36:touch.0 Request processed in 50us (787us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838048.256525:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1139 00000020:00080000:1.0:1788838048.256560:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.256569:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:1.0:1788838048.256575:0:87136:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:1.0:1788838048.256580:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.256595:0:87136:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116385664 t103079215112 from 192.168.203.30@tcp req@ffff8ff627d28700 x1875729116385664/t0(103079215112) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:704/0 lens 488/0 e 0 to 0 dl 1788838059 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788838048.256920:0:87136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.258046:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.258079:0:87136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838048.258579:0:87136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079ab7383 reply state 00000000770f2ea5 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.258600:0:87136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.258627:0:87136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8ff508af1400) 00010000:00010000:1.0:1788838048.258630:0:87136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838048.258635:0:87136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788838048.258854:0:87136:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788838048.258889:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.258893:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:1.0:1788838048.258898:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.258901:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000001:02000400:3.0:1788838048.267565:0:87389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788838048.275585:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838048.275727:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116386048 00000100:00100000:2.0:1788838048.275739:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116386048 00000100:00100000:2.0:1788838048.275819:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:2.0:1788838048.275830:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2403:x1875729116386048:12345-192.168.203.30@tcp:35:touch.0 00010000:00080000:2.0:1788838048.275852:0:66257:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215113, replaying 00000100:00100000:2.0:1788838048.275871:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2403:x1875729116386048:12345-192.168.203.30@tcp:35:touch.0 Request processed in 45us (297us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838048.275877:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 220 00000020:00080000:1.0:1788838048.277244:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.277254:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215113, next_transno: 103079215113 00010000:00080000:1.0:1788838048.277259:0:87136:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (103079215113) 00000020:00080000:1.0:1788838048.277263:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.277282:0:87136:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116386048 t103079215113 from 192.168.203.30@tcp req@ffff8ff5048d3100 x1875729116386048/t0(103079215113) o35->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:704/0 lens 392/0 e 0 to 0 dl 1788838059 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838048.277587:0:87136:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788838048.277604:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.277607:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000020:00080000:1.0:1788838048.277610:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.277612:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000100:00100000:0.0:1788838048.287218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838048.287432:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116391552 00000100:00100000:3.0:1788838048.287442:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116391552 00000100:00100000:3.0:1788838048.287507:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1129 00000100:00100000:3.0:1788838048.287520:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:2403:x1875729116391552:12345-192.168.203.30@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788838048.287545:0:66254:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff626a89880 x1875729116391552/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:704/0 lens 224/0 e 0 to 0 dl 1788838059 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838048.287576:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:2403:x1875729116391552:12345-192.168.203.30@tcp:400:ldlm_lock_repla.0 Request processed in 61us (364us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838048.287584:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1129 00000020:00080000:1.0:1788838048.287642:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.287647:0:87136:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215114 00010000:00080000:1.0:1788838048.287651:0:87136:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788838048.287654:0:87136:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838048.287662:0:87136:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788838048.287665:0:87136:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788838048.287786:0:87136:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:2.0:1788838048.290582:0:87104:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00100000:2.0:1788838048.290594:0:87104:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788838048.290618:0:87104:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:1.0:1788838048.290707:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290721:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290739:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290746:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5fa00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838048.290752:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290760:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290780:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290787:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8530 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290843:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290850:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290857:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290862:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838048.290873:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290880:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290889:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290895:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc854c lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290918:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290924:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290931:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290937:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838048.290940:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290946:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290955:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.290961:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff607460800/0x88da08396ccc855a lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87136 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838048.291935:0:87136:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788838048.291994:0:87136:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788838048.292012:0:87136:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8ff5048d0700 x1875729135005696/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:704/0 lens 224/0 e 0 to 0 dl 1788838059 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788838048.292629:0:87136:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.30@tcp: req@ffff8ff626a89880 x1875729116391552/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:704/0 lens 224/0 e 0 to 0 dl 1788838059 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788838048.292722:0:87136:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1788838048.296393:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1788838048.296416:0:3642:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8ff50719c380 x1875729135005696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838064 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838048.296430:0:3642:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8ff50719c380 x1875729135005696/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838064 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838048.296437:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788838048.296461:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788838048.296467:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135005696:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788838048.299762:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135005824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838048.299873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.299919:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135005824 00000100:00100000:3.0:1788838048.299930:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135005824 00000100:00100000:3.0:1788838048.300090:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:3.0:1788838048.300101:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135005824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838048.300139:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:3.0:1788838048.300206:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135005824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838048.300214:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:1.0:1788838048.304536:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135005824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838048.316784:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838048.316947:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838048.316979:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116391680 00000100:00100000:3.0:1788838048.316988:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116391680 00000100:00100000:3.0:1788838048.317047:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116391808 00000100:00100000:3.0:1788838048.317051:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116391808 00000100:00100000:3.0:1788838048.317075:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1140 00000100:00100000:3.0:1788838048.317086:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116391680:12345-192.168.203.30@tcp:17:kworker.0 00000100:00100000:1.0:1788838048.317239:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1141 00000100:00100000:1.0:1788838048.317249:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116391808:12345-192.168.203.30@tcp:17:kworker.0 00000100:00100000:3.0:1788838048.317323:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116391680:12345-192.168.203.30@tcp:17:kworker.0 Request processed in 238us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838048.317331:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1140 00000100:00080000:3.0:1788838048.317355:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838048.320322:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116391808:12345-192.168.203.30@tcp:17:kworker.0 Request processed in 3058us (3358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838048.320341:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1141 00000004:00000080:0.0:1788838048.324946:0:87136:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f51879fbe10 00100000:10000000:0.0:1788838048.324963:0:87136:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788838048.326716:0:87124:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1788838048.326765:0:87124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87124:1875729135005952:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788838048.326873:0:87124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838048.326911:0:87124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608ea6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838048.327329:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135005952 00000100:00100000:0.0:1788838048.327341:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135005952 00000100:00100000:0.0:1788838048.327409:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5929 00000100:00100000:0.0:1788838048.327420:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:87124:x1875729135005952:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788838048.327450:0:26213:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -95 00002000:02000040:0.0:1788838048.327454:0:26213:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:769) 00000004:00080000:3.0:1788838048.329223:0:87122:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:3.0:1788838048.329273:0:87122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87122:1875729135006080:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788838048.329345:0:87122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838048.329433:0:87122:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60614ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838048.335843:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135006080 00000100:00100000:1.0:1788838048.335860:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135006080 00000100:00100000:1.0:1788838048.335932:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5930 00000100:00100000:1.0:1788838048.335958:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:87122:x1875729135006080:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788838048.335997:0:26214:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -593 00002000:02000040:1.0:1788838048.336002:0:26214:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:769) 00002000:00010000:0.0:1788838048.337907:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.337923:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954f775d/0x88da08396ccc8561 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.337960:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x301:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788838048.337965:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838048.337972:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000954f775d/0x88da08396ccc8561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.337990:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000954f775d/0x88da08396ccc8561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.338000:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000954f775d/0x88da08396ccc8561 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.338009:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000954f775d/0x88da08396ccc8561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.338034:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838048.338162:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838048.338172:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000954f775d/0x88da08396ccc8561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.338182:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838048.338188:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000954f775d/0x88da08396ccc8561 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.338199:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000954f775d/0x88da08396ccc8561 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.338221:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000954f775d/0x88da08396ccc8561 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.338230:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000954f775d/0x88da08396ccc8561 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.338268:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.338271:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.338273:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838048.338325:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.338332:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc8568 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.338341:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x300:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788838048.338344:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838048.338348:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc8568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.338358:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc8568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.338377:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc8568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.338384:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc8568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.338404:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838048.338526:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838048.338533:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc8568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.338545:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838048.338549:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc8568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.338556:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc8568 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.338567:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc8568 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.338574:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc8568 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.338587:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.338588:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.338589:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788838048.345025:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1788838048.346007:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.346018:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092dcf804/0x88da08396ccc856f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346048:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ff:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.346054:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.346061:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092dcf804/0x88da08396ccc856f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346076:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092dcf804/0x88da08396ccc856f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346086:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092dcf804/0x88da08396ccc856f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346094:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092dcf804/0x88da08396ccc856f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346121:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838048.346196:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.346204:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092dcf804/0x88da08396ccc856f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.346213:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.346217:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092dcf804/0x88da08396ccc856f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.346227:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092dcf804/0x88da08396ccc856f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.346245:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092dcf804/0x88da08396ccc856f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.346253:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092dcf804/0x88da08396ccc856f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.346284:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.346286:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.346288:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838048.346347:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.346353:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fba9984d/0x88da08396ccc8576 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346362:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fe:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.346365:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.346369:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fba9984d/0x88da08396ccc8576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346377:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fba9984d/0x88da08396ccc8576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346396:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fba9984d/0x88da08396ccc8576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346403:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fba9984d/0x88da08396ccc8576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346452:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838048.346494:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.346499:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b74810a8/0x88da08396ccc857d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346507:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fd:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.346510:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.346513:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b74810a8/0x88da08396ccc857d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346522:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b74810a8/0x88da08396ccc857d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346529:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b74810a8/0x88da08396ccc857d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.346537:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b74810a8/0x88da08396ccc857d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.348455:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838048.348470:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fba9984d/0x88da08396ccc8576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.348483:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.348488:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fba9984d/0x88da08396ccc8576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.348499:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fba9984d/0x88da08396ccc8576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.348521:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fba9984d/0x88da08396ccc8576 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.348529:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fba9984d/0x88da08396ccc8576 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.349211:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.349219:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b74810a8/0x88da08396ccc857d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.349229:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.349241:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b74810a8/0x88da08396ccc857d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.349252:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b74810a8/0x88da08396ccc857d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.349268:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b74810a8/0x88da08396ccc857d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.349276:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.349278:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.349281:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.350457:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.350468:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8584 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.350484:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x301:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.350489:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.350495:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.350513:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.350526:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.350534:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.350744:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838048.350751:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b74810a8/0x88da08396ccc857d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838048.350939:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.350944:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb4b9c5d/0x88da08396ccc858b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.350954:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fc:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.350958:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.350962:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb4b9c5d/0x88da08396ccc858b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.350973:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb4b9c5d/0x88da08396ccc858b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.350982:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb4b9c5d/0x88da08396ccc858b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.350990:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb4b9c5d/0x88da08396ccc858b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351098:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838048.351108:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8584 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351117:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.351121:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8584 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351131:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8584 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351162:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8584 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351172:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.351185:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb4b9c5d/0x88da08396ccc858b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351192:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.351196:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb4b9c5d/0x88da08396ccc858b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351204:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb4b9c5d/0x88da08396ccc858b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351217:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb4b9c5d/0x88da08396ccc858b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351225:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.351227:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.351229:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.351363:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788838048.351369:0:26214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed8c94a5/0x88da08396ccc8584 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838048.351457:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.351471:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc8592 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351480:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x300:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.351484:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.351488:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc8592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351498:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc8592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351508:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc8592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351515:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc8592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351530:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838048.351650:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.351656:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc8592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351664:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.351668:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc8592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351687:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc8592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351713:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc8592 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351721:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3cc69c1/0x88da08396ccc8592 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.351735:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.351737:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.351740:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.351794:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.351826:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc8599 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351834:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ff:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.351837:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.351841:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc8599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351849:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc8599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351865:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc8599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351872:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc8599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351887:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838048.351935:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.351941:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc85a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351948:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fe:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.351951:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.351955:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc85a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351964:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc85a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351972:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc85a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.351979:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc85a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352006:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788838048.352047:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.352052:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb09f945/0x88da08396ccc85a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352059:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fd:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.352062:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.352066:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb09f945/0x88da08396ccc85a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352075:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb09f945/0x88da08396ccc85a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352083:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb09f945/0x88da08396ccc85a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352089:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb09f945/0x88da08396ccc85a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352102:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788838048.352109:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838048.352113:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc8599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352120:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.352130:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc8599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352138:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc8599 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352223:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc8599 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352232:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096225ef3/0x88da08396ccc8599 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352247:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838048.352251:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc85a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352257:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.352260:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc85a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352268:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc85a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352278:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc85a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352285:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9a22aa/0x88da08396ccc85a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352303:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.352307:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb09f945/0x88da08396ccc85a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352313:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.352316:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb09f945/0x88da08396ccc85a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352324:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb09f945/0x88da08396ccc85a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352334:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb09f945/0x88da08396ccc85a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352341:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb09f945/0x88da08396ccc85a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352351:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.352353:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.352355:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.352367:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.352391:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.352434:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.352440:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019393b7a/0x88da08396ccc85ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352459:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fc:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.352462:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.352466:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019393b7a/0x88da08396ccc85ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352475:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019393b7a/0x88da08396ccc85ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352483:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019393b7a/0x88da08396ccc85ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352492:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019393b7a/0x88da08396ccc85ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352505:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838048.352547:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.352666:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.352682:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019393b7a/0x88da08396ccc85ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.352690:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.352693:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019393b7a/0x88da08396ccc85ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.352701:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019393b7a/0x88da08396ccc85ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.352712:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019393b7a/0x88da08396ccc85ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.352719:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019393b7a/0x88da08396ccc85ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.352744:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.352746:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.352748:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.352780:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000354e1db9/0x88da08396ccc85b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352789:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fb:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.352792:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838048.352842:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.352923:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000354e1db9/0x88da08396ccc85b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352935:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000354e1db9/0x88da08396ccc85b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352954:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000354e1db9/0x88da08396ccc85b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352961:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000354e1db9/0x88da08396ccc85b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352974:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.352981:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.352985:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000354e1db9/0x88da08396ccc85b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.352991:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.352994:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000354e1db9/0x88da08396ccc85b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353001:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000354e1db9/0x88da08396ccc85b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353011:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000354e1db9/0x88da08396ccc85b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353018:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000354e1db9/0x88da08396ccc85b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353030:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353037:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353039:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.353087:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.353092:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f7697ec/0x88da08396ccc85bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353099:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fa:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.353102:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.353105:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f7697ec/0x88da08396ccc85bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353113:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f7697ec/0x88da08396ccc85bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353120:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f7697ec/0x88da08396ccc85bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353126:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f7697ec/0x88da08396ccc85bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353136:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.353141:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.353144:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f7697ec/0x88da08396ccc85bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353162:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.353165:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f7697ec/0x88da08396ccc85bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353181:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f7697ec/0x88da08396ccc85bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353191:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f7697ec/0x88da08396ccc85bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353198:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f7697ec/0x88da08396ccc85bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353208:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353210:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353212:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.353253:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.353258:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc85c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353265:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f9:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.353269:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.353273:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc85c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353280:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc85c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353287:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc85c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353299:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc85c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353312:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.353319:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.353322:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc85c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353330:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.353333:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc85c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353342:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc85c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353353:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc85c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353360:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc85c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353377:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353379:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353381:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.353418:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.353428:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1d7021a/0x88da08396ccc85ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353436:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f8:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.353439:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.353443:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d7021a/0x88da08396ccc85ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353451:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1d7021a/0x88da08396ccc85ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353458:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1d7021a/0x88da08396ccc85ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353464:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1d7021a/0x88da08396ccc85ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353475:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.353482:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.353487:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1d7021a/0x88da08396ccc85ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353494:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.353497:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1d7021a/0x88da08396ccc85ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353504:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1d7021a/0x88da08396ccc85ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353520:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1d7021a/0x88da08396ccc85ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353527:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1d7021a/0x88da08396ccc85ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353541:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353542:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353545:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.353596:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.353601:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da647b6/0x88da08396ccc85d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353608:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f7:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.353611:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.353615:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da647b6/0x88da08396ccc85d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353624:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000da647b6/0x88da08396ccc85d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353631:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da647b6/0x88da08396ccc85d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353637:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000da647b6/0x88da08396ccc85d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353659:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.353666:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.353680:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000da647b6/0x88da08396ccc85d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353688:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.353692:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000da647b6/0x88da08396ccc85d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353700:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000da647b6/0x88da08396ccc85d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353712:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000da647b6/0x88da08396ccc85d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353719:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000da647b6/0x88da08396ccc85d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353733:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353735:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353737:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.353781:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.353786:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc85d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353792:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f6:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.353819:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.353823:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc85d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353831:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc85d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353838:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc85d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353845:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc85d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353855:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.353861:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.353864:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc85d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353870:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.353873:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc85d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353880:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc85d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353889:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc85d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353904:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc85d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353917:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353919:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.353922:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.353960:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.353965:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc85df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353972:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f5:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.353975:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.353979:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc85df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353988:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc85df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.353995:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc85df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354001:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc85df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354013:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.354025:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.354029:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc85df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354035:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.354039:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc85df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354046:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc85df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354058:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc85df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354064:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc85df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354078:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354080:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354082:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.354118:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.354122:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc85e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354129:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f4:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.354132:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.354136:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc85e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354153:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc85e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354161:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc85e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354168:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc85e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354181:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.354188:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.354192:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc85e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354199:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.354202:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc85e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354210:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc85e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354221:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc85e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354227:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc85e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354246:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354261:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354263:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.354302:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.354307:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc85ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354314:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f3:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.354317:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.354322:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc85ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354330:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc85ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354337:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc85ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354343:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc85ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354354:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.354360:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.354363:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc85ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354379:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.354382:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc85ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354389:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc85ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354398:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc85ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354405:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc85ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354417:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354419:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354421:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.354459:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.354463:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc85f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354470:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f2:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.354473:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.354477:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc85f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354485:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc85f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354498:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc85f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354505:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc85f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354517:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.354524:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.354528:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc85f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354534:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.354537:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc85f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354544:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc85f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354554:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc85f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354560:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc85f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354573:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354582:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354584:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.354628:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.354634:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc85fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354642:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f1:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.354645:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.354648:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc85fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354657:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc85fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354664:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc85fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354685:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc85fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354700:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.354707:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.354711:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc85fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354716:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.354719:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc85fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354737:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc85fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354747:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc85fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354754:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc85fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354766:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354767:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354769:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.354831:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.354836:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8602 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354844:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f0:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.354847:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.354851:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354859:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354867:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354880:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354894:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.354902:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.354906:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354913:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.354916:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354924:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8602 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354935:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8602 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354942:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8602 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.354957:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354959:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.354961:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.355009:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.355021:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8609 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355029:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ef:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.355032:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.355036:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355045:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355052:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355058:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355070:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.355077:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.355081:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355087:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.355090:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355097:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355113:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8609 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355119:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8609 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355132:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.355133:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.355135:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.355178:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.355183:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8610 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355190:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ee:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.355193:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.355197:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355205:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355213:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355220:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355242:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.355249:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.355254:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355260:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.355264:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355271:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8610 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355282:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8610 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355289:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8610 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355303:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.355305:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.355307:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.355351:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.355356:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc8617 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355364:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ed:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.355372:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.355376:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc8617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355384:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc8617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355391:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc8617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355398:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc8617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355412:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.355420:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.355425:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc8617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355431:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.355436:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc8617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355444:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc8617 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355455:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc8617 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355473:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041108f7a/0x88da08396ccc8617 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355486:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.355488:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.355490:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.355532:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.355538:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc861e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355546:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ec:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.355548:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.355552:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc861e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355561:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc861e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355569:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc861e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355576:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc861e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355589:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838048.355603:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.355608:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc861e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355615:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.355618:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc861e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355626:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc861e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355637:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc861e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355644:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e6dd992/0x88da08396ccc861e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.355657:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.355659:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.355662:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838048.356193:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788838048.356201:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb4b9c5d/0x88da08396ccc858b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838048.356290:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.356296:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e64a5d/0x88da08396ccc8625 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356304:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fb:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.356308:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.356313:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e64a5d/0x88da08396ccc8625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356323:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e64a5d/0x88da08396ccc8625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356332:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e64a5d/0x88da08396ccc8625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356339:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085e64a5d/0x88da08396ccc8625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356352:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838048.356388:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.356393:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b1fa70d/0x88da08396ccc862c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356400:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fa:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.356403:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.356413:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b1fa70d/0x88da08396ccc862c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356422:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b1fa70d/0x88da08396ccc862c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356430:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b1fa70d/0x88da08396ccc862c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356437:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b1fa70d/0x88da08396ccc862c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356450:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838048.356486:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.356491:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc8633 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356498:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f9:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.356501:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.356505:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc8633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356515:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc8633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356523:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc8633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356541:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc8633 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356678:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788838048.356725:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.356731:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008264b728/0x88da08396ccc863a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356739:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f8:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.356742:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.356747:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008264b728/0x88da08396ccc863a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356756:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008264b728/0x88da08396ccc863a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356764:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008264b728/0x88da08396ccc863a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356771:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008264b728/0x88da08396ccc863a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356781:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788838048.356849:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.356855:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e28b6a5/0x88da08396ccc8641 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356870:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f7:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.356873:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.356878:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e28b6a5/0x88da08396ccc8641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356888:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e28b6a5/0x88da08396ccc8641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356897:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e28b6a5/0x88da08396ccc8641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356904:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e28b6a5/0x88da08396ccc8641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356914:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788838048.356957:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.356963:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d82f29a7/0x88da08396ccc8648 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356971:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f6:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.356974:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.356978:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d82f29a7/0x88da08396ccc8648 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.356986:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d82f29a7/0x88da08396ccc8648 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357005:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d82f29a7/0x88da08396ccc8648 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357012:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d82f29a7/0x88da08396ccc8648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357021:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788838048.357059:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.357065:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073ae1192/0x88da08396ccc864f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357073:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f5:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.357076:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.357080:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073ae1192/0x88da08396ccc864f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357088:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073ae1192/0x88da08396ccc864f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357097:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073ae1192/0x88da08396ccc864f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357103:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073ae1192/0x88da08396ccc864f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357121:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788838048.357224:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.357230:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f442d3/0x88da08396ccc8656 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357238:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f4:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.357241:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.357244:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090f442d3/0x88da08396ccc8656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357253:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090f442d3/0x88da08396ccc8656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357261:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f442d3/0x88da08396ccc8656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357268:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090f442d3/0x88da08396ccc8656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357276:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788838048.357309:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.357314:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d30641b/0x88da08396ccc865d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357322:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f3:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.357330:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.357335:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d30641b/0x88da08396ccc865d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357344:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d30641b/0x88da08396ccc865d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357352:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d30641b/0x88da08396ccc865d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357358:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d30641b/0x88da08396ccc865d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357369:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788838048.357402:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.357407:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f5d4818/0x88da08396ccc8664 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357415:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f2:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.357418:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.357422:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f5d4818/0x88da08396ccc8664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357431:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f5d4818/0x88da08396ccc8664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357439:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f5d4818/0x88da08396ccc8664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357452:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f5d4818/0x88da08396ccc8664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357460:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1788838048.357494:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.357499:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fee0e0d/0x88da08396ccc866b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357506:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f1:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.357509:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.357513:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fee0e0d/0x88da08396ccc866b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357523:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fee0e0d/0x88da08396ccc866b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357531:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fee0e0d/0x88da08396ccc866b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357539:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fee0e0d/0x88da08396ccc866b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357546:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1788838048.357649:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.357655:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eb753c4/0x88da08396ccc8672 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357668:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f0:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.357679:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.357684:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009eb753c4/0x88da08396ccc8672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357693:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009eb753c4/0x88da08396ccc8672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357701:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009eb753c4/0x88da08396ccc8672 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357708:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009eb753c4/0x88da08396ccc8672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357718:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1788838048.357759:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.357764:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2bf1250/0x88da08396ccc8679 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357772:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ef:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.357774:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.357778:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2bf1250/0x88da08396ccc8679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357786:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2bf1250/0x88da08396ccc8679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357834:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2bf1250/0x88da08396ccc8679 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357841:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2bf1250/0x88da08396ccc8679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357850:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1788838048.357891:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.357897:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccc8680 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357905:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ee:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.357908:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.357912:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccc8680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357922:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccc8680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357930:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccc8680 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357937:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccc8680 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.357957:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1788838048.358001:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.358006:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc8687 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358013:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ed:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.358015:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.358019:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc8687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358028:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc8687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358035:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc8687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358043:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc8687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358051:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1788838048.358089:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.358094:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc868e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358102:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ec:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.358111:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.358116:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc868e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358125:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc868e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358133:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc868e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358140:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc868e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358317:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1788838048.358360:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.358366:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a37efb/0x88da08396ccc8695 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358374:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2eb:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.358378:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.358382:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a37efb/0x88da08396ccc8695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358392:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9a37efb/0x88da08396ccc8695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358401:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a37efb/0x88da08396ccc8695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358416:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a37efb/0x88da08396ccc8695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358426:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1788838048.358466:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.358472:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d634831d/0x88da08396ccc869c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358480:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ea:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.358483:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.358487:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d634831d/0x88da08396ccc869c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358497:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d634831d/0x88da08396ccc869c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358506:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d634831d/0x88da08396ccc869c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358514:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d634831d/0x88da08396ccc869c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358522:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:3.0:1788838048.358643:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.358649:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba27507d/0x88da08396ccc86a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358663:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e9:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.358666:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.358678:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba27507d/0x88da08396ccc86a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358688:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba27507d/0x88da08396ccc86a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358697:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba27507d/0x88da08396ccc86a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358704:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba27507d/0x88da08396ccc86a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358713:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:3.0:1788838048.358755:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.358760:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009463f16c/0x88da08396ccc86aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358768:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e8:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.358770:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.358774:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009463f16c/0x88da08396ccc86aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.358784:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009463f16c/0x88da08396ccc86aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.358923:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1788838048.358935:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085e64a5d/0x88da08396ccc8625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.358945:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.358950:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e64a5d/0x88da08396ccc8625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.358960:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e64a5d/0x88da08396ccc8625 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.358982:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085e64a5d/0x88da08396ccc8625 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.358992:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085e64a5d/0x88da08396ccc8625 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359018:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1788838048.359022:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b1fa70d/0x88da08396ccc862c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359029:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.359040:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b1fa70d/0x88da08396ccc862c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359048:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b1fa70d/0x88da08396ccc862c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359060:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b1fa70d/0x88da08396ccc862c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359068:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b1fa70d/0x88da08396ccc862c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359271:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1788838048.359275:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc8633 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359282:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.359285:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc8633 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359293:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc8633 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359305:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc8633 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359312:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098596178/0x88da08396ccc8633 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359334:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788838048.359338:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008264b728/0x88da08396ccc863a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359345:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.359348:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008264b728/0x88da08396ccc863a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359357:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008264b728/0x88da08396ccc863a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359367:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008264b728/0x88da08396ccc863a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359375:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008264b728/0x88da08396ccc863a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359387:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788838048.359391:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e28b6a5/0x88da08396ccc8641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359397:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.359401:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e28b6a5/0x88da08396ccc8641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359420:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e28b6a5/0x88da08396ccc8641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359432:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e28b6a5/0x88da08396ccc8641 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359439:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e28b6a5/0x88da08396ccc8641 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359453:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788838048.359457:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d82f29a7/0x88da08396ccc8648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359464:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.359467:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d82f29a7/0x88da08396ccc8648 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359476:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d82f29a7/0x88da08396ccc8648 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359485:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d82f29a7/0x88da08396ccc8648 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359493:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d82f29a7/0x88da08396ccc8648 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359517:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788838048.359521:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073ae1192/0x88da08396ccc864f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359528:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.359531:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073ae1192/0x88da08396ccc864f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359539:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073ae1192/0x88da08396ccc864f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.359550:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073ae1192/0x88da08396ccc864f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359719:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1788838048.359727:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090f442d3/0x88da08396ccc8656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359735:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.359738:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f442d3/0x88da08396ccc8656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359757:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f442d3/0x88da08396ccc8656 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359769:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090f442d3/0x88da08396ccc8656 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359776:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090f442d3/0x88da08396ccc8656 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359791:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788838048.359812:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d30641b/0x88da08396ccc865d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359820:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.359823:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d30641b/0x88da08396ccc865d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359831:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d30641b/0x88da08396ccc865d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359841:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d30641b/0x88da08396ccc865d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359847:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d30641b/0x88da08396ccc865d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359872:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788838048.359876:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f5d4818/0x88da08396ccc8664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359882:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.359885:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f5d4818/0x88da08396ccc8664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359892:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f5d4818/0x88da08396ccc8664 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359903:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f5d4818/0x88da08396ccc8664 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359910:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f5d4818/0x88da08396ccc8664 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359925:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788838048.359929:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fee0e0d/0x88da08396ccc866b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359935:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.359938:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fee0e0d/0x88da08396ccc866b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359956:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fee0e0d/0x88da08396ccc866b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359968:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fee0e0d/0x88da08396ccc866b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359976:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fee0e0d/0x88da08396ccc866b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359989:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788838048.359993:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009eb753c4/0x88da08396ccc8672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.359999:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.360002:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009eb753c4/0x88da08396ccc8672 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360011:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009eb753c4/0x88da08396ccc8672 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360022:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009eb753c4/0x88da08396ccc8672 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360029:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009eb753c4/0x88da08396ccc8672 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360055:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788838048.360059:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2bf1250/0x88da08396ccc8679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360066:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.360069:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2bf1250/0x88da08396ccc8679 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360077:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2bf1250/0x88da08396ccc8679 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360089:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2bf1250/0x88da08396ccc8679 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360096:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2bf1250/0x88da08396ccc8679 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360107:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788838048.360111:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccc8680 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360116:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.360119:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccc8680 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360136:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccc8680 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.360146:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccc8680 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360279:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009463f16c/0x88da08396ccc86aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360288:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009463f16c/0x88da08396ccc86aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360298:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788838048.360384:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.360390:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009df13184/0x88da08396ccc86b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360400:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e7:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.360404:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.360409:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009df13184/0x88da08396ccc86b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360421:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009df13184/0x88da08396ccc86b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360429:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009df13184/0x88da08396ccc86b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360436:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009df13184/0x88da08396ccc86b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360456:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788838048.360492:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.360497:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccc86b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360505:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e6:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.360507:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.360511:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccc86b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360520:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccc86b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360528:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccc86b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360535:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccc86b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.360543:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1788838048.360651:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073ae1192/0x88da08396ccc864f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360677:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788838048.360682:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc8687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360688:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.360692:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc8687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360712:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc8687 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360725:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc8687 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360733:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc8687 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360746:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788838048.360750:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc868e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360757:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.360760:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc868e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360767:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc868e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360776:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc868e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360783:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc868e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360822:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788838048.360826:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9a37efb/0x88da08396ccc8695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360833:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.360837:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a37efb/0x88da08396ccc8695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360844:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a37efb/0x88da08396ccc8695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360855:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9a37efb/0x88da08396ccc8695 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360861:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9a37efb/0x88da08396ccc8695 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360872:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788838048.360876:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d634831d/0x88da08396ccc869c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360882:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.360886:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d634831d/0x88da08396ccc869c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360903:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d634831d/0x88da08396ccc869c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360912:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d634831d/0x88da08396ccc869c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360919:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d634831d/0x88da08396ccc869c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360933:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788838048.360938:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba27507d/0x88da08396ccc86a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360944:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.360948:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba27507d/0x88da08396ccc86a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360956:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba27507d/0x88da08396ccc86a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360967:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba27507d/0x88da08396ccc86a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.360974:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba27507d/0x88da08396ccc86a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361005:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838048.361009:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009463f16c/0x88da08396ccc86aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361016:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.361020:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009463f16c/0x88da08396ccc86aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361028:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009463f16c/0x88da08396ccc86aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361041:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009463f16c/0x88da08396ccc86aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361048:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009463f16c/0x88da08396ccc86aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361068:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838048.361071:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009df13184/0x88da08396ccc86b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361078:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.361081:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009df13184/0x88da08396ccc86b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361101:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009df13184/0x88da08396ccc86b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361111:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009df13184/0x88da08396ccc86b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361118:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009df13184/0x88da08396ccc86b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361130:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.361134:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccc86b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.361140:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.361143:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccc86b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838048.361286:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.361293:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccc86bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361301:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e5:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.361311:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.361316:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccc86bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361326:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccc86bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361334:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccc86bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361341:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccc86bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361349:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838048.361388:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.361393:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f0f0d19/0x88da08396ccc86c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361400:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e4:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.361403:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.361407:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f0f0d19/0x88da08396ccc86c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361415:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f0f0d19/0x88da08396ccc86c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361423:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f0f0d19/0x88da08396ccc86c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361436:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f0f0d19/0x88da08396ccc86c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361445:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838048.361481:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.361486:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf645de3/0x88da08396ccc86cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361493:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e3:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.361496:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.361500:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf645de3/0x88da08396ccc86cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361508:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf645de3/0x88da08396ccc86cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361516:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf645de3/0x88da08396ccc86cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361523:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf645de3/0x88da08396ccc86cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.361531:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788838048.361651:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccc8680 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361681:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838048.361685:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccc86bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361692:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.361695:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccc86bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361704:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccc86bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361718:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccc86bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361724:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccc86bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361748:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838048.361752:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f0f0d19/0x88da08396ccc86c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361758:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297b800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.361761:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f0f0d19/0x88da08396ccc86c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361768:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f0f0d19/0x88da08396ccc86c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361778:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f0f0d19/0x88da08396ccc86c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361786:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f0f0d19/0x88da08396ccc86c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361816:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838048.361820:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf645de3/0x88da08396ccc86cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361827:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297ba00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838048.361830:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf645de3/0x88da08396ccc86cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361851:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf645de3/0x88da08396ccc86cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361863:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf645de3/0x88da08396ccc86cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361870:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf645de3/0x88da08396ccc86cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.361883:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.361885:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.361888:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838048.361898:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838048.361958:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838048.361969:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc86d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362024:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccc86b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838048.362081:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838048.362087:0:26213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e673e4/0x88da08396ccc86db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.362101:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e2:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:3.0:1788838048.362104:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838048.362109:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e673e4/0x88da08396ccc86db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.362119:0:26213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3e673e4/0x88da08396ccc86db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.362127:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e673e4/0x88da08396ccc86db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838048.362135:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e673e4/0x88da08396ccc86db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362244:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccc86b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362252:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccc86b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362278:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.362282:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3e673e4/0x88da08396ccc86db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.362302:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2eb:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:1.0:1788838048.362305:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838048.362310:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc86d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.362321:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc86d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.362329:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc86d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.362342:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc86d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362374:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297a800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.362377:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e673e4/0x88da08396ccc86db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362385:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e673e4/0x88da08396ccc86db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362396:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3e673e4/0x88da08396ccc86db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362418:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.362447:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc86d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362456:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.362459:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc86d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362467:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc86d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362489:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc86d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.362498:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.362499:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838048.362530:0:26213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788838048.362535:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3e673e4/0x88da08396ccc86db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788838048.363190:0:26213:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:3.0:1788838048.363295:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:87124:x1875729135005952:12345-0@lo:5:osp-pre-1-0.0 Request processed in 35874us (36418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838048.363306:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5929 00010000:00010000:1.0:1788838048.363480:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788838048.363486:0:26214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc86d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838048.363513:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838048.363582:0:87124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87124:1875729135005952:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788838048.363596:0:87124:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x301:0x0] from OST, last_created [0x2c0000401:0x301:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1788838048.363666:0:87124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f744e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87124:1875729135006336:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788838048.363714:0:87124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838048.363738:0:87124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608ea6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838048.363753:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135006208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838048.363779:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838048.363850:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135006336 00000100:00100000:1.0:1788838048.363856:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135006336 00000100:00100000:1.0:1788838048.363898:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5931 00000100:00100000:1.0:1788838048.363907:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:87124:x1875729135006336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788838048.363950:0:8657:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 770 00010000:00010000:3.0:1788838048.364726:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838048.366770:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:87124:x1875729135006336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2856us (3046us total) trans 4294969450 rc 0/0 00000100:00100000:1.0:1788838048.366784:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5931 00000100:00100000:1.0:1788838048.366907:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135006208 00000100:00100000:1.0:1788838048.366916:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135006208 00000100:00100000:1.0:1788838048.366961:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1788838048.366968:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135006208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838048.366990:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00010000:00010000:0.0:1788838048.367105:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.367126:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838048.367190:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135006208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (3409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838048.367198:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:0.0:1788838048.367761:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135006208:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1788838048.367963:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.367973:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc86e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.367994:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ea:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788838048.368000:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838048.368006:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc86e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368020:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc86e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368030:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc86e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368038:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc86e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368072:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838048.368117:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.368123:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc86e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368131:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e9:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788838048.368134:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838048.368138:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc86e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368161:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc86e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368169:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc86e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368177:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc86e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368194:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788838048.368212:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838048.368223:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc86e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838048.368237:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.368246:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc86f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.368254:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.368258:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e8:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:2.0:1788838048.368261:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc86e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368273:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838048.368279:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc86e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368280:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc86f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368296:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc86f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368304:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc86f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368311:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc86f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368325:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838048.368335:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838048.368340:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc86e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368348:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.368351:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc86e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368359:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc86e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368378:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc86e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368396:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dffee80/0x88da08396ccc86e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368416:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.368419:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc86f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368426:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.368429:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc86f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368436:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc86f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368446:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc86f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368453:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000954f775d/0x88da08396ccc86f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368463:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.368465:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.368466:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838048.368511:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.368517:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a6ca11/0x88da08396ccc86f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368530:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e7:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788838048.368533:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838048.368537:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a6ca11/0x88da08396ccc86f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368545:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6a6ca11/0x88da08396ccc86f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.368679:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc86e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368688:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a6ca11/0x88da08396ccc86f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.368691:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069abe6ce/0x88da08396ccc86e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368706:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a6ca11/0x88da08396ccc86f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.368721:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.368724:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788838048.368727:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6a6ca11/0x88da08396ccc86f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368734:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.368737:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838048.368742:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a6ca11/0x88da08396ccc86f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.368751:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a6ca11/0x88da08396ccc86f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.368764:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6a6ca11/0x88da08396ccc86f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.368779:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6a6ca11/0x88da08396ccc86f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838048.368783:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.368793:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc86fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368823:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e6:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788838048.368826:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838048.368830:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc86fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368840:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc86fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368855:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc86fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368862:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc86fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368875:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838048.368883:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.368887:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc86fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368893:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.368897:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc86fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368904:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc86fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368916:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc86fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368923:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc86fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.368938:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.368948:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.368949:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838048.368999:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.369004:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8705 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369011:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e5:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788838048.369014:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838048.369017:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369026:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369033:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8705 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369039:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369051:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838048.369057:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.369058:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.369064:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369073:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838048.369077:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8705 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369087:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8705 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369099:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8705 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838048.369100:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.369107:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b28a2e5/0x88da08396ccc870c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369115:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e4:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788838048.369117:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838048.369126:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b28a2e5/0x88da08396ccc870c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369135:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b28a2e5/0x88da08396ccc870c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369142:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b28a2e5/0x88da08396ccc870c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369176:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8705 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369192:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.369194:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.369196:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.369218:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b28a2e5/0x88da08396ccc870c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369237:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838048.369258:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838048.369264:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b28a2e5/0x88da08396ccc870c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369278:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f800 already unused, calling callback (ffffffffc0dd5350) 00002000:00010000:0.0:1788838048.369281:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838048.369282:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b28a2e5/0x88da08396ccc870c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369291:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396ccc8713 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369296:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b28a2e5/0x88da08396ccc870c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369307:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e3:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788838048.369312:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838048.369315:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b28a2e5/0x88da08396ccc870c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369317:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396ccc8713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369340:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396ccc8713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369350:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396ccc8713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369369:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396ccc8713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369383:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838048.369391:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838048.369395:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396ccc8713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369401:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718ec00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838048.369404:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396ccc8713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369407:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b28a2e5/0x88da08396ccc870c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369413:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396ccc8713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369431:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396ccc8713 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369434:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.369437:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.369440:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.369443:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396ccc8713 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369459:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.369461:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838048.369462:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838048.369505:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838048.369516:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc871a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369524:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e2:0x0].0x0 since=3442s v=(0 0) 00010000:00010000:0.0:1788838048.369526:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838048.369530:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc871a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369538:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc871a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369545:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc871a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369635:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc871a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838048.369655:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838048.369709:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838048.369715:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc871a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369724:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838048.369729:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc871a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369739:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc871a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369761:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc871a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369770:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc871a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838048.369789:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.369791:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.369794:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838048.369843:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838048.373351:0:87124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f744e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87124:1875729135006336:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788838048.373375:0:87124:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x301:0x0]-[0x2c0000401:0x321:0x0] 00002000:00080000:0.0:1788838048.379207:0:26214:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:0.0:1788838048.379341:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:87122:x1875729135006080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 43381us (49989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838048.379353:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5930 00000100:00100000:2.0:1788838048.379942:0:87122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87122:1875729135006080:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788838048.379959:0:87122:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x301:0x0] from OST, last_created [0x280000401:0x301:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:1.0:1788838048.380043:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135006464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838048.380109:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838048.380167:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135006464 00000100:00100000:0.0:1788838048.380174:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135006464 00000100:00100000:2.0:1788838048.380194:0:87122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87122:1875729135006592:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788838048.380223:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:2.0:1788838048.380230:0:87122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838048.380235:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135006464:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838048.380255:0:87122:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608b99900 going to sleep for 11 seconds 00002000:00000024:0.0:1788838048.380259:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838048.386285:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135006464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6045us (6167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838048.386299:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1788838048.391552:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135006464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838048.391594:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135006592 00000100:00100000:1.0:1788838048.391598:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135006592 00000100:00100000:1.0:1788838048.391714:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5932 00000100:00100000:1.0:1788838048.391724:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:87122:x1875729135006592:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788838048.391771:0:26207:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 770 00000100:00100000:0.0:1788838048.394162:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:87122:x1875729135006592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2426us (13919us total) trans 4294969450 rc 0/0 00000100:00100000:0.0:1788838048.394177:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5932 00000100:00100000:3.0:1788838048.394277:0:87122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87122:1875729135006592:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788838048.394294:0:87122:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x301:0x0]-[0x280000401:0x321:0x0] 00010000:00010000:2.0:1788838048.701632:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788838049.159601:0:87442:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838049.165187:0:87442:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788838049.343053:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838049.343089:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838049.343115:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838049.343189:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116391936 00000100:00100000:3.0:1788838049.343202:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116391936 00000100:00100000:3.0:1788838049.343262:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:3.0:1788838049.343273:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2407:x1875729116391936:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838049.343341:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2407:x1875729116391936:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 70us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838049.343348:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:3.0:1788838049.343385:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116392192 00000100:00100000:3.0:1788838049.343389:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116392192 00000100:00100000:3.0:1788838049.343418:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116392064 00000100:00100000:3.0:1788838049.343421:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116392064 00000100:00100000:3.0:1788838049.343441:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1130 00000100:00100000:3.0:1788838049.343447:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116392192:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838049.343480:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116392192:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 33us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838049.343486:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1130 00000100:00100000:3.0:1788838049.343497:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1131 00000100:00100000:3.0:1788838049.343503:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116392064:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838049.343525:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116392064:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838049.343531:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1131 00010000:00010000:0.0:1788838049.726950:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788838050.136037:0:87492:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838050.136582:0:87492:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788838050.749963:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838051.773566:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838052.206986:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838052.210197:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116392320 00000100:00100000:1.0:1788838052.210217:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116392320 00000100:00100000:1.0:1788838052.210339:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1142 00000100:00100000:1.0:1788838052.210351:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:66688:x1875729116392320:12345-192.168.203.30@tcp:101:lfs.0 00000100:00080000:3.0:1788838052.210503:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788838052.210930:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838052.210968:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1400/0x88da08396ccc8721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc3d expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.211058:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0400/0x88da08396ccc8728 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.211291:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0400/0x88da08396ccc8728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.211307:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0400/0x88da08396ccc8728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838052.211449:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788838052.211453:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788838052.211504:0:66255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0400/0x88da08396ccc8728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.211603:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1400/0x88da08396ccc8721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc3d expref: 8 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.211628:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0400/0x88da08396ccc8728 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc3d expref: 7 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838052.211637:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff624400400) 00010000:00010000:1.0:1788838052.211641:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788838052.211655:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff505bb0400, rc 0) 00000100:00100000:1.0:1788838052.211758:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66688:x1875729116392320:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1407us (4788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838052.211767:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1142 00000100:00100000:2.0:1788838052.221498:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135006720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838052.221633:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838052.221840:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135006720 00000100:00100000:1.0:1788838052.221851:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135006720 00000100:00100000:1.0:1788838052.221965:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:1.0:1788838052.221979:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135006720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838052.222024:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838052.222094:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135006720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838052.222102:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:0.0:1788838052.222610:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838052.222627:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135006848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838052.222688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788838052.222839:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838052.222897:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135006720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838052.222982:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135006848 00000100:00100000:3.0:1788838052.222999:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135006848 00000100:00100000:3.0:1788838052.223056:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:3.0:1788838052.223067:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135006848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838052.223092:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838052.223273:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135006848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 208us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838052.223281:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:3.0:1788838052.223315:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135006848:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788838052.223380:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838052.226170:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838052.226851:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116392448 00000100:00100000:0.0:1788838052.226866:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116392448 00000100:00100000:0.0:1788838052.226955:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1143 00000100:00100000:0.0:1788838052.226968:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66688:x1875729116392448:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1788838052.227024:0:66254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:0.0:1788838052.227156:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:66688:x1875729116392448:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 190us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.227166:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1143 00000100:00100000:2.0:1788838052.229989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838052.234699:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116392576 00000100:00100000:3.0:1788838052.234726:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116392576 00000100:00100000:3.0:1788838052.234863:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1144 00000100:00100000:3.0:1788838052.234879:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:66688:x1875729116392576:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838052.234936:0:67312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838052.235051:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:66688:x1875729116392576:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 177us (5077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838052.235059:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1144 00000100:00080000:2.0:1788838052.235276:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838052.238087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838052.238273:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116392704 00000100:00100000:0.0:1788838052.238288:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116392704 00000100:00100000:0.0:1788838052.238348:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5933 00000100:00100000:0.0:1788838052.238367:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2403:x1875729116392704:12345-192.168.203.30@tcp:8:lfs.0 00010000:00080000:0.0:1788838052.238415:0:26206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp t0 exp 0000000000000000 cur 3446 last 0 00000020:00000080:0.0:1788838052.238463:0:26206:0:(genops.c:1385:class_connect()) connect: client fdcf066d-ff07-4b2e-96ab-52415ed6bf72, cookie 0x88da08396ccc872f 00002000:00100000:0.0:1788838052.238481:0:26206:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fdcf066d-ff07-4b2e-96ab-52415ed6bf72/ffff8ff50a9bb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788838052.238496:0:26206:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788838052.238612:0:26206:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788838052.238672:0:26206:0:(import.c:65:import_set_state_nolock()) ffff8ff50a9bd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838052.238767:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116392704:12345-192.168.203.30@tcp:8:lfs.0 Request processed in 407us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.238776:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5933 00000100:00100000:1.0:1788838052.246959:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838052.247072:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116392832 00000100:00100000:0.0:1788838052.247089:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116392832 00000100:00100000:0.0:1788838052.247354:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1954 00000100:00100000:0.0:1788838052.247376:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:66688:x1875729116392832:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:0.0:1788838052.247412:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838052.247514:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:66688:x1875729116392832:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 141us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.247522:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1954 00000100:00080000:2.0:1788838052.248215:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838052.252086:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838052.252735:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116392960 00000100:00100000:3.0:1788838052.252750:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116392960 00000100:00100000:3.0:1788838052.252836:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5934 00000100:00100000:3.0:1788838052.252847:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2403:x1875729116392960:12345-192.168.203.30@tcp:8:lfs.0 00010000:00080000:3.0:1788838052.252897:0:26218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp t0 exp 0000000000000000 cur 3446 last 0 00000020:00000080:3.0:1788838052.252939:0:26218:0:(genops.c:1385:class_connect()) connect: client fdcf066d-ff07-4b2e-96ab-52415ed6bf72, cookie 0x88da08396ccc8736 00002000:00100000:3.0:1788838052.252956:0:26218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fdcf066d-ff07-4b2e-96ab-52415ed6bf72/ffff8ff609257000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788838052.252972:0:26218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788838052.253087:0:26218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788838052.253286:0:26218:0:(import.c:65:import_set_state_nolock()) ffff8ff609253000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838052.254085:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116392960:12345-192.168.203.30@tcp:8:lfs.0 Request processed in 1231us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838052.254097:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5934 00000100:00100000:1.0:1788838052.266418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838052.266575:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116393088 00000100:00100000:0.0:1788838052.266589:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116393088 00000100:00100000:0.0:1788838052.266696:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1955 00000100:00100000:0.0:1788838052.266710:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:66688:x1875729116393088:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:0.0:1788838052.266745:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838052.266875:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:66688:x1875729116393088:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 167us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838052.266884:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1955 00000100:00080000:2.0:1788838052.267063:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788838052.797393:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838053.245284:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135007232:0@lo:400:kworker.0 00000100:00100000:1.0:1788838053.245498:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838053.245560:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135007616:0@lo:400:kworker.0 00000100:00100000:2.0:1788838053.245579:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135007104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838053.245623:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838053.245692:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135006976:0@lo:400:kworker.0 00000100:00100000:0.0:1788838053.246406:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135007232 00000100:00100000:0.0:1788838053.246420:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135007232 00000100:00100000:0.0:1788838053.246530:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1788838053.246553:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135007232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838053.252384:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838053.252489:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135008128:0@lo:400:kworker.0 00000100:00100000:1.0:1788838053.252543:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838053.252584:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135008640:0@lo:400:kworker.0 00000100:00100000:1.0:1788838053.252619:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838053.252655:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788838053.252665:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135007360:0@lo:400:kworker.0 00000100:00100000:1.0:1788838053.252691:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838053.252712:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135007744:0@lo:400:kworker.0 00000100:00100000:1.0:1788838053.252741:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838053.252762:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135008256:0@lo:400:kworker.0 00000100:00100000:1.0:1788838053.252786:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838053.252862:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135007616 00000100:00100000:1.0:1788838053.252873:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135007616 00000100:00100000:1.0:1788838053.252949:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135008128 00000100:00100000:1.0:1788838053.252952:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135008128 00000100:00100000:1.0:1788838053.252967:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135008640 00000100:00100000:1.0:1788838053.252970:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135008640 00000100:00100000:1.0:1788838053.253004:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135007360 00000100:00100000:1.0:1788838053.253007:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135007360 00000100:00100000:1.0:1788838053.253028:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:1.0:1788838053.253038:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135007616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838053.253106:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135007872:0@lo:400:kworker.0 00000100:00100000:1.0:1788838053.253123:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135007616:12345-0@lo:400:kworker.0 Request processed in 84us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.253132:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1788838053.253150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838053.253177:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135008384:0@lo:400:kworker.0 00000100:00100000:2.0:1788838053.253203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838053.253245:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135007104 00000100:00100000:2.0:1788838053.253250:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135007104 00000100:00100000:1.0:1788838053.253294:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1788838053.253302:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135008128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838053.253336:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135008128:12345-0@lo:400:kworker.0 Request processed in 35us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.253343:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1788838053.253357:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1788838053.253364:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135008640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838053.253381:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135007744 00000100:00100000:2.0:1788838053.253387:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135007744 00000100:00100000:1.0:1788838053.253398:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135008640:12345-0@lo:400:kworker.0 Request processed in 34us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838053.253407:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135008256 00000100:00100000:1.0:1788838053.253407:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1788838053.253412:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135008256 00000100:00100000:1.0:1788838053.253425:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1788838053.253433:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:1.0:1788838053.253437:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135007360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838053.253445:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135007104:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838053.253473:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135007360:12345-0@lo:400:kworker.0 Request processed in 39us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.253481:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000004:00000024:2.0:1788838053.253486:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:1.0:1788838053.253509:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:1.0:1788838053.253517:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135007744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838053.253550:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135007744:12345-0@lo:400:kworker.0 Request processed in 33us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.253757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838053.253812:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135007488:0@lo:400:kworker.0 00000100:00100000:3.0:1788838053.253843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838053.253865:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135008000:0@lo:400:kworker.0 00000100:00100000:3.0:1788838053.253890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838053.253918:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135007872 00000100:00100000:3.0:1788838053.253923:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135007872 00000100:00100000:3.0:1788838053.253953:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135008384 00000100:00100000:3.0:1788838053.253956:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135008384 00000100:00100000:0.0:1788838053.254075:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135007488 00000100:00100000:0.0:1788838053.254087:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135007488 00000100:00100000:0.0:1788838053.254125:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1788838053.254132:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135007488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838053.254172:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135007488:12345-0@lo:400:kworker.0 Request processed in 41us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.254179:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1788838053.254379:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135007104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 936us (8754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838053.254395:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1788838053.254414:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:2.0:1788838053.254421:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135008256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838053.254456:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135008256:12345-0@lo:400:kworker.0 Request processed in 36us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838053.254463:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:2.0:1788838053.254487:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135006976 00000100:00100000:2.0:1788838053.254491:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135006976 00000100:00100000:3.0:1788838053.254709:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135008000 00000100:00100000:3.0:1788838053.254714:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135008000 00000100:00100000:3.0:1788838053.254737:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:3.0:1788838053.254743:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135007872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838053.254782:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135007872:12345-0@lo:400:kworker.0 Request processed in 38us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.254788:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:3.0:1788838053.254818:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:3.0:1788838053.254824:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135008384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838053.254850:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135008384:12345-0@lo:400:kworker.0 Request processed in 27us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.254856:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00100000:3.0:1788838053.254875:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:3.0:1788838053.254881:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135008000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838053.254906:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135008000:12345-0@lo:400:kworker.0 Request processed in 25us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.254912:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:0.0:1788838053.255220:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135007232:12345-0@lo:400:kworker.0 Request processed in 8680us (9732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838053.255229:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1788838053.255477:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788838053.255486:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135006976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838053.256085:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135006976:12345-0@lo:400:kworker.0 Request processed in 597us (2326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838053.256094:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788838053.256134:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838053.256140:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838053.256143:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838053.256187:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135007104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838053.256202:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135007872:0@lo:400:kworker.0 00000100:00100000:2.0:1788838053.256216:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135008384:0@lo:400:kworker.0 00000100:00100000:3.0:1788838053.256393:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135008000:0@lo:400:kworker.0 00000100:00100000:3.0:1788838053.256406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135008512:0@lo:400:kworker.0 00000100:00100000:3.0:1788838053.256449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838053.256487:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135008512 00000100:00100000:3.0:1788838053.256493:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135008512 00000100:00100000:1.0:1788838053.256704:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000100:00100000:1.0:1788838053.256820:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135007360:0@lo:400:kworker.0 00000100:00100000:0.0:1788838053.256869:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135007744:0@lo:400:kworker.0 00000100:00100000:0.0:1788838053.256884:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135008256:0@lo:400:kworker.0 00000100:00100000:0.0:1788838053.256896:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135008128:0@lo:400:kworker.0 00000100:00100000:0.0:1788838053.256911:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135008640:0@lo:400:kworker.0 00000100:00100000:0.0:1788838053.256923:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135007232:0@lo:400:kworker.0 00000100:00100000:0.0:1788838053.256935:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135007616:0@lo:400:kworker.0 00000100:00100000:3.0:1788838053.257475:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:3.0:1788838053.257485:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135008512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838053.257868:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135006976:0@lo:400:kworker.0 00000100:00100000:2.0:1788838053.257886:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135007488:0@lo:400:kworker.0 00000100:00100000:3.0:1788838053.258466:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135008512:12345-0@lo:400:kworker.0 Request processed in 981us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.258476:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:2.0:1788838053.259154:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135008512:0@lo:400:kworker.0 00000100:00080000:1.0:1788838053.260862:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838053.761182:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838053.761209:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135008768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838053.761240:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135008896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838053.761294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838053.761296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838053.761340:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838053.761347:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135009024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838053.761371:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838053.761405:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135008896 00000100:00100000:1.0:1788838053.761412:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135008896 00000100:00100000:1.0:1788838053.761455:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135009024 00000100:00100000:1.0:1788838053.761458:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135009024 00000100:00100000:1.0:1788838053.761484:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:1.0:1788838053.761497:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135008896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838053.761522:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838053.761570:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135008896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.761577:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:1.0:1788838053.761595:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:1.0:1788838053.761604:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135009024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838053.761616:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838053.761656:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135009024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838053.761663:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:1.0:1788838053.761707:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135009024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838053.761735:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135008896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838053.761831:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135008768 00000100:00100000:3.0:1788838053.761836:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135008768 00000100:00100000:3.0:1788838053.761874:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:3.0:1788838053.761882:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135008768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838053.761908:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:3.0:1788838053.761967:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135008768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838053.761975:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:1.0:1788838053.762390:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135008768:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1788838053.766945:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00080000:3.0:1788838053.766964:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969450 is committed 00000001:00100000:1.0:1788838053.782401:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00080000:1.0:1788838053.782421:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969450 is committed 00010000:00010000:0.0:1788838053.820917:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838054.466849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838054.466893:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838054.466914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838054.466947:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838054.466980:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116393344 00000100:00100000:1.0:1788838054.466990:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116393344 00000100:00100000:1.0:1788838054.467064:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116393472 00000100:00100000:1.0:1788838054.467068:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116393472 00000100:00100000:1.0:1788838054.467093:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1138 00000100:00100000:1.0:1788838054.467103:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2405:x1875729116393344:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838054.467179:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2405:x1875729116393344:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 77us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838054.467187:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1138 00000100:00100000:1.0:1788838054.467203:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1139 00000100:00100000:1.0:1788838054.467210:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116393472:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838054.467238:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116393472:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838054.467245:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1139 00000100:00100000:1.0:1788838054.467265:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116393728 00000100:00100000:1.0:1788838054.467268:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116393728 00000100:00100000:1.0:1788838054.467294:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2478 00000100:00100000:1.0:1788838054.467319:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116393728:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838054.467351:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116393728:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838054.467358:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2478 00000100:00080000:1.0:1788838054.467375:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838054.467380:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838054.467382:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838054.467701:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116393216 00000100:00100000:3.0:1788838054.467714:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116393216 00000100:00100000:3.0:1788838054.467754:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:3.0:1788838054.467761:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff507117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116393216:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838054.467815:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff507117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116393216:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838054.467822:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:1.0:1788838054.475981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838054.476056:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116393600 00000100:00100000:0.0:1788838054.476067:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116393600 00000100:00100000:0.0:1788838054.476153:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2479 00000100:00100000:0.0:1788838054.476167:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116393600:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838054.476252:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116393600:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838054.476274:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2479 00000100:00080000:1.0:1788838054.476339:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788838054.846134:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838055.870886:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838056.896637:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838057.343909:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838057.343952:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135009152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838057.344051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838057.344311:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838057.344324:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135009280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838057.344357:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838057.344430:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135009152 00000100:00100000:3.0:1788838057.344439:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135009152 00000100:00100000:3.0:1788838057.344500:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135009280 00000100:00100000:3.0:1788838057.344504:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135009280 00000100:00100000:3.0:1788838057.344525:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1788838057.344533:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135009152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838057.344561:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838057.344602:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135009152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838057.344619:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1788838057.344637:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:3.0:1788838057.344643:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135009280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838057.344658:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838057.344701:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135009280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838057.344707:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00080000:1.0:1788838057.344931:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838057.344935:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838057.344974:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135009280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838057.345687:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135009152:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788838057.917369:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838058.365160:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135009664:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.365258:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838058.365296:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135010176:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.365331:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838058.365346:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135010688:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.365362:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838058.365386:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788838058.365391:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135009792:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.365410:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838058.365424:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135010304:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.365441:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838058.365453:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135010816:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.365469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838058.365506:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135009664 00000100:00100000:3.0:1788838058.365514:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135009664 00000100:00100000:3.0:1788838058.365571:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135009792 00000100:00100000:3.0:1788838058.365573:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135009792 00000100:00100000:3.0:1788838058.365596:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1788838058.365618:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135009664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.365687:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135009664:12345-0@lo:400:kworker.0 Request processed in 82us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838058.365694:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1788838058.365713:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1788838058.365719:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135009792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.365742:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135009792:12345-0@lo:400:kworker.0 Request processed in 24us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838058.365748:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00080000:3.0:1788838058.365763:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838058.365767:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838058.365839:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135009792:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366041:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135009408:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838058.366128:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135009920:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838058.366172:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135010432:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838058.366211:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135010944:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838058.366253:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788838058.366259:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135009536:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838058.366290:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135010048:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838058.366326:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135010560:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366343:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838058.366370:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135010176 00000100:00100000:0.0:1788838058.366375:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135010176 00000100:00100000:0.0:1788838058.366407:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135010688 00000100:00100000:0.0:1788838058.366409:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135010688 00000100:00100000:0.0:1788838058.366430:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135010304 00000100:00100000:0.0:1788838058.366432:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135010304 00000100:00100000:0.0:1788838058.366447:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135010816 00000100:00100000:0.0:1788838058.366449:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135010816 00000100:00100000:0.0:1788838058.366467:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:0.0:1788838058.366483:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135010176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366518:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135010176:12345-0@lo:400:kworker.0 Request processed in 36us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.366524:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00000100:00100000:0.0:1788838058.366539:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1788838058.366544:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135010688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366564:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135010688:12345-0@lo:400:kworker.0 Request processed in 20us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.366569:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1788838058.366577:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:0.0:1788838058.366582:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135010304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366601:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135010304:12345-0@lo:400:kworker.0 Request processed in 20us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.366618:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:0.0:1788838058.366627:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:0.0:1788838058.366633:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135010816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366654:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135010816:12345-0@lo:400:kworker.0 Request processed in 22us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.366660:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:0.0:1788838058.366692:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135009920 00000100:00100000:0.0:1788838058.366695:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135009920 00000100:00100000:0.0:1788838058.366720:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135010432 00000100:00100000:0.0:1788838058.366723:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135010432 00000100:00100000:0.0:1788838058.366732:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135010944 00000100:00100000:0.0:1788838058.366734:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135010944 00000100:00100000:0.0:1788838058.366742:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135009536 00000100:00100000:0.0:1788838058.366744:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135009536 00000100:00100000:0.0:1788838058.366765:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1788838058.366770:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135009920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.366827:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135009920:12345-0@lo:400:kworker.0 Request processed in 57us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.366833:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1788838058.367007:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1788838058.367015:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135010432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367044:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135010432:12345-0@lo:400:kworker.0 Request processed in 31us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.367050:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1788838058.367061:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1788838058.367066:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135010944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367148:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135010944:12345-0@lo:400:kworker.0 Request processed in 81us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.367155:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1788838058.367168:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1788838058.367174:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135009536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367204:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135009536:12345-0@lo:400:kworker.0 Request processed in 30us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.367210:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1788838058.367244:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135009408 00000100:00100000:0.0:1788838058.367249:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135009408 00000100:00100000:0.0:1788838058.367283:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788838058.367290:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135009408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367320:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135009408:12345-0@lo:400:kworker.0 Request processed in 31us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.367333:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788838058.367377:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135010048 00000100:00100000:0.0:1788838058.367381:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135010048 00000100:00100000:0.0:1788838058.367406:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135010560 00000100:00100000:0.0:1788838058.367409:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135010560 00000100:00100000:0.0:1788838058.367424:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:0.0:1788838058.367429:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135010048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367460:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135010048:12345-0@lo:400:kworker.0 Request processed in 30us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.367466:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:0.0:1788838058.367475:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:0.0:1788838058.367480:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135010560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367499:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135010560:12345-0@lo:400:kworker.0 Request processed in 19us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.367504:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00000100:00080000:0.0:1788838058.367547:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838058.367551:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838058.367553:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838058.367556:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838058.367591:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135009536:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367613:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135010048:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367625:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135010560:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367633:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135009408:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367643:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135009920:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.367664:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135010432:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.367936:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135010304:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.367947:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000100:00100000:3.0:1788838058.367965:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135010816:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.367976:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135009664:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.367986:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135010176:0@lo:400:kworker.0 00000100:00100000:3.0:1788838058.367996:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000100:00100000:3.0:1788838058.368005:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135010688:0@lo:400:kworker.0 00000100:00100000:2.0:1788838058.368456:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135011072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838058.368508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838058.368580:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135010944:0@lo:400:kworker.0 00000100:00100000:0.0:1788838058.368634:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135011072 00000100:00100000:0.0:1788838058.368640:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135011072 00000100:00100000:0.0:1788838058.368686:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:0.0:1788838058.368693:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135011072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788838058.368726:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788838058.375675:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135011072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6964us (7148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838058.375694:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00000100:00100000:2.0:1788838058.377367:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135011072:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788838058.651239:0:87686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:3.0:1788838058.887082:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135011200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838058.887186:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838058.887241:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838058.887298:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135011456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838058.887330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838058.887417:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135011328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838058.887444:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838058.887614:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135011328 00000100:00100000:2.0:1788838058.887627:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135011328 00000100:00100000:2.0:1788838058.887683:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:2.0:1788838058.887692:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135011328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838058.887729:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:2.0:1788838058.889708:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135011328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1999us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838058.889726:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000100:00100000:3.0:1788838058.890252:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135011200 00000100:00100000:3.0:1788838058.890267:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135011200 00000100:00100000:3.0:1788838058.890347:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135011456 00000100:00100000:3.0:1788838058.890351:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135011456 00000100:00100000:3.0:1788838058.890378:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1788838058.890391:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135011200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838058.890431:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838058.890520:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135011200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (3334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838058.890989:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1788838058.891014:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:3.0:1788838058.891041:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135011456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838058.891056:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838058.891720:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135011456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 673us (4380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838058.891730:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:2.0:1788838058.892498:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135011456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838058.892638:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135011328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838058.892665:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135011200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788838058.941781:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838059.600430:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838059.600629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838059.600642:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116393856 00000100:00100000:0.0:1788838059.600658:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116393856 00000100:00100000:1.0:1788838059.600739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838059.600748:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:0.0:1788838059.600765:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff507114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116393856:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838059.600784:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838059.600903:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff507114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116393856:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 141us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838059.600915:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:0.0:1788838059.600977:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116394112 00000100:00100000:0.0:1788838059.600981:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116394112 00000100:00100000:0.0:1788838059.601016:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116393984 00000100:00100000:0.0:1788838059.601020:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116393984 00000100:00100000:0.0:1788838059.601041:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1146 00000100:00100000:0.0:1788838059.601047:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116394112:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838059.601089:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116394112:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838059.601122:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1146 00000100:00100000:0.0:1788838059.601143:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1147 00000100:00100000:0.0:1788838059.601156:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116393984:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838059.601169:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838059.601208:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116393984:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 55us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838059.601216:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1147 00000100:00100000:0.0:1788838059.601252:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116394368 00000100:00100000:0.0:1788838059.601256:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116394368 00000100:00100000:0.0:1788838059.601282:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116394240 00000100:00100000:0.0:1788838059.601285:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116394240 00000100:00100000:0.0:1788838059.601306:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2484 00000100:00100000:0.0:1788838059.601312:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116394368:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838059.601348:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116394368:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838059.601361:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2484 00000100:00100000:0.0:1788838059.601391:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2485 00000100:00100000:0.0:1788838059.601404:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116394240:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:1.0:1788838059.601425:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838059.601432:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838059.601462:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116394240:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 60us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838059.601472:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2485 00000100:00080000:1.0:1788838059.601551:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788838059.601556:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788838059.971893:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788838060.319963:0:87734:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1788838060.991200:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838062.013016:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838062.199847:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838062.200365:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116394496 00000100:00100000:0.0:1788838062.200376:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116394496 00000100:00100000:0.0:1788838062.200454:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1145 00000100:00100000:0.0:1788838062.200464:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:67157:x1875729116394496:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1788838062.200515:0:76060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:0.0:1788838062.200597:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:67157:x1875729116394496:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 134us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838062.200606:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1145 00000100:00080000:1.0:1788838062.201165:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838062.209685:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838062.209790:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116394624 00000100:00100000:2.0:1788838062.209827:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116394624 00000100:00100000:2.0:1788838062.209908:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1146 00000100:00100000:2.0:1788838062.209935:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:67157:x1875729116394624:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788838062.210084:0:66255:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788838062.210164:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:67157:x1875729116394624:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 231us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838062.210172:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1146 00000100:00080000:1.0:1788838062.210535:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838062.218164:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838062.218325:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116394752 00000100:00100000:3.0:1788838062.218335:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116394752 00000100:00100000:3.0:1788838062.218412:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1962 00000100:00100000:3.0:1788838062.218423:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:67157:x1875729116394752:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1788838062.218454:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838062.218517:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:67157:x1875729116394752:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 96us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.218524:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1962 00000100:00080000:1.0:1788838062.219206:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838062.234651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838062.234770:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116394880 00000100:00100000:0.0:1788838062.234782:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116394880 00000100:00100000:0.0:1788838062.234887:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1963 00000100:00100000:0.0:1788838062.234899:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:67157:x1875729116394880:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:0.0:1788838062.234938:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838062.235025:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:67157:x1875729116394880:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 127us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838062.235031:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1963 00000100:00080000:1.0:1788838062.235569:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838062.299773:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838062.299934:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116395008 00000100:00100000:0.0:1788838062.299946:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116395008 00000100:00100000:0.0:1788838062.300016:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1147 00000100:00100000:0.0:1788838062.300027:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:67174:x1875729116395008:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838062.300158:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838062.300185:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc873d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc44 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300252:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc8744 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300268:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc8744 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300300:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc8744 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300316:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc874b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300323:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc874b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300330:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc874b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300428:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fe00/0x88da08396ccc8752 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300436:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fe00/0x88da08396ccc8752 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300442:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fe00/0x88da08396ccc8752 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838062.300871:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788838062.300877:0:75504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788838062.300902:0:75504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fe00/0x88da08396ccc8752 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300915:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc8744 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300922:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc8744 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300940:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc8744 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300946:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718ec00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838062.300950:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc8744 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300958:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc8744 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300970:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff624400400) 00010000:00010000:0.0:1788838062.300973:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838062.300977:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc8744 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300983:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc8744 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.300995:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc874b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.301001:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc874b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.301007:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc874b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.301011:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718ee00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838062.301014:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc874b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.301029:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc874b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.301037:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8ff603cabc00) 00010000:00010000:0.0:1788838062.301039:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838062.301042:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc874b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.301047:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc874b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.301098:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc873d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc44 expref: 9 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.301112:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fe00/0x88da08396ccc8752 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc44 expref: 8 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.301119:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff603cab300) 00010000:00010000:0.0:1788838062.301122:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788838062.301124:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718fe00, rc 0) 00000100:00100000:0.0:1788838062.301246:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67174:x1875729116395008:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1221us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838062.301254:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1147 00000100:00100000:3.0:1788838062.305960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838062.306040:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116395264 00000100:00100000:0.0:1788838062.306049:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116395264 00000100:00100000:0.0:1788838062.306128:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1148 00000100:00100000:0.0:1788838062.306139:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67174:x1875729116395264:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838062.306186:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838062.306209:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8759 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc4b expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306289:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306306:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306317:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306332:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8767 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306340:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8767 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306346:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8767 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306431:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306439:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306446:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306453:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306476:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838062.306481:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306489:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306503:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff603cab300) 00010000:00010000:0.0:1788838062.306506:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838062.306511:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306517:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc8760 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306532:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8767 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306538:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8767 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306544:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8767 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306549:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838062.306551:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8767 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306558:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8767 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306585:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8ff603cab900) 00010000:00010000:0.0:1788838062.306588:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838062.306591:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8767 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306597:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8767 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306631:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8759 lrc: 1/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc4b expref: 9 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306641:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff603cab300) 00010000:00010000:0.0:1788838062.306643:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838062.306647:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8759 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc4b expref: 9 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.306655:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718f000, rc 0) 00000100:00100000:0.0:1788838062.313139:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67174:x1875729116395264:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 6990us (7175us total) trans 0 rc 301/301 00000100:00100000:0.0:1788838062.313152:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1148 00000100:00100000:3.0:1788838062.322771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838062.328370:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116395520 00000100:00100000:0.0:1788838062.328384:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116395520 00000100:00100000:0.0:1788838062.328476:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1149 00000100:00100000:0.0:1788838062.328487:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67174:x1875729116395520:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838062.328508:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838062.328530:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc876e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc52 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838062.328688:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788838062.328887:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc876e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc52 expref: 10 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.328901:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff624400400) 00010000:00010000:0.0:1788838062.328905:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838062.328910:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc876e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc52 expref: 10 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.328927:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718e800, rc 0) 00000100:00100000:0.0:1788838062.328995:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:67174:x1875729116395520:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 510us (6236us total) trans 107374182401 rc 301/301 00000100:00100000:0.0:1788838062.329002:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1149 00000100:00100000:2.0:1788838062.333024:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838062.333200:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116395648 00000100:00100000:0.0:1788838062.333211:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116395648 00000100:00100000:0.0:1788838062.333284:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1150 00000100:00100000:0.0:1788838062.333296:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:67174:x1875729116395648:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:0.0:1788838062.333393:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333414:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333427:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333443:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8783 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333476:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8783 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333483:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8783 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333560:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333568:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333575:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838062.333631:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788838062.333645:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333661:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333668:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333673:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333680:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333685:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838062.333696:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333704:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333719:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8ff603cab300) 00010000:00010000:0.0:1788838062.333722:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838062.333727:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333734:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc877c lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333746:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8783 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333753:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8783 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333758:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8783 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333763:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718ee00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838062.333766:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8783 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333772:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8783 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333779:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8ff603cabc00) 00010000:00010000:0.0:1788838062.333782:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838062.333791:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8783 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333833:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8783 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333850:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333856:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333861:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333866:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718ec00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838062.333869:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333874:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333883:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8ff603cab800) 00010000:00010000:0.0:1788838062.333885:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838062.333888:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838062.333893:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc878a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838062.333983:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:67174:x1875729116395648:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 688us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838062.333991:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1150 00000100:00100000:3.0:1788838062.342939:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838062.343066:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116395904 00000100:00100000:1.0:1788838062.343083:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116395904 00000100:00100000:1.0:1788838062.343143:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 221 00000100:00100000:1.0:1788838062.343153:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:67174:x1875729116395904:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1788838062.343449:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:67174:x1875729116395904:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 296us (523us total) trans 107374182402 rc 0/0 00000100:00100000:1.0:1788838062.343457:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 221 00000100:00100000:0.0:1788838062.461361:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135011584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838062.461436:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838062.463170:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135011584 00000100:00100000:2.0:1788838062.463188:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135011584 00000100:00100000:2.0:1788838062.463295:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1788838062.463307:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135011584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838062.463338:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838062.463435:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135011584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838062.463443:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1788838062.463507:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135011584:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788838062.463571:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838062.466951:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838062.472167:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135011712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838062.472250:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838062.474107:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135011712 00000100:00100000:3.0:1788838062.474124:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135011712 00000100:00100000:3.0:1788838062.474232:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:3.0:1788838062.474252:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135011712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838062.474297:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838062.474404:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135011712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838062.474429:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:0.0:1788838062.474607:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135011712:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788838062.475230:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788838063.037137:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838063.485082:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135011840:0@lo:400:kworker.0 00000100:00100000:0.0:1788838063.485173:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.485320:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135011840 00000100:00100000:2.0:1788838063.485329:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135011840 00000100:00100000:2.0:1788838063.485405:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788838063.485417:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135011840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838063.486014:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135012352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838063.486936:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.490327:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135011840:12345-0@lo:400:kworker.0 Request processed in 4906us (5146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.490342:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788838063.490406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135012096:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.490842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.490876:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135012608:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.490906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.490931:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135013120:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.490954:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.490980:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788838063.490987:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135011968:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.491008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.491025:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135012480:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.491058:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838063.491359:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135012096 00000100:00100000:3.0:1788838063.491368:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135012096 00000100:00100000:3.0:1788838063.491429:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135011968 00000100:00100000:3.0:1788838063.491433:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135011968 00000100:00100000:3.0:1788838063.491467:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135012480 00000100:00100000:3.0:1788838063.491471:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135012480 00000100:00100000:3.0:1788838063.491497:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1788838063.491505:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135012096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.491724:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135012992:0@lo:400:kworker.0 00000100:00100000:1.0:1788838063.491834:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135012352 00000100:00100000:1.0:1788838063.491840:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135012352 00000100:00100000:1.0:1788838063.491871:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135012608 00000100:00100000:1.0:1788838063.491874:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135012608 00000100:00100000:1.0:1788838063.491895:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1788838063.491903:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135012352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838063.491930:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788838063.492249:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135011840:0@lo:400:kworker.0 00000100:00100000:0.0:1788838063.492278:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135012864:0@lo:400:kworker.0 00000100:00100000:3.0:1788838063.495293:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135012096:12345-0@lo:400:kworker.0 Request processed in 3774us (4438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.495309:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1788838063.495354:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:3.0:1788838063.495369:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135011968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838063.495432:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135011968:12345-0@lo:400:kworker.0 Request processed in 70us (4422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.495438:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:3.0:1788838063.496349:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1788838063.496365:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135012480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838063.496418:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135012480:12345-0@lo:400:kworker.0 Request processed in 60us (5371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.496425:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1788838063.496727:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.496780:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135012096:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.496823:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135011968:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.496833:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135012480:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.496888:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135012992 00000100:00100000:2.0:1788838063.496894:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135012992 00000100:00100000:2.0:1788838063.496931:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1788838063.496937:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135012992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.496977:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135012992:12345-0@lo:400:kworker.0 Request processed in 40us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.496983:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1788838063.497011:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060 00000100:00100000:2.0:1788838063.497019:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135012608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497231:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135012608:12345-0@lo:400:kworker.0 Request processed in 211us (6323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.497238:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060 00000100:00100000:2.0:1788838063.497269:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135012224:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497301:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.497320:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135012736:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497342:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.497362:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60925ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135013248:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497385:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838063.497418:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135013120 00000100:00100000:2.0:1788838063.497422:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135013120 00000100:00100000:2.0:1788838063.497516:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135012736 00000100:00100000:2.0:1788838063.497520:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135012736 00000100:00100000:2.0:1788838063.497539:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135013248 00000100:00100000:2.0:1788838063.497542:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135013248 00000100:00100000:2.0:1788838063.497582:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:2.0:1788838063.497590:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135013120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497624:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135013120:12345-0@lo:400:kworker.0 Request processed in 35us (6668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.497630:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00100000:2.0:1788838063.497641:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487 00000100:00100000:2.0:1788838063.497647:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135012736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497679:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135012736:12345-0@lo:400:kworker.0 Request processed in 32us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.497685:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487 00000100:00100000:2.0:1788838063.497696:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:2.0:1788838063.497711:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135013248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497741:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135013248:12345-0@lo:400:kworker.0 Request processed in 32us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.497747:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00100000:2.0:1788838063.497764:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135012224 00000100:00100000:2.0:1788838063.497767:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135012224 00000100:00100000:2.0:1788838063.497791:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1788838063.497823:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135012224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497855:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135012224:12345-0@lo:400:kworker.0 Request processed in 58us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.497861:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1788838063.497890:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135012224:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497901:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135012736:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497909:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60925ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135013248:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497940:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135012992:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497950:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135012608:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.497960:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135013120:0@lo:400:kworker.0 00000100:00080000:2.0:1788838063.498006:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838063.498011:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838063.498013:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838063.498015:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838063.500251:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135012352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8340us (13308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838063.500268:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00100000:0.0:1788838063.501185:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.501298:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60925b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135013376:0@lo:400:kworker.0 00000100:00100000:0.0:1788838063.501340:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.501404:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135012352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838063.501555:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135013376 00000100:00100000:3.0:1788838063.501563:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135013376 00000100:00100000:3.0:1788838063.501627:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1788838063.501637:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135013376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838063.501710:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135013376:12345-0@lo:400:kworker.0 Request processed in 75us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.501719:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1788838063.501741:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60925b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135013376:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.505399:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135012864 00000100:00100000:2.0:1788838063.505535:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135012864 00000100:00100000:2.0:1788838063.505630:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:2.0:1788838063.505643:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135012864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838063.505987:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135012864:0@lo:400:kworker.0 00000100:00100000:2.0:1788838063.506085:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135012864:12345-0@lo:400:kworker.0 Request processed in 445us (4901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838063.506094:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000100:00100000:0.0:1788838063.997065:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135013504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838063.997163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838063.997237:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135013504 00000100:00100000:0.0:1788838063.997247:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135013504 00000100:00100000:0.0:1788838063.997300:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:0.0:1788838063.997310:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135013504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838063.997341:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838063.997382:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135013504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.997389:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:0.0:1788838063.997495:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60925aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135013632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838063.997532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838063.997596:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135013760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838063.997629:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838063.997672:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135013760 00000100:00100000:3.0:1788838063.997676:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135013760 00000100:00100000:3.0:1788838063.997704:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:3.0:1788838063.997712:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135013760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838063.998747:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838063.998846:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135013760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1131us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838063.998855:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00100000:3.0:1788838063.998927:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135013760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838063.999139:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135013632 00000100:00100000:0.0:1788838063.999148:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135013632 00000100:00100000:0.0:1788838063.999205:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061 00000100:00100000:0.0:1788838063.999215:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135013632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838063.999255:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:0.0:1788838063.999308:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135013632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838063.999316:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061 00000100:00100000:0.0:1788838063.999358:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135013504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838063.999391:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60925aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135013632:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788838064.061250:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838064.702232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838064.702291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838064.702338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838064.702374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838064.702402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838064.702461:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116396032 00000100:00100000:1.0:1788838064.702481:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116396032 00000100:00100000:0.0:1788838064.702585:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116396416 00000100:00100000:1.0:1788838064.702595:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:0.0:1788838064.702596:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116396416 00000100:00100000:1.0:1788838064.702613:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116396032:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838064.702675:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116396544 00000100:00100000:0.0:1788838064.702680:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116396544 00000100:00100000:1.0:1788838064.702706:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116396032:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 98us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838064.702716:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2490 00000100:00100000:1.0:1788838064.702726:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:0.0:1788838064.702739:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116396416:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838064.702900:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2491 00000100:00100000:0.0:1788838064.702901:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116396416:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 155us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838064.702919:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2490 00000100:00100000:1.0:1788838064.702935:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116396544:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838064.702983:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116396544:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838064.702991:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2491 00000100:00100000:2.0:1788838064.703477:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116396160 00000100:00100000:2.0:1788838064.703485:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116396160 00000100:00100000:2.0:1788838064.703544:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116396288 00000100:00100000:2.0:1788838064.703548:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116396288 00000100:00100000:2.0:1788838064.703598:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1154 00000100:00100000:2.0:1788838064.703606:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2406:x1875729116396160:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838064.703792:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1155 00000100:00100000:1.0:1788838064.703827:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116396288:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:0.0:1788838064.704031:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838064.704036:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838064.704047:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838064.704050:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838064.706843:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2406:x1875729116396160:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3212us (4603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838064.706865:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1154 00000100:00100000:1.0:1788838064.708504:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116396288:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 4663us (6112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838064.708522:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1155 00010000:00010000:2.0:1788838065.085169:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838066.135522:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838067.201779:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838067.582000:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135013888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838067.582135:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838067.582234:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135013888 00000100:00100000:2.0:1788838067.582247:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135013888 00000100:00100000:2.0:1788838067.582326:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:2.0:1788838067.582339:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135013888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838067.582385:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838067.582446:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135013888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838067.582455:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00080000:2.0:1788838067.582481:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838067.582534:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135013888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838067.584920:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838067.584947:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60925b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135014016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838067.585044:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838067.585162:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135014016 00000100:00100000:2.0:1788838067.585179:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135014016 00000100:00100000:2.0:1788838067.585259:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1788838067.585271:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135014016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838067.585309:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838067.585368:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135014016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838067.585376:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1788838067.585433:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60925b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135014016:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788838067.585498:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788838068.095280:0:87104:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182402 is committed 00010000:00010000:3.0:1788838068.222402:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838068.606510:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135014528:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.606643:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838068.606695:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135015040:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.606725:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838068.606744:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135015552:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.606768:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838068.606826:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788838068.606833:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135014144:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.606865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838068.606895:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135014656:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.606918:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838068.606934:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135015168:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.606956:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838068.606972:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135015680:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.606993:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838068.607028:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135015040 00000100:00100000:3.0:1788838068.607038:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135015040 00000100:00100000:3.0:1788838068.607091:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135015552 00000100:00100000:3.0:1788838068.607095:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135015552 00000100:00100000:3.0:1788838068.607135:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:3.0:1788838068.607146:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135015040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.607210:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135015040:12345-0@lo:400:kworker.0 Request processed in 65us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838068.607230:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:3.0:1788838068.607253:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493 00000100:00100000:3.0:1788838068.607270:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135015552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.607313:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135015552:12345-0@lo:400:kworker.0 Request processed in 54us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838068.607319:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493 00000100:00080000:3.0:1788838068.607344:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838068.607378:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135015040:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.607389:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135015552:0@lo:400:kworker.0 00000100:00100000:0.0:1788838068.607886:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135014528 00000100:00100000:0.0:1788838068.607901:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135014528 00000100:00100000:0.0:1788838068.607954:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135014656 00000100:00100000:0.0:1788838068.607957:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135014656 00000100:00100000:0.0:1788838068.607978:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135015168 00000100:00100000:0.0:1788838068.607981:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135015168 00000100:00100000:0.0:1788838068.607994:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135015680 00000100:00100000:0.0:1788838068.607996:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135015680 00000100:00100000:0.0:1788838068.608010:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1788838068.608018:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135014528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838068.608073:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135014528:12345-0@lo:400:kworker.0 Request processed in 56us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838068.608079:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1788838068.608098:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1788838068.608104:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135014656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838068.608133:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135014656:12345-0@lo:400:kworker.0 Request processed in 30us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838068.608140:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1788838068.608151:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1788838068.608156:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135015168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838068.608185:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135015168:12345-0@lo:400:kworker.0 Request processed in 29us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838068.608192:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1788838068.608203:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1788838068.608209:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135015680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838068.608252:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135015680:12345-0@lo:400:kworker.0 Request processed in 43us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838068.608257:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00080000:1.0:1788838068.608460:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838068.608465:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838068.608564:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135014272:0@lo:400:kworker.0 00000100:00100000:2.0:1788838068.608623:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838068.608660:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135014784:0@lo:400:kworker.0 00000100:00100000:2.0:1788838068.608690:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838068.608719:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135015296:0@lo:400:kworker.0 00000100:00100000:2.0:1788838068.608747:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838068.608765:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135015808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838068.608787:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838068.608859:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788838068.608868:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135014400:0@lo:400:kworker.0 00000100:00100000:2.0:1788838068.608895:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838068.608916:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135014912:0@lo:400:kworker.0 00000100:00100000:2.0:1788838068.608944:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838068.608965:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135015424:0@lo:400:kworker.0 00000100:00100000:2.0:1788838068.608988:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838068.609029:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135014144 00000100:00100000:2.0:1788838068.609045:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135014144 00000100:00100000:2.0:1788838068.609092:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788838068.609100:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff507117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135014144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838068.609143:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff507117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135014144:12345-0@lo:400:kworker.0 Request processed in 45us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838068.609150:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788838068.609187:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135014272 00000100:00100000:2.0:1788838068.609190:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135014272 00000100:00100000:1.0:1788838068.609433:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135014784 00000100:00100000:1.0:1788838068.609438:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135014784 00000100:00100000:1.0:1788838068.609472:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135015296 00000100:00100000:1.0:1788838068.609475:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135015296 00000100:00100000:1.0:1788838068.609486:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135015808 00000100:00100000:1.0:1788838068.609488:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135015808 00000100:00100000:1.0:1788838068.609512:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062 00000100:00100000:1.0:1788838068.609518:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135014784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.609589:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135014784:12345-0@lo:400:kworker.0 Request processed in 69us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838068.609598:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062 00000100:00100000:1.0:1788838068.609626:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063 00000100:00100000:1.0:1788838068.609632:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135015296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.609660:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135015296:12345-0@lo:400:kworker.0 Request processed in 29us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838068.609666:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063 00000100:00100000:1.0:1788838068.609677:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064 00000100:00100000:1.0:1788838068.609683:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135015808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838068.609711:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:1.0:1788838068.609743:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135015808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838068.609749:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064 00000100:00080000:1.0:1788838068.609774:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838068.609830:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135014784:0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.609843:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135015296:0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.609856:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135015808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838068.609914:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135014400 00000100:00100000:1.0:1788838068.609918:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135014400 00000100:00100000:1.0:1788838068.609950:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1788838068.609956:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135014272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.609995:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135014272:12345-0@lo:400:kworker.0 Request processed in 39us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838068.610008:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1788838068.610021:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1788838068.610027:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135014400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.610058:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135014400:12345-0@lo:400:kworker.0 Request processed in 31us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838068.610064:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00080000:1.0:1788838068.610077:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838068.610095:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135014400:0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.610108:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135014272:0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.610143:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135014912 00000100:00100000:1.0:1788838068.610147:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135014912 00000100:00100000:1.0:1788838068.610171:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135015424 00000100:00100000:1.0:1788838068.610174:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135015424 00000100:00100000:1.0:1788838068.610201:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494 00000100:00100000:1.0:1788838068.610207:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135014912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.610255:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135014912:12345-0@lo:400:kworker.0 Request processed in 48us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838068.610270:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494 00000100:00100000:1.0:1788838068.610283:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1788838068.610290:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135015424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.610317:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135015424:12345-0@lo:400:kworker.0 Request processed in 29us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838068.610322:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00080000:1.0:1788838068.610335:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838068.610353:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135014912:0@lo:400:kworker.0 00000100:00100000:1.0:1788838068.610375:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135015424:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.610674:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135014144:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.610693:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135014656:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.610713:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135015168:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.610732:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135015680:0@lo:400:kworker.0 00000100:00100000:3.0:1788838068.610746:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135014528:0@lo:400:kworker.0 00000100:00100000:0.0:1788838069.116993:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838069.117038:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135015936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838069.117150:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.117587:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135016064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838069.117627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838069.117673:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135016064 00000100:00100000:3.0:1788838069.117684:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135016064 00000100:00100000:3.0:1788838069.117744:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065 00000100:00100000:3.0:1788838069.117755:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135016064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838069.117820:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:3.0:1788838069.117874:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135016064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838069.117882:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065 00000100:00100000:3.0:1788838069.117939:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135016064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838069.118677:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135015936 00000100:00100000:2.0:1788838069.118685:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135015936 00000100:00100000:2.0:1788838069.118736:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1788838069.118746:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135015936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788838069.118776:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838069.118879:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135015936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.118886:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1788838069.118914:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135016192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838069.118956:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838069.119003:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135016192 00000100:00100000:2.0:1788838069.119007:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135016192 00000100:00100000:2.0:1788838069.120275:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1788838069.120286:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135016192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838069.120322:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838069.120400:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135016192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.120407:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:2.0:1788838069.120481:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135015936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838069.120972:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135016192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788838069.245230:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838069.827629:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838069.827680:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838069.827705:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838069.827726:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838069.827756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838069.827777:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116396672 00000100:00100000:2.0:1788838069.827784:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116397184 00000100:00100000:2.0:1788838069.827790:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116397184 00000100:00100000:1.0:1788838069.827790:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116396672 00000100:00100000:1.0:1788838069.827887:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:1.0:1788838069.827898:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2405:x1875729116396672:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838069.827948:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116397056 00000100:00100000:2.0:1788838069.827952:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116397056 00000100:00100000:2.0:1788838069.827977:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2496 00000100:00100000:2.0:1788838069.827984:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116397184:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838069.827999:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2405:x1875729116396672:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 103us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838069.828008:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:2.0:1788838069.828015:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116397184:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 33us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.828021:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2496 00000100:00100000:2.0:1788838069.828032:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2497 00000100:00100000:2.0:1788838069.828037:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116397056:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838069.828061:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116397056:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.828067:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2497 00000100:00100000:2.0:1788838069.828085:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116396928 00000100:00100000:2.0:1788838069.828088:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116396928 00000100:00100000:2.0:1788838069.828119:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116396800 00000100:00100000:2.0:1788838069.828121:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116396800 00000100:00100000:2.0:1788838069.828145:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1162 00000100:00100000:2.0:1788838069.828150:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116396928:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838069.828198:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116396928:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 47us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.828205:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1162 00000100:00100000:2.0:1788838069.828218:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1163 00000100:00100000:2.0:1788838069.828224:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2405:x1875729116396800:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838069.828315:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2405:x1875729116396800:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 90us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838069.828323:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1163 00000100:00080000:2.0:1788838069.828347:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838069.828352:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838069.828354:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838069.828357:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1788838070.018002:0:87929:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 23:27:48 (1788838068) 00000100:00100000:1.0:1788838070.149681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838070.149794:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116397312 00000100:00100000:0.0:1788838070.149841:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116397312 00000100:00100000:0.0:1788838070.149925:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1151 00000100:00100000:0.0:1788838070.149936:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67762:x1875729116397312:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838070.149965:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838070.149994:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ea00/0x88da08396ccc8791 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc59 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150115:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f200/0x88da08396ccc8798 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150137:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f200/0x88da08396ccc8798 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150153:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f200/0x88da08396ccc8798 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150171:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc879f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150179:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc879f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150186:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc879f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150274:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f200/0x88da08396ccc8798 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150283:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f200/0x88da08396ccc8798 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150290:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f200/0x88da08396ccc8798 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150299:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838070.150306:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f200/0x88da08396ccc8798 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150315:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f200/0x88da08396ccc8798 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150332:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff624400400) 00010000:00010000:0.0:1788838070.150336:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838070.150341:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f200/0x88da08396ccc8798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150348:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f200/0x88da08396ccc8798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150365:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc879f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150371:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc879f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150378:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc879f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150391:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838070.150395:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc879f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150401:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc879f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150410:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8ff603cab800) 00010000:00010000:0.0:1788838070.150412:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838070.150415:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc879f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150421:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc879f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150463:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ea00/0x88da08396ccc8791 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc59 expref: 9 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150474:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff624400400) 00010000:00010000:0.0:1788838070.150477:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838070.150480:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ea00/0x88da08396ccc8791 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc59 expref: 9 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.150490:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718ea00, rc 0) 00000100:00100000:0.0:1788838070.150572:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67762:x1875729116397312:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 638us (908us total) trans 0 rc 301/301 00000100:00100000:0.0:1788838070.150580:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1151 00000100:00100000:1.0:1788838070.156668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838070.157224:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116397568 00000100:00100000:2.0:1788838070.157256:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116397568 00000100:00100000:2.0:1788838070.157361:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1152 00000100:00100000:2.0:1788838070.157375:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67762:x1875729116397568:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838070.157410:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838070.157414:0:67312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788838070.157453:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0400/0x88da08396ccc8728 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc3d expref: 8 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.157476:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff624400400) 00010000:00010000:2.0:1788838070.157491:0:67312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838070.157513:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc87a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc60 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.157697:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.157715:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.157727:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.157743:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.157750:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.157756:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158392:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158404:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158412:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838070.158423:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:2.0:1788838070.158458:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158466:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158481:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158489:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158496:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5ea00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838070.158502:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158511:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158534:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831100) 00010000:00010000:2.0:1788838070.158537:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838070.158542:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158549:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87ad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838070.158563:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ad2bf37 reply state 00000000a0f20350 transno 107374182403 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158576:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158583:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8ff63f831d00) 00010000:00010000:2.0:1788838070.158586:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838070.158590:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838070.158630:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc87a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc60 expref: 10 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158659:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc60 expref: 9 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.158667:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff63f831000) 00010000:00010000:2.0:1788838070.158670:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838070.158672:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5e800, rc 0) 00000100:00100000:2.0:1788838070.158772:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:67762:x1875729116397568:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1399us (2130us total) trans 107374182403 rc 0/0 00000100:00100000:2.0:1788838070.158781:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1152 00000100:00100000:1.0:1788838070.162420:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838070.163358:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116397824 00000100:00100000:0.0:1788838070.163388:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116397824 00000100:00100000:0.0:1788838070.163472:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1153 00000100:00100000:0.0:1788838070.163487:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:67762:x1875729116397824:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838070.163519:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838070.163558:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ea00/0x88da08396ccc87c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc67 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.163711:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.163732:0:66255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc60 expref: 11 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.163745:0:66255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.163833:0:66255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc60 expref: 11 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838070.163852:0:66255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc60 expref: 11 pid: 67312 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838070.163872:0:66255:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66255:1875729135016320:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788838070.164006:0:66255:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6193c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838070.169349:0:66255:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66255:1875729135016320:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788838070.169396:0:66255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838070.170906:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838070.171052:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116397952 00000100:00100000:2.0:1788838070.171076:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116397952 00010000:00010000:2.0:1788838070.171135:0:6533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc60 expref: 12 pid: 67312 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838070.171194:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2541 00000100:00100000:2.0:1788838070.171206:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2405:x1875729116397952:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838070.171237:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838070.171246:0:6533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc60 expref: 12 pid: 67312 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.171262:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc60 expref: 12 pid: 67312 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.171311:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc87bb lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc60 expref: 12 pid: 67312 timeout: 3564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.171332:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff63f831000) 00010000:00010000:2.0:1788838070.171339:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.171349:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.171357:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838070.171404:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838070.171473:0:66255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838070.171478:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2405:x1875729116397952:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 271us (580us total) trans 0 rc 0/0 00010000:00010000:3.0:1788838070.171489:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838070.171495:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2541 00000004:00200000:3.0:1788838070.171523:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:3.0:1788838070.171878:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838070.171894:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838070.171902:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838070.171909:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838070.171914:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838070.171923:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838070.171934:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff63f831000) 00010000:00010000:3.0:1788838070.171938:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788838070.171942:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838070.171949:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e600/0x88da08396ccc87d0 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838070.172024:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ea00/0x88da08396ccc87c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc67 expref: 11 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838070.172044:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff603cab800) 00010000:00010000:3.0:1788838070.172047:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788838070.172052:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ea00/0x88da08396ccc87c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc67 expref: 11 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838070.172068:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718ea00, rc 0) 00000100:00100000:3.0:1788838070.172104:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:67762:x1875729116397824:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 8622us (9701us total) trans 107374182404 rc 301/301 00000100:00100000:3.0:1788838070.172113:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1153 00000100:00100000:1.0:1788838070.182437:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838070.182510:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116398208 00000100:00100000:0.0:1788838070.182533:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116398208 00000100:00100000:0.0:1788838070.182612:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:0.0:1788838070.182625:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502465c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:67762:x1875729116398208:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1788838070.183041:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502465c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:67762:x1875729116398208:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 418us (617us total) trans 107374182405 rc 0/0 00000100:00100000:0.0:1788838070.183051:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:1.0:1788838070.189604:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838070.189746:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116398464 00000100:00100000:3.0:1788838070.189769:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116398464 00000100:00100000:3.0:1788838070.189879:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:3.0:1788838070.189892:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:67762:x1875729116398464:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788838070.191028:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:67762:x1875729116398464:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 1128us (1428us total) trans 107374182406 rc 0/0 00000100:00100000:3.0:1788838070.191042:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 223 00010000:00010000:0.0:1788838070.269957:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788838071.241301:0:87104:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182406 is committed 00010000:00010000:3.0:1788838071.241352:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.241372:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.241382:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.241397:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5fc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838071.241421:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.241431:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.241460:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8ff63f831d00) 00010000:00010000:3.0:1788838071.241464:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838071.241470:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.241476:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87b4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.295941:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838071.313063:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838071.313433:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116398592 00000100:00100000:2.0:1788838071.313449:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116398592 00000100:00100000:2.0:1788838071.313555:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1154 00000100:00100000:2.0:1788838071.313570:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:67771:x1875729116398592:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838071.313606:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838071.313641:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc6e expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.313737:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.313771:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.313789:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838071.313872:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838071.313877:0:75504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838071.313903:0:75504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.313934:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc6e expref: 9 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.313956:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc6e expref: 8 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.313966:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831e00) 00010000:00010000:2.0:1788838071.313970:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838071.313973:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5fc00, rc 0) 00000100:00100000:2.0:1788838071.314065:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67771:x1875729116398592:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 499us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838071.314073:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1154 00000100:00080000:2.0:1788838071.314102:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838071.337698:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838071.337785:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116398720 00000100:00100000:2.0:1788838071.337826:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116398720 00000100:00100000:2.0:1788838071.337907:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1155 00000100:00100000:2.0:1788838071.337919:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67771:x1875729116398720:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788838071.337985:0:67312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:2.0:1788838071.338079:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67771:x1875729116398720:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 162us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838071.338087:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1155 00000100:00100000:3.0:1788838071.341643:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838071.341890:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116398848 00000100:00100000:0.0:1788838071.341903:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116398848 00000100:00080000:2.0:1788838071.341953:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838071.341997:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1156 00000100:00100000:0.0:1788838071.342014:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:67771:x1875729116398848:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1788838071.342072:0:76060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788838071.342173:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:67771:x1875729116398848:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 164us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838071.342182:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1156 00000100:00100000:1.0:1788838071.357658:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838071.357878:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116398976 00000100:00100000:2.0:1788838071.357891:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116398976 00000100:00100000:2.0:1788838071.357982:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1972 00000100:00100000:2.0:1788838071.357994:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:67771:x1875729116398976:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838071.358049:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838071.359183:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:67771:x1875729116398976:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 1181us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838071.359196:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1972 00000100:00080000:1.0:1788838071.359872:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838071.367762:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838071.367883:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116399104 00000100:00100000:3.0:1788838071.367897:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116399104 00000100:00100000:3.0:1788838071.368008:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1973 00000100:00100000:3.0:1788838071.368022:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:67771:x1875729116399104:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1788838071.368066:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788838071.368168:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838071.368172:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:67771:x1875729116399104:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 154us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838071.368181:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1973 00000100:00100000:3.0:1788838071.438908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838071.439108:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116399360 00000100:00100000:0.0:1788838071.439124:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116399360 00000100:00100000:0.0:1788838071.439215:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1157 00000100:00100000:0.0:1788838071.439228:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67778:x1875729116399360:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00010000:0.0:1788838071.439386:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838071.439438:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fc00/0x88da08396ccc87e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc6e expref: 8 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.439469:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831e00) 00010000:00010000:0.0:1788838071.439486:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838071.439585:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc87ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.440372:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc87ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.440388:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc87ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.440410:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.440419:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.440436:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.441140:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc87ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.441152:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc87ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.441160:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc87ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.441166:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718ec00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838071.441171:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc87ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.441180:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc87ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.441196:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff603cabc00) 00010000:00010000:0.0:1788838071.441214:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838071.441220:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc87ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.441228:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ec00/0x88da08396ccc87ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838071.444452:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd883c1e reply state 00000000de450d3f transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.444490:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838071.444501:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff603cab900) 00010000:00010000:0.0:1788838071.444505:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838071.444511:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838071.445499:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:67778:x1875729116399360:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 6262us (6595us total) trans 107374182407 rc 0/0 00000100:00100000:0.0:1788838071.445513:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1157 00000100:00100000:3.0:1788838071.465624:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838071.465699:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116399488 00000100:00100000:2.0:1788838071.465714:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116399488 00000100:00100000:2.0:1788838071.465839:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1158 00000100:00100000:2.0:1788838071.465854:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:67781:x1875729116399488:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1788838071.465890:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838071.465921:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc75 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.466014:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8801 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.466033:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.466060:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838071.466123:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838071.466128:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838071.466151:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.466181:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc87fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc75 expref: 11 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.466202:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8801 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc75 expref: 10 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838071.466212:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831300) 00010000:00010000:2.0:1788838071.466216:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838071.466221:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5e200, rc 0) 00000100:00100000:2.0:1788838071.466318:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:67781:x1875729116399488:12345-192.168.203.30@tcp:101:rm.0 Request processed in 469us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838071.466325:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1158 00000100:00100000:0.0:1788838071.469760:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838071.469907:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116399616 00000100:00100000:3.0:1788838071.469921:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116399616 00000100:00100000:3.0:1788838071.470007:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1159 00000100:00100000:3.0:1788838071.470022:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:67781:x1875729116399616:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1788838071.470069:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838071.470106:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b200/0x88da08396ccc8808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc7c expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470221:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470243:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470259:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470273:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8816 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470282:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470289:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470415:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b400/0x88da08396ccc881d lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470552:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b400/0x88da08396ccc881d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470563:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b400/0x88da08396ccc881d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838071.470629:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788838071.470640:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838071.470668:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b400/0x88da08396ccc881d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470682:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b400/0x88da08396ccc881d lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470692:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470698:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470705:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470711:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470719:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297a400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838071.470724:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470733:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470746:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831300) 00010000:00010000:3.0:1788838071.470748:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838071.470754:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470760:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297a400/0x88da08396ccc880f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470786:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470793:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8816 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470878:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470884:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297b600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838071.470887:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470893:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8816 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470901:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff603cab900) 00010000:00010000:3.0:1788838071.470903:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838071.470907:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8816 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470913:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8816 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470944:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b200/0x88da08396ccc8808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc7c expref: 12 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470958:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b400/0x88da08396ccc881d lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc7c expref: 11 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.470978:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff8ff619120400) 00010000:00010000:3.0:1788838071.470980:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838071.470982:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63297b400, rc 0) 00000100:00100000:3.0:1788838071.471514:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:67781:x1875729116399616:12345-192.168.203.30@tcp:101:rm.0 Request processed in 1490us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838071.471537:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1159 00000100:00100000:3.0:1788838071.480959:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838071.482075:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116399872 00000100:00100000:1.0:1788838071.482093:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116399872 00000100:00100000:1.0:1788838071.482187:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1160 00000100:00100000:1.0:1788838071.482199:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:67781:x1875729116399872:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:1.0:1788838071.482288:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788838071.482328:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b400/0x88da08396ccc881d lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc7c expref: 11 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.482355:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff8ff619120400) 00010000:00010000:1.0:1788838071.482404:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e200/0x88da08396ccc8801 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc75 expref: 10 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.482416:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831300) 00010000:00010000:1.0:1788838071.482423:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838071.483218:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.483240:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.483255:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.483270:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.483279:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.483287:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.484647:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0a00/0x88da08396ccc8832 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.484671:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0a00/0x88da08396ccc8832 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.484682:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0a00/0x88da08396ccc8832 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.485591:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.485617:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.485627:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.485637:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.485645:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.485653:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487580:0:66253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838071.487644:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0a00/0x88da08396ccc8832 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487658:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0a00/0x88da08396ccc8832 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487667:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0a00/0x88da08396ccc8832 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487674:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838071.487681:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0a00/0x88da08396ccc8832 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487690:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0a00/0x88da08396ccc8832 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487724:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff8ff624400a00) 00010000:00010000:1.0:1788838071.487727:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788838071.487733:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0a00/0x88da08396ccc8832 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487740:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0a00/0x88da08396ccc8832 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487770:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487777:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487782:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487788:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487793:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb1a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838071.487812:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487819:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487827:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff624400700) 00010000:00010000:1.0:1788838071.487830:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838071.487833:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487850:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb1a00/0x88da08396ccc8824 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838071.487875:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4b9fd09 reply state 00000000f4232793 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487891:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838071.487900:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff603cab900) 00010000:00010000:1.0:1788838071.487903:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838071.487908:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838071.488060:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:67781:x1875729116399872:12345-192.168.203.30@tcp:36:rm.0 Request processed in 5855us (7107us total) trans 107374182408 rc 0/0 00000100:00100000:1.0:1788838071.488071:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1160 00010000:00010000:3.0:1788838071.496574:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838071.496598:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.496614:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838071.496620:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.496634:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.496660:0:15289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff8ff624400a00) 00010000:00010000:3.0:1788838071.496664:0:15289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788838071.496669:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.496676:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0200/0x88da08396ccc8839 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838071.496701:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838071.496703:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838071.496705:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838072.316994:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838072.701121:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135016448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838072.701252:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838072.701395:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135016448 00000100:00100000:2.0:1788838072.701405:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135016448 00000100:00100000:2.0:1788838072.701500:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:2.0:1788838072.701521:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135016448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838072.701555:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838072.701616:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135016448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838072.701642:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:2.0:1788838072.701710:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135016448:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788838072.701891:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838072.710893:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135016576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838072.711003:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838072.712172:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135016576 00000100:00100000:0.0:1788838072.712191:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135016576 00000100:00100000:0.0:1788838072.712287:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:0.0:1788838072.712303:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135016576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838072.712342:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838072.712441:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135016576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838072.712449:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00080000:3.0:1788838072.712959:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838072.713271:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135016576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788838073.341174:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838073.725123:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135016832:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725262:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135017344:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725310:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135017856:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725360:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788838073.725366:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135016704:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725426:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135017216:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725449:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725467:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135017728:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725653:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135018240:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725774:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135016960:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725822:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725840:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135017472:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725865:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725888:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135017984:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725930:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788838073.725936:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135017088:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.725957:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.725983:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135017600:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.726003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838073.726018:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135018112:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.726037:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838073.727622:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838073.727658:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135018368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838073.727755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838073.727858:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135017344 00000100:00100000:1.0:1788838073.727871:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135017344 00000100:00100000:0.0:1788838073.727928:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135016832 00000100:00100000:0.0:1788838073.727935:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135016832 00000100:00100000:1.0:1788838073.727946:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135017856 00000100:00100000:1.0:1788838073.727953:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135017856 00000100:00100000:0.0:1788838073.727985:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135017216 00000100:00100000:0.0:1788838073.727990:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135017216 00000100:00100000:0.0:1788838073.728003:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135017728 00000100:00100000:0.0:1788838073.728005:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135017728 00000100:00100000:0.0:1788838073.728019:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135018240 00000100:00100000:0.0:1788838073.728021:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135018240 00000100:00100000:0.0:1788838073.728030:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135016960 00000100:00100000:0.0:1788838073.728032:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135016960 00000100:00100000:0.0:1788838073.728043:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135017088 00000100:00100000:0.0:1788838073.728046:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135017088 00000100:00100000:0.0:1788838073.728061:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1788838073.728071:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135016832:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838073.728116:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50475c000 x1875729135016832/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:729/0 lens 224/224 e 0 to 0 dl 1788838084 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838073.728170:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135016832:12345-0@lo:400:kworker.0 Request processed in 100us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838073.728178:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1788838073.728200:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1788838073.728206:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135017216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.728236:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135017216:12345-0@lo:400:kworker.0 Request processed in 31us (2786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838073.728242:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1788838073.728271:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:0.0:1788838073.728276:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135017728:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838073.728287:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50475df80 x1875729135017728/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:729/0 lens 224/224 e 0 to 0 dl 1788838084 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838073.728317:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135017728:12345-0@lo:400:kworker.0 Request processed in 42us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838073.728323:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:0.0:1788838073.728334:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1788838073.728340:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135018240:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838073.728351:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff503f44380 x1875729135018240/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:729/0 lens 224/224 e 0 to 0 dl 1788838084 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838073.728377:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135018240:12345-0@lo:400:kworker.0 Request processed in 38us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838073.728382:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1788838073.728392:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:0.0:1788838073.728398:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135016960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.728430:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135016960:12345-0@lo:400:kworker.0 Request processed in 32us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838073.728435:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:0.0:1788838073.728446:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1788838073.728452:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135017088:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838073.728463:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff503f46680 x1875729135017088/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:729/0 lens 224/224 e 0 to 0 dl 1788838084 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838073.729175:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135017088:12345-0@lo:400:kworker.0 Request processed in 655us (3148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838073.729193:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1788838073.729225:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135017472 00000100:00100000:3.0:1788838073.729230:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135017984 00000100:00100000:0.0:1788838073.729232:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135017472 00000100:00100000:3.0:1788838073.729234:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135017984 00000100:00100000:3.0:1788838073.729269:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135017600 00000100:00100000:3.0:1788838073.729273:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135017600 00000100:00100000:0.0:1788838073.729276:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135018112 00000100:00100000:0.0:1788838073.729279:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135018112 00000100:00100000:3.0:1788838073.729294:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:3.0:1788838073.729302:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135017984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838073.729344:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135017984:12345-0@lo:400:kworker.0 Request processed in 43us (3434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838073.729350:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:3.0:1788838073.729363:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499 00000100:00100000:3.0:1788838073.729369:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135017472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.729370:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500 00000100:00100000:0.0:1788838073.729376:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135017600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838073.729399:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135017472:12345-0@lo:400:kworker.0 Request processed in 30us (3533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838073.729404:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499 00000100:00100000:0.0:1788838073.729406:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135017600:12345-0@lo:400:kworker.0 Request processed in 31us (3402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838073.729412:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500 00000100:00100000:3.0:1788838073.729415:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:3.0:1788838073.729420:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135018112:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788838073.729442:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838073.729445:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135018112:12345-0@lo:400:kworker.0 Request processed in 26us (3407us total) trans 0 rc 0/0 00000100:00080000:0.0:1788838073.729447:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838073.729450:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838073.729451:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00080000:0.0:1788838073.729452:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838073.729518:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135017088:0@lo:400:kworker.0 00000100:00100000:1.0:1788838073.729519:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135018368 00000100:00100000:1.0:1788838073.729527:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135018368 00000100:00100000:0.0:1788838073.729540:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135017600:0@lo:400:kworker.0 00000100:00100000:1.0:1788838073.729552:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066 00000100:00100000:0.0:1788838073.729561:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135018112:0@lo:400:kworker.0 00000100:00100000:1.0:1788838073.729565:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135017344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.729578:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135016960:0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.729593:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135017472:0@lo:400:kworker.0 00010000:00000080:1.0:1788838073.729597:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50475f480 x1875729135017344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:729/0 lens 224/224 e 0 to 0 dl 1788838084 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838073.729608:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135017984:0@lo:400:kworker.0 00000100:00100000:1.0:1788838073.729644:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135017344:12345-0@lo:400:kworker.0 Request processed in 84us (4350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838073.729652:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066 00000100:00100000:1.0:1788838073.729673:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067 00000100:00100000:1.0:1788838073.729681:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135017856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838073.729712:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135017856:12345-0@lo:400:kworker.0 Request processed in 34us (4379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838073.729718:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067 00000100:00100000:1.0:1788838073.729729:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068 00000100:00100000:1.0:1788838073.729734:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135018368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838073.729772:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838073.729823:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135016704 00000100:00100000:3.0:1788838073.729828:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135016704 00000100:00100000:3.0:1788838073.729860:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788838073.729867:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff507114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135016704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838073.729939:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135018368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838073.730442:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff507114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135016704:12345-0@lo:400:kworker.0 Request processed in 573us (5043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838073.730450:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788838073.730533:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135016704:0@lo:400:kworker.0 00000100:00100000:3.0:1788838073.730550:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135017216:0@lo:400:kworker.0 00000100:00100000:3.0:1788838073.730564:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135017728:0@lo:400:kworker.0 00000100:00100000:3.0:1788838073.730579:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135018240:0@lo:400:kworker.0 00000100:00100000:3.0:1788838073.730594:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135016832:0@lo:400:kworker.0 00000100:00100000:3.0:1788838073.730607:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135017344:0@lo:400:kworker.0 00000100:00100000:3.0:1788838073.730619:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135017856:0@lo:400:kworker.0 00000100:00100000:1.0:1788838073.735643:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135018368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5726us (7707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838073.735662:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068 00000100:00100000:1.0:1788838074.241020:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838074.241069:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135018496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838074.241187:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838074.241268:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135018496 00000100:00100000:1.0:1788838074.241280:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135018496 00000100:00100000:1.0:1788838074.241347:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:1.0:1788838074.241358:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135018496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838074.241410:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838074.241462:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135018496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838074.241485:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:1.0:1788838074.241556:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135018496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838074.242025:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135018752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838074.242080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838074.242124:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135018752 00000100:00100000:3.0:1788838074.242128:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135018752 00000100:00100000:3.0:1788838074.242171:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069 00000100:00100000:3.0:1788838074.242179:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135018752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838074.242213:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00010000:00000080:3.0:1788838074.242229:0:8471:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc97480 x1875729135018752/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:730/0 lens 224/368 e 0 to 0 dl 1788838085 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838074.242266:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135018752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838074.242273:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069 00000100:00100000:3.0:1788838074.242314:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135018752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838074.242622:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838074.242634:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135018624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838074.242674:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838074.243903:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135018624 00000100:00100000:3.0:1788838074.243920:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135018624 00000100:00100000:3.0:1788838074.243999:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:3.0:1788838074.244009:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135018624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838074.244056:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838074.244151:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135018624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838074.244160:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:2.0:1788838074.244417:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135018624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788838074.368773:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838074.947520:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838074.947581:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838074.947620:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838074.947646:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838074.947678:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838074.947716:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116400512 00000100:00100000:1.0:1788838074.947730:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116400512 00000100:00100000:1.0:1788838074.947840:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116400384 00000100:00100000:1.0:1788838074.947844:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116400384 00000100:00100000:1.0:1788838074.947875:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2502 00000100:00100000:1.0:1788838074.947886:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116400512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838074.948106:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116400000 00000100:00100000:0.0:1788838074.948112:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116400000 00000100:00100000:0.0:1788838074.948159:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:0.0:1788838074.948167:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116400000:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838074.948316:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116400256 00000100:00100000:3.0:1788838074.948320:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116400256 00000100:00100000:3.0:1788838074.948354:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116400128 00000100:00100000:3.0:1788838074.948357:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116400128 00000100:00100000:3.0:1788838074.948385:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1170 00000100:00100000:3.0:1788838074.948393:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116400256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838074.948452:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116400512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 567us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838074.948460:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2502 00000100:00100000:1.0:1788838074.948481:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2503 00000100:00100000:1.0:1788838074.948488:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116400384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838074.948975:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1171 00000100:00100000:2.0:1788838074.948989:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2406:x1875729116400128:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000080:2.0:1788838074.949018:0:75504:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505930a80 x1875729116400128/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:730/0 lens 224/224 e 0 to 0 dl 1788838085 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838074.953371:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116400000:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 5186us (5856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838074.953393:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00080000:0.0:1788838074.953501:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838074.953508:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838074.953513:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838074.953516:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838074.955988:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116400256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 5689us (6499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838074.956023:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1170 00000100:00100000:2.0:1788838074.956152:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2406:x1875729116400128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 7164us (8500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838074.956170:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1171 00000100:00100000:1.0:1788838074.958822:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116400384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 7594us (8403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838074.958857:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2503 00010000:00010000:2.0:1788838075.390530:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838076.412991:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838077.438571:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838077.821354:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838077.821391:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135018880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838077.821507:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838077.821545:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135019008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838077.821580:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838077.821624:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135018880 00000100:00100000:3.0:1788838077.821637:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135018880 00000100:00100000:3.0:1788838077.821726:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135019008 00000100:00100000:3.0:1788838077.821730:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135019008 00000100:00080000:2.0:1788838077.821739:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838077.821745:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838077.822693:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1788838077.822732:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135018880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838077.822775:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838077.823124:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135018880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 396us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838077.823134:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1788838077.823172:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:1.0:1788838077.823182:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135019008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838077.823205:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838077.823247:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135019008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838077.823253:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:1.0:1788838077.824978:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135019008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838077.827450:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135018880:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1788838077.967287:0:87104:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:3.0:1788838077.967361:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967378:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967400:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967408:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838077.967414:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967425:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967446:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff603cab900) 00010000:00010000:3.0:1788838077.967450:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838077.967455:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967463:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f800/0x88da08396ccc87f3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967497:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967505:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967511:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967745:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838077.967749:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967768:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967778:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff603cab900) 00010000:00010000:3.0:1788838077.967781:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838077.967784:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838077.967790:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff505bb0800/0x88da08396ccc882b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838078.460934:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838078.848189:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135019136:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848257:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848311:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135019648:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848336:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848357:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135020160:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848377:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848393:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135020672:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848440:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788838078.848446:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135019520:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848478:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848495:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135020032:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848517:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848532:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135020544:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848571:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135019264:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848609:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135019776:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848641:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135020288:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848658:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848671:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135020800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838078.848686:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848700:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788838078.848704:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135019392:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848742:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135019904:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848778:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135020416:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.848823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838078.848855:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135019648 00000100:00100000:2.0:1788838078.848863:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135019648 00000100:00100000:2.0:1788838078.848910:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135020160 00000100:00100000:2.0:1788838078.848913:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135020160 00000100:00100000:2.0:1788838078.848926:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135020672 00000100:00100000:2.0:1788838078.848929:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135020672 00000100:00100000:2.0:1788838078.848939:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135019520 00000100:00100000:2.0:1788838078.848941:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135019520 00000100:00100000:2.0:1788838078.848965:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135019264 00000100:00100000:2.0:1788838078.848968:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135019264 00000100:00100000:2.0:1788838078.848981:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135019392 00000100:00100000:2.0:1788838078.848983:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135019392 00000100:00100000:2.0:1788838078.848999:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1788838078.849007:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135019648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.849059:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135019648:12345-0@lo:400:kworker.0 Request processed in 52us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849067:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1788838078.849084:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1788838078.849090:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135020160:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838078.849103:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc71180 x1875729135020160/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:734/0 lens 224/224 e 0 to 0 dl 1788838089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838078.849128:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135020160:12345-0@lo:400:kworker.0 Request processed in 39us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849134:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1788838078.849151:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1788838078.849157:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135020672:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838078.849166:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc70380 x1875729135020672/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:734/0 lens 224/224 e 0 to 0 dl 1788838089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838078.849189:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135020672:12345-0@lo:400:kworker.0 Request processed in 33us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849195:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1788838078.849204:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1788838078.849209:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135019520:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838078.849217:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc72a00 x1875729135019520/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:734/0 lens 224/224 e 0 to 0 dl 1788838089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838078.849236:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135019520:12345-0@lo:400:kworker.0 Request processed in 28us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849242:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1788838078.849250:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1788838078.849255:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135019264:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838078.849264:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff502709180 x1875729135019264/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:734/0 lens 224/224 e 0 to 0 dl 1788838089 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838078.849287:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135019264:12345-0@lo:400:kworker.0 Request processed in 32us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849293:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1788838078.849302:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1788838078.849307:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135019392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.849328:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135019392:12345-0@lo:400:kworker.0 Request processed in 21us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849340:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1788838078.849371:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135020032 00000100:00100000:2.0:1788838078.849375:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135020032 00000100:00100000:2.0:1788838078.849399:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135020544 00000100:00100000:2.0:1788838078.849402:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135020544 00000100:00100000:2.0:1788838078.849421:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135019904 00000100:00100000:2.0:1788838078.849424:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135019904 00000100:00100000:2.0:1788838078.849439:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135020416 00000100:00100000:2.0:1788838078.849441:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135020416 00000100:00100000:2.0:1788838078.849463:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504 00000100:00100000:2.0:1788838078.849480:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135020032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.849513:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135020032:12345-0@lo:400:kworker.0 Request processed in 34us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849519:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504 00000100:00100000:2.0:1788838078.849529:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505 00000100:00100000:2.0:1788838078.849535:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135020544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.849555:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135020544:12345-0@lo:400:kworker.0 Request processed in 21us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849561:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505 00000100:00100000:2.0:1788838078.849569:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:2.0:1788838078.849574:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135019904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.849594:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135019904:12345-0@lo:400:kworker.0 Request processed in 20us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849599:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00000100:00100000:2.0:1788838078.849608:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:2.0:1788838078.849613:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135020416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.849643:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135020416:12345-0@lo:400:kworker.0 Request processed in 30us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849649:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00100000:2.0:1788838078.849670:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135019776 00000100:00100000:2.0:1788838078.849673:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135019776 00000100:00100000:2.0:1788838078.849694:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4070 00000100:00100000:2.0:1788838078.849699:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135019776:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838078.849711:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50270b100 x1875729135019776/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:734/0 lens 224/224 e 0 to 0 dl 1788838089 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838078.849735:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135019776:12345-0@lo:400:kworker.0 Request processed in 36us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849740:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4070 00000100:00100000:2.0:1788838078.849748:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135020288 00000100:00100000:2.0:1788838078.849751:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135020288 00000100:00100000:2.0:1788838078.849760:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135020800 00000100:00100000:2.0:1788838078.849762:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135020800 00000100:00100000:2.0:1788838078.849771:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4071 00000100:00100000:2.0:1788838078.849776:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135020288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.849816:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135020288:12345-0@lo:400:kworker.0 Request processed in 21us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849822:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4071 00000100:00100000:2.0:1788838078.849831:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072 00000100:00100000:2.0:1788838078.849837:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135020800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838078.849859:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788838078.849887:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135020800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838078.849901:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072 00000100:00080000:2.0:1788838078.849936:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838078.849940:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838078.849943:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838078.849945:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838078.849989:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135019392:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850000:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135019904:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850009:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135020416:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850018:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135019264:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850026:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135019776:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850035:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135020288:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850047:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135020800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838078.850093:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135019520:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850102:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135020032:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850111:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135020544:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850120:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135019648:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850128:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135020160:0@lo:400:kworker.0 00000100:00100000:2.0:1788838078.850137:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135020672:0@lo:400:kworker.0 00000100:00100000:0.0:1788838078.850593:0:87111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135019136 00000100:00100000:0.0:1788838078.850600:0:87111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135019136 00000100:00100000:0.0:1788838078.850642:0:87111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788838078.850650:0:87111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135019136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838078.850692:0:87111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135019136:12345-0@lo:400:kworker.0 Request processed in 43us (2436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838078.850698:0:87111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788838078.852019:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135019136:0@lo:400:kworker.0 00000001:02000400:3.0:1788838078.979342:0:88324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1788838079.142513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838079.143589:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116400640 00000100:00100000:3.0:1788838079.143602:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116400640 00000100:00100000:3.0:1788838079.143694:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1161 00000100:00100000:3.0:1788838079.143705:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:67850:x1875729116400640:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838079.143729:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838079.143755:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc83 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.143856:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b200/0x88da08396ccc8847 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.143872:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b200/0x88da08396ccc8847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.143898:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b200/0x88da08396ccc8847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838079.143963:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838079.143981:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838079.144038:0:66255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b200/0x88da08396ccc8847 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.144069:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc8840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc83 expref: 9 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.144092:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b200/0x88da08396ccc8847 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc83 expref: 8 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.144102:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff5037c5700) 00010000:00010000:3.0:1788838079.144105:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838079.144109:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63297b200, rc 0) 00010000:00000080:3.0:1788838079.144119:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505ac5c00 x1875729116400640/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:735/0 lens 576/688 e 0 to 0 dl 1788838090 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838079.144196:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67850:x1875729116400640:12345-192.168.203.30@tcp:101:dd.0 Request processed in 493us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838079.144204:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1161 00000100:00080000:2.0:1788838079.145728:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838079.150700:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838079.150775:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116400896 00000100:00100000:2.0:1788838079.150789:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116400896 00000100:00100000:2.0:1788838079.150903:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1162 00000100:00100000:2.0:1788838079.150915:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:67850:x1875729116400896:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838079.150938:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838079.150941:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788838079.150971:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b200/0x88da08396ccc8847 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc83 expref: 8 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.150999:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff5037c5700) 00010000:00010000:2.0:1788838079.151015:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838079.151038:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc884e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc8a expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151203:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151218:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151230:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151244:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc885c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151252:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc885c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151258:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc885c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151357:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151366:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151373:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838079.151505:0:66253:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1788838079.151509:0:66253:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1788838070 00000004:00010000:2.0:1788838079.151512:0:66253:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1788838070 00000004:00010000:2.0:1788838079.151514:0:66253:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1788838070 00000004:00010000:2.0:1788838079.151517:0:66253:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1788838079.151522:0:66253:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1788838079.151530:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151538:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151544:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151551:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151557:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5fa00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838079.151563:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151582:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151593:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831200) 00010000:00010000:2.0:1788838079.151596:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838079.151599:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151605:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5fa00/0x88da08396ccc8855 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151616:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc885c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151621:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc885c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151626:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc885c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151631:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5e800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838079.151633:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc885c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151639:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc885c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151645:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8ff63f831a00) 00010000:00010000:2.0:1788838079.151647:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838079.151649:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc885c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151665:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc885c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151707:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc884e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151724:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 9 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.151732:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:2.0:1788838079.151734:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1788838079.151737:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5ea00, rc 0) 00010000:00000080:2.0:1788838079.151746:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505932300 x1875729116400896/t107374182409(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:735/0 lens 752/824 e 0 to 0 dl 1788838090 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838079.151868:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:67850:x1875729116400896:12345-192.168.203.30@tcp:101:dd.0 Request processed in 954us (1177us total) trans 107374182409 rc 0/0 00000100:00100000:2.0:1788838079.151876:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1162 00000100:00100000:1.0:1788838079.164283:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838079.164510:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116401024 00000100:00100000:2.0:1788838079.164520:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116401024 00000100:00100000:2.0:1788838079.164588:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1163 00000100:00100000:2.0:1788838079.164598:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:67850:x1875729116401024:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838079.164622:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838079.164644:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8871 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc91 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.164677:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc8878 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.164697:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc8878 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.164708:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc8878 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.164829:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8871 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc91 expref: 11 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.164844:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc8878 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc91 expref: 10 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.164852:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:2.0:1788838079.164855:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788838079.164857:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5e800, rc 0) 00010000:00000080:2.0:1788838079.164875:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505931880 x1875729116401024/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:735/0 lens 568/1272 e 0 to 0 dl 1788838090 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838079.164932:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:67850:x1875729116401024:12345-192.168.203.30@tcp:101:dd.0 Request processed in 335us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838079.164939:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1163 00000100:00100000:1.0:1788838079.176459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838079.177256:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116401280 00000100:00100000:3.0:1788838079.177270:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116401280 00000100:00100000:3.0:1788838079.177343:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1164 00000100:00100000:3.0:1788838079.177360:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:67850:x1875729116401280:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:3.0:1788838079.177498:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.177519:0:66255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.177541:0:66255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.177578:0:66255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.177594:0:66255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 10 pid: 66253 timeout: 3573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838079.177615:0:66255:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66255:1875729135020928:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788838079.177706:0:66255:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a5c9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838079.181231:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838079.181327:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116401408 00000100:00100000:2.0:1788838079.181336:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116401408 00010000:00010000:2.0:1788838079.181373:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 11 pid: 66253 timeout: 3573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838079.181412:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2542 00000100:00100000:2.0:1788838079.181422:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2404:x1875729116401408:12345-192.168.203.30@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1788838079.181452:0:6532:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 11 pid: 66253 timeout: 3573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.181478:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 11 pid: 66253 timeout: 3573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.181490:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 11 pid: 66253 timeout: 3573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.181499:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:2.0:1788838079.181502:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1788838079.181506:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.181516:0:6532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.181524:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838079.181544:0:6532:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 11 pid: 66253 timeout: 3573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838079.181595:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2404:x1875729116401408:12345-192.168.203.30@tcp:102:ldlm_bl.0 Request processed in 174us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838079.181603:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2542 00000100:00100000:3.0:1788838079.184907:0:66255:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66255:1875729135020928:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788838079.184955:0:66255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.184968:0:66255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.184975:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838079.185111:0:66255:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1788838079.185115:0:66255:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788838070 -> 1788838079 00000004:00010000:3.0:1788838079.185118:0:66255:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788838070 -> 1788838070 00000004:00010000:3.0:1788838079.185120:0:66255:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788838070 -> 1788838079 00000004:00010000:3.0:1788838079.185122:0:66255:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:3.0:1788838079.185137:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052e14ddf reply state 00000000e47fc03d transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.185155:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838079.185165:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:3.0:1788838079.185169:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838079.185173:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1788838079.185233:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505933b80 x1875729116401280/t107374182410(0) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:735/0 lens 488/456 e 0 to 0 dl 1788838090 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838079.185295:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:67850:x1875729116401280:12345-192.168.203.30@tcp:36:dd.0 Request processed in 7943us (8844us total) trans 107374182410 rc 0/0 00000100:00100000:3.0:1788838079.185304:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1164 00000100:00100000:1.0:1788838079.190212:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838079.190317:0:66266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116401536 00000100:00100000:3.0:1788838079.190335:0:66266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116401536 00002000:00010000:3.0:1788838079.190374:0:66266:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:3.0:1788838079.190380:0:66266:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8ff505931500 with x1875729116401536 00000100:00100000:3.0:1788838079.190458:0:66266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1788838079.190478:0:66266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2406:x1875729116401536:12345-192.168.203.30@tcp:10:dd.0 00000004:00010000:3.0:1788838079.190664:0:66266:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1788838079.190668:0:66266:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788838079 -> 1788838079 00000004:00010000:3.0:1788838079.190670:0:66266:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788838070 -> 1788838070 00000004:00010000:3.0:1788838079.190672:0:66266:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788838079 -> 1788838079 00000004:00010000:3.0:1788838079.190674:0:66266:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788838079.190692:0:66266:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505931500 x1875729116401536/t107374182411(0) o10->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:735/0 lens 440/432 e 0 to 0 dl 1788838090 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838079.190768:0:66266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:2406:x1875729116401536:12345-192.168.203.30@tcp:10:dd.0 Request processed in 301us (565us total) trans 107374182411 rc 0/0 00000100:00100000:3.0:1788838079.190775:0:66266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00002000:00010000:3.0:1788838079.190779:0:66266:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:3.0:1788838079.190781:0:66266:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8ff505931500 with x1875729116401536 00000100:00100000:3.0:1788838079.227248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838079.227686:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116401792 00000100:00100000:0.0:1788838079.227696:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116401792 00000100:00100000:0.0:1788838079.227780:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:0.0:1788838079.227790:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:67850:x1875729116401792:12345-192.168.203.30@tcp:35:dd.0 00010000:00000080:0.0:1788838079.228029:0:66257:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc94380 x1875729116401792/t107374182412(0) o35->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:735/0 lens 392/456 e 0 to 0 dl 1788838090 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838079.228089:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+14:67850:x1875729116401792:12345-192.168.203.30@tcp:35:dd.0 Request processed in 302us (850us total) trans 107374182412 rc 0/0 00000100:00100000:0.0:1788838079.228097:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:2.0:1788838079.357251:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135021184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838079.357294:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135021056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838079.357376:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838079.357396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838079.357826:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135021056 00000100:00100000:0.0:1788838079.357838:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135021056 00000100:00100000:0.0:1788838079.357896:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:0.0:1788838079.357907:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135021056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788838079.357961:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838079.360063:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135021184 00000100:00100000:1.0:1788838079.360081:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135021184 00000100:00100000:1.0:1788838079.360143:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4073 00000100:00100000:1.0:1788838079.360156:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135021184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838079.360201:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445085184 avail 1298845696 00000100:00100000:2.0:1788838079.360231:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838079.360254:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135021312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838079.360348:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838079.361106:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135021312 00000100:00100000:3.0:1788838079.361115:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135021312 00000100:00100000:3.0:1788838079.361167:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00010000:00000080:1.0:1788838079.361324:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505ac4a80 x1875729135021184/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:735/0 lens 224/368 e 0 to 0 dl 1788838090 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838079.361433:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135021184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1280us (4058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838079.361442:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4073 00000100:00100000:3.0:1788838079.361873:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135021312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838079.361903:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838079.362197:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135021056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4290us (4801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838079.362207:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:1.0:1788838079.362399:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135021056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838079.362571:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135021312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 705us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838079.362579:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:2.0:1788838079.362685:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135021312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838079.362701:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135021184:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788838079.486246:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838080.060256:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838080.060315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838080.060350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838080.060372:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838080.060400:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838080.060437:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116402176 00000100:00100000:1.0:1788838080.060450:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116402176 00000100:00100000:1.0:1788838080.060531:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116402048 00000100:00100000:1.0:1788838080.060534:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116402048 00000100:00100000:1.0:1788838080.060559:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1178 00000100:00100000:1.0:1788838080.060583:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116402176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838080.060671:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116402176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838080.060678:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1178 00000100:00100000:1.0:1788838080.060697:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1179 00000100:00100000:1.0:1788838080.060706:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+14:2406:x1875729116402048:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000080:1.0:1788838080.060727:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504ffad80 x1875729116402048/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:736/0 lens 224/224 e 0 to 0 dl 1788838091 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838080.060753:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+14:2406:x1875729116402048:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 50us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838080.060777:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1179 00000100:00100000:1.0:1788838080.060833:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116402432 00000100:00100000:1.0:1788838080.060836:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116402432 00000100:00100000:1.0:1788838080.060864:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116402304 00000100:00100000:1.0:1788838080.060867:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116402304 00000100:00100000:1.0:1788838080.060892:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2508 00000100:00100000:1.0:1788838080.060899:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64134b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116402432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838080.060931:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64134b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116402432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838080.060938:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2508 00000100:00100000:1.0:1788838080.061123:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2509 00000100:00100000:1.0:1788838080.061130:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116402304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838080.061155:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116402304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838080.061161:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2509 00000100:00080000:1.0:1788838080.061184:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838080.061188:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838080.061190:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838080.061382:0:87108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116401920 00000100:00100000:3.0:1788838080.061387:0:87108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116401920 00000100:00100000:3.0:1788838080.061429:0:87108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:3.0:1788838080.061437:0:87108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a2a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116401920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838080.061539:0:87108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a2a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116401920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 49us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838080.061547:0:87108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00010000:00010000:1.0:1788838080.517502:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788838081.144212:0:88422:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788838081.144296:0:88422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.144317:0:88422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.144341:0:88422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.144348:0:88422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.144375:0:88422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788838081.144382:0:88422:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788838081.144417:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788838081.144422:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788838081.144429:0:88422:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788838081.144472:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff6104de800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788838081.144554:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135021440:0@lo:39:umount.0 00000100:00100000:1.0:1788838081.144655:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838081.144772:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135021440 00000100:00100000:2.0:1788838081.144784:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135021440 00000100:00100000:2.0:1788838081.145081:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1788838081.145091:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729135021440:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788838081.145126:0:66254:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8514 00000100:00080000:2.0:1788838081.145147:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff624a92800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1788838081.145186:0:66254:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504ff9f80 x1875729135021440/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1788838092 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838081.145243:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1875729135021440:12345-0@lo:39:umount.0 Request processed in 153us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838081.145251:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000020:00000080:2.0:1788838081.145263:0:66254:0:(genops.c:885:class_export_put()) final put ffff8ff624a92000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788838081.145363:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838081.145371:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.145381:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030c00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838081.145394:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.145405:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838081.145413:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838081.145419:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838081.145423:0:6534:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788838081.145425:0:6534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788838081.145472:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.145480:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838081.145511:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.145519:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff600030c00/0x88da08396ccc8411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8418 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.145533:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838081.145535:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838081.145536:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838081.145546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff624a92000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788838081.145600:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff624a92800 for lustre-MDT0000 00000100:00100000:1.0:1788838081.145612:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838081.145624:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135021568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838081.145662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838081.145715:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135021568 00000100:00100000:1.0:1788838081.145726:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135021568 00000100:00100000:1.0:1788838081.145769:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1788838081.145776:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135021568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838081.145789:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838081.145826:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600030200/0x88da08396ccc8418 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8411 expref: 24 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.145843:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838081.145873:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3646:x1875729135021568:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838081.145879:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1788838081.145922:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135021568:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788838081.145957:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6104de800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788838081.145968:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135021440:0@lo:39:umount.0 00000100:00080000:3.0:1788838081.146055:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788838081.146069:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788838081.146074:0:88422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788838081.146792:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838081.147035:0:88422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147052:0:88422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147060:0:88422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147068:0:88422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147096:0:88422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838081.147115:0:88422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147125:0:88422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147127:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838081.147141:0:88422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147144:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147164:0:88422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147194:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f400 already unused, calling callback (ffffffffc13dbc20) 00010000:00010000:3.0:1788838081.147199:0:88422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:0.0:1788838081.147200:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147213:0:88422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147218:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147226:0:88422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147243:0:88422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147249:0:88422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147262:0:88422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788838081.147268:0:88422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147274:0:88422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147288:0:88422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147295:0:88422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.147310:0:88422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1788838081.147315:0:88422:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788838081.147355:0:88422:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788838081.147360:0:88422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788838081.147365:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788838081.147371:0:88422:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 10000000:00010000:0.0:1788838081.147405:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838081.147416:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788838081.147420:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788838081.147423:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788838081.147487:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147494:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838081.147534:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147542:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5f400/0x88da08396ccc8331 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8338 expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147559:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838081.147563:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147570:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788838081.147572:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147579:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838081.147585:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838081.147591:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788838081.147593:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788838081.147595:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788838081.147610:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147617:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838081.147629:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147635:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607460400/0x88da08396ccc843b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8442 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147656:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838081.147660:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147665:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031c00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788838081.147668:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147674:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838081.147681:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838081.147686:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788838081.147688:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788838081.147690:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788838081.147704:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147709:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838081.147715:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147721:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc8403 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc840a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147731:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838081.147735:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147746:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030000 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788838081.147749:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147756:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838081.147762:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838081.147767:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788838081.147769:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788838081.147771:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788838081.147785:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147791:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838081.147835:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147841:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff600030000/0x88da08396ccc8323 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc832a expref: -99 pid: 87103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.147851:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838081.147853:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838081.147855:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838081.147863:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838081.148532:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838081.148565:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135021696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838081.148674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838081.148751:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838081.148758:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135022080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838081.148783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838081.148836:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135021696 00000100:00100000:1.0:1788838081.148845:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135021696 00000100:00100000:1.0:1788838081.148899:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135022080 00000100:00100000:1.0:1788838081.148902:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135022080 00000100:00100000:1.0:1788838081.148928:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1788838081.148938:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135021696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838081.148957:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838081.148993:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc8338 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8331 expref: 24 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.149011:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838081.149051:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3646:x1875729135021696:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838081.149058:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1788838081.149131:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1788838081.149138:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3646:x1875729135022080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838081.149164:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838081.149175:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5e600/0x88da08396ccc832a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8323 expref: 22 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.149184:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838081.149206:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3646:x1875729135022080:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838081.149212:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00010000:00010000:1.0:1788838081.149240:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838081.149269:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135022080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838081.149279:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135021696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838081.149532:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135021824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838081.149574:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838081.149610:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838081.149618:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135021952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838081.149642:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838081.149786:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135021824 00000100:00100000:0.0:1788838081.149830:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135021824 00000100:00100000:0.0:1788838081.149902:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135021952 00000100:00100000:0.0:1788838081.149921:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135021952 00000100:00100000:0.0:1788838081.149967:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1788838081.149982:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3643:x1875729135021824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838081.150004:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838081.150030:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f000/0x88da08396ccc8442 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc843b expref: 22 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838081.150053:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838081.150159:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3643:x1875729135021824:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838081.150168:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1788838081.150191:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1788838081.150206:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3643:x1875729135021952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838081.150218:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838081.150236:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5fe00/0x88da08396ccc840a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8403 expref: 20 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.150248:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838081.150294:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:3643:x1875729135021952:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838081.150301:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1788838081.150395:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135021952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838081.150406:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135021824:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1788838081.152976:0:88422:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1788838081.153479:0:87104:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182412 is committed 00010000:00010000:3.0:1788838081.153654:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.153669:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.153679:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.153687:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297b600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838081.153692:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.153702:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.153726:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:3.0:1788838081.153744:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838081.153751:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.153758:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297b600/0x88da08396ccc887f lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788838081.154061:0:88422:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1788838081.154080:0:88422:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff610296000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838081.154089:0:88422:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff63f7cd800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838081.154094:0:88422:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff50345b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838081.154099:0:88422:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff640eeb000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838081.154107:0:88422:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff640ee8800 fdcf066d-ff07-4b2e-96ab-52415ed6bf72 192.168.203.30@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 107374182412 stale:0 00000020:00080000:0.0:1788838081.154115:0:88422:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8ff6395619b8) has exports, disconnecting them 00000020:00080000:0.0:1788838081.154120:0:88422:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff610296000), last request at 1788838048 00000020:00000080:0.0:1788838081.154130:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc850d 00000100:00080000:0.0:1788838081.154146:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff624a96800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838081.154191:0:88422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff610296000): rc 0 00000020:00000080:0.0:1788838081.154194:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff610296000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788838081.154210:0:88422:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff63f7cd800), last request at 1788838078 00000020:00000080:0.0:1788838081.154213:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8506 00000100:00080000:0.0:1788838081.154218:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff63f7cf800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788838081.154283:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788838081.154295:0:88422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff63f7cd800): rc 0 00000020:00000080:0.0:1788838081.154298:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff63f7cd800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788838081.154303:0:88422:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff50345b800), last request at 1788838078 00000020:00000080:0.0:1788838081.154307:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc84ff 00000100:00080000:0.0:1788838081.154313:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff50345e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838081.154331:0:88422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff50345b800): rc 0 00000020:00000080:0.0:1788838081.154333:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff50345b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788838081.154337:0:88422:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff640eeb000), last request at 1788838042 00000020:00000080:0.0:1788838081.154347:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8385 00000100:00080000:0.0:1788838081.154361:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff624a95800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838081.154414:0:88422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff640eeb000): rc 0 00000020:00000080:0.0:1788838081.154417:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff640eeb000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1788838081.154422:0:88422:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.30@tcp (ffff8ff640ee8800), last request at 1788838080 00000020:00000080:0.0:1788838081.154426:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc837e 00000020:00010000:0.0:1788838081.154432:0:88422:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff640ee8800: total 4 00000100:00080000:0.0:1788838081.154437:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff6049ba800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838081.154467:0:88422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff640ee8800): rc 0 00000004:00000080:0.0:1788838081.154475:0:88422:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f5181d77ae0 00000100:00080000:0.0:1788838081.154506:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788838081.154511:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:1.0:1788838081.154692:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff610296000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788838081.154773:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff63f7cd800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788838081.154826:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50345b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788838081.154851:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640eeb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788838081.154888:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff624a96800 for lustre-MDT0000 00000020:00000080:1.0:1788838081.154897:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff63f7cf800 for lustre-MDT0000 00000020:00000080:1.0:1788838081.154901:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50345e800 for lustre-MDT0000 00000020:00000080:1.0:1788838081.154905:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff624a95800 for lustre-MDT0000 00000020:00010000:1.0:1788838081.154920:0:63563:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff640ee8800: total 0 00010000:00010000:1.0:1788838081.155017:0:63563:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff640ee8800, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1788838081.155073:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ea00/0x88da08396ccc8863 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 4 pid: 66253 timeout: 3573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.155100:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fe00/0x88da08396ccc8752 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc44 expref: 3 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.155127:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e800/0x88da08396ccc8878 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc91 expref: 2 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838081.155148:0:63563:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff640ee8800, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1788838081.156856:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838081.169020:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838081.169035:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838081.172606:0:88422:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788838081.172654:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff627d59000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788838081.172758:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135022208:0@lo:39:umount.0 00000100:00100000:2.0:1788838081.172880:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788838081.173262:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788838081.173271:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:0.0:1788838081.173296:0:88422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788838081.173845:0:88422:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788838081.173875:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff5036b5800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788838081.174657:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135022336:0@lo:9:umount.0 00000100:00100000:2.0:1788838081.174725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838081.174827:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135022208 00000100:00100000:2.0:1788838081.174836:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135022208 00000100:00100000:2.0:1788838081.174896:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4074 00000100:00100000:2.0:1788838081.174908:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135022208:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788838081.174950:0:8471:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc83c4 00000100:00080000:2.0:1788838081.174961:0:8471:0:(import.c:65:import_set_state_nolock()) ffff8ff62cead800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788838081.174992:0:8471:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411435 00000100:00080000:0.0:1788838081.175617:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788838081.175644:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:0.0:1788838081.175670:0:88422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788838081.175936:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135022336 00000100:00100000:3.0:1788838081.175948:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135022336 00000100:00100000:3.0:1788838081.176030:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5935 00000100:00100000:3.0:1788838081.176041:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135022336:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788838081.176193:0:26207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc83e0 00000100:00080000:3.0:1788838081.176205:0:26207:0:(import.c:65:import_set_state_nolock()) ffff8ff509c61000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788838081.176406:0:26207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:2.0:1788838081.176532:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3642:x1875729135022208:12345-0@lo:39:umount.0 Request processed in 1614us (3645us total) trans 77309411436 rc 0/0 00000100:00100000:2.0:1788838081.176546:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4074 00000100:00080000:2.0:1788838081.176667:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff627d59000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788838081.176678:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135022208:0@lo:39:umount.0 00000100:00080000:2.0:1788838081.176700:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5036b5800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788838081.176721:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788838081.176724:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838081.176728:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135022336:0@lo:9:umount.0 00000100:00100000:3.0:1788838081.176738:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729135022336:12345-0@lo:9:umount.0 Request processed in 692us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838081.176751:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5935 00000100:00080000:0.0:1788838081.176775:0:88422:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788838081.176789:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788838081.176852:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838081.176854:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff5036b3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788838081.176863:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838081.176895:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135022464:0@lo:9:umount.0 00000020:00080000:0.0:1788838081.176941:0:88422:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff6395619b8) has no exports 00000100:00100000:2.0:1788838081.176979:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838081.177423:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135022464 00000100:00100000:0.0:1788838081.177432:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135022464 00000100:00080000:3.0:1788838081.177485:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838081.177511:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5936 00000100:00100000:0.0:1788838081.177524:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135022464:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788838081.177557:0:26206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc83f5 00000100:00080000:0.0:1788838081.177565:0:26206:0:(import.c:65:import_set_state_nolock()) ffff8ff509c75000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788838081.177597:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788838081.177622:0:26206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000020:00000080:1.0:1788838081.177749:0:63563:0:(genops.c:885:class_export_put()) final put ffff8ff640ee8800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000100:00100000:0.0:1788838081.177839:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729135022464:12345-0@lo:9:umount.0 Request processed in 276us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838081.177849:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5936 00010000:00010000:1.0:1788838081.177861:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838081.177864:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838081.177867:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788838081.177980:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640ee8800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-MDT0000 00000020:00000080:3.0:1788838081.178051:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6049ba800 for lustre-MDT0000 00000100:00080000:2.0:1788838081.178621:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5036b3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788838081.178647:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788838081.178670:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838081.178679:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135022464:0@lo:9:umount.0 00000020:00080000:0.0:1788838081.179019:0:88422:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff6395619b8) has no exports 00000020:00000080:0.0:1788838081.266618:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc839a 00000020:00000080:0.0:1788838081.266715:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff61d4bb800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788838081.266820:0:88422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788838081.274589:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838081.274621:0:88422:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788838081.274630:0:88422:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ff624ff19b8) has no exports 00000020:00000080:0.0:1788838081.276618:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8393 00000020:00000080:0.0:1788838081.276651:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff62ceaa800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788838081.276752:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838081.276767:0:88422:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788838081.277748:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff61d4bb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788838081.277759:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff640eed800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788838081.277762:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640eed800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788838081.277776:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788838081.277992:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceaa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788838081.278074:0:88422:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff640e742a0 - data ffff8ff63fd1d510/ffff8ff50452f800 00000020:01000000:3.0:1788838081.278330:0:88422:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff640e741e0 - data ffff8ff633f90798/ffff8ff62ba7c800 00000100:00080000:1.0:1788838081.381077:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788838081.381090:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788838081.381108:0:88422:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ff5071cc380 x1875729135022208/t77309411436(77309411436) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838091 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838081.381739:0:88422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788838081.384617:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788838081.384627:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:1.0:1788838081.384993:0:88422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788838081.384997:0:88422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788838081.385961:0:87121:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788838081.385969:0:87121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:2.0:1788838081.385985:0:87121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:1.0:1788838081.386991:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788838081.386999:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:1.0:1788838081.387253:0:88422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788838081.387257:0:88422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788838081.387614:0:87123:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788838081.387620:0:87123:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:3.0:1788838081.387633:0:87123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:1.0:1788838081.388931:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8354 00000020:00000080:1.0:1788838081.388946:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff627d5b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788838081.389598:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d5b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788838081.390025:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8369 00000020:00000080:1.0:1788838081.390035:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff627d1b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788838081.390082:0:88422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788838081.390089:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838081.390104:0:88422:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788838081.390109:0:88422:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8ff639560000) has no exports 00000004:01000000:1.0:1788838081.390323:0:88422:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788838081.390335:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc83e7 00000020:00000080:1.0:1788838081.390401:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff5036b3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788838081.391015:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d1b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788838081.391211:0:88422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788838081.391218:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838081.391244:0:88422:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788838081.391248:0:88422:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8ff503ca4d28) has no exports 00000020:00000080:1.0:1788838081.391258:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc83d9 00000020:00000080:1.0:1788838081.391265:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff5036b2000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788838081.391708:0:88422:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788838081.391714:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788838081.391720:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:1.0:1788838081.391728:0:88422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788838081.391731:0:88422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788838081.391771:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838081.391780:0:88422:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838081.391788:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc83cb 00000020:00000080:1.0:1788838081.391793:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff608b83800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788838081.391829:0:88422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788838081.391833:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838081.391838:0:88422:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788838081.391841:0:88422:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8ff6271ccd28) has no exports 00000020:00000080:1.0:1788838081.391845:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc83bd 00000020:00000080:1.0:1788838081.391849:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff5036b1000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788838081.392225:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5036b3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788838081.392235:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5036b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788838081.392241:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5036b3000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788838081.392247:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff6104dd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788838081.392250:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104dd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788838081.392255:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788838081.392387:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff608b83800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788838081.392397:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5036b1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788838081.393534:0:88422:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788838081.393542:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788838081.393547:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:1.0:1788838081.393555:0:88422:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788838081.393558:0:88422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788838081.393655:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838081.393671:0:88422:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788838081.393691:0:88422:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788838081.393699:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc83af 00000020:00000080:1.0:1788838081.393709:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff5036b6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788838081.397181:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5036b5800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788838081.397205:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff5036b7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788838081.397210:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5036b7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788838081.397220:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788838081.397654:0:88422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788838081.397664:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838081.397686:0:88422:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788838081.397705:0:88422:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8ff624ff3370) has no exports 00000020:00000080:1.0:1788838081.397716:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc83a8 00000020:00000080:1.0:1788838081.397726:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff639712000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788838081.398902:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5036b6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788838081.398920:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff639712000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788838081.419752:0:88422:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788838081.419764:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788838081.419771:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788838081.419781:0:88422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788838081.419908:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff627d59000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788838081.419956:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838081.419977:0:88422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838081.419986:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff62ceae000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788838081.419992:0:88422:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceae000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788838081.420007:0:88422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838081.420155:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838081.420161:0:88422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838081.420166:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff604fe7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788838081.420169:0:88422:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604fe7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788838081.420173:0:88422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838081.420292:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8370 00000020:00000080:1.0:1788838081.420300:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff627d1b800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788838081.420310:0:88422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788838081.420313:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838081.420319:0:88422:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788838081.420323:0:88422:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ff608224d28) has no exports 00000020:00000080:1.0:1788838081.420345:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838081.420348:0:88422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788838081.420351:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8377 00000020:00000080:1.0:1788838081.420354:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff627d18800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788838081.420361:0:88422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff605444800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788838081.420363:0:88422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff605444800 3 00000020:01000004:1.0:1788838081.420367:0:88422:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff605444800 from lustre-MDT0000 00000020:00000080:1.0:1788838081.420384:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838081.420395:0:88422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788838081.420398:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff627d5c000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788838081.420399:0:88422:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d5c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788838081.420406:0:88422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788838081.420430:0:88422:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788838081.420433:0:88422:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788838081.420435:0:88422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788838081.420436:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838081.420438:0:88422:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788838081.420444:0:88422:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff602d1d800 57943c9a-ca27-46d8-8845-5d2bce640e45 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788838081.420463:0:88422:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff604fe3800 4043f878-3455-4729-a2a8-e06e8394cc00 192.168.203.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788838081.420468:0:88422:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8ff610240000) has exports, disconnecting them 00000020:00080000:1.0:1788838081.420473:0:88422:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ff602d1d800), last request at 1788838042 00000020:00000080:1.0:1788838081.420495:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8315 00000020:00010000:1.0:1788838081.420499:0:88422:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff602d1d800: total 2 00000100:00080000:1.0:1788838081.420503:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff602d1a800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788838081.420544:0:88422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff602d1d800): rc 0 00000020:00080000:1.0:1788838081.420547:0:88422:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.30@tcp (ffff8ff604fe3800), last request at 1788838039 00000020:00000080:1.0:1788838081.420590:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc82f2 00000020:00010000:1.0:1788838081.420593:0:88422:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff604fe3800: total 2 00000100:00080000:1.0:1788838081.420595:0:88422:0:(import.c:65:import_set_state_nolock()) ffff8ff604fe6800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788838081.420618:0:6535:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff602d1d800: total 2 00000020:00000080:2.0:1788838081.420642:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d1b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788838081.420649:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff627d1d000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788838081.420651:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d1d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788838081.420661:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:3.0:1788838081.420665:0:6535:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff602d1d800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788838081.420707:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607460c00/0x88da08396ccc84c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc84b9 expref: 14 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420725:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9000/0x88da08396ccc8450 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8449 expref: 13 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420734:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f200/0x88da08396ccc84ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc84c7 expref: 12 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420743:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc845e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8457 expref: 11 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788838081.420746:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d18800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788838081.420765:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc84dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc84d5 expref: 10 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420772:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc846c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8465 expref: 9 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420780:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9600/0x88da08396ccc84ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc84e3 expref: 8 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420792:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc847a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8473 expref: 7 pid: 87114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420819:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5e400/0x88da08396ccc8496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc848f expref: 6 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420828:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc84f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc84f1 expref: 5 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420836:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607461c00/0x88da08396ccc8488 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8481 expref: 4 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420844:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc84a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc849d expref: 3 pid: 87108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420852:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607460e00/0x88da08396ccc84b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc84ab expref: 2 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420858:0:6535:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff602d1d800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788838081.420877:0:6535:0:(genops.c:885:class_export_put()) final put ffff8ff602d1d800/57943c9a-ca27-46d8-8845-5d2bce640e45 00000020:00010000:3.0:1788838081.420886:0:6535:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff604fe3800: total 1 00010000:00010000:3.0:1788838081.420915:0:6535:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff604fe3800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1788838081.420935:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607461000/0x88da08396ccc8434 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc36 expref: 7 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420956:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600031800/0x88da08396ccc8307 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc28 expref: 6 pid: 87110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420974:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607460600/0x88da08396ccc8300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc21 expref: 5 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838081.420986:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff607461a00/0x88da08396ccc830e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc2f expref: 4 pid: 87111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788838081.420991:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff602d1d800/57943c9a-ca27-46d8-8845-5d2bce640e45 for MGS 00010000:00010000:3.0:1788838081.420998:0:6535:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff604fe3800, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1788838081.421016:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838081.421019:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838081.421022:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788838081.421026:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff602d1a800 for MGS 00000020:00080000:1.0:1788838081.421102:0:88422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff604fe3800): rc 0 00000020:00000080:1.0:1788838081.421105:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff604fe3800/4043f878-3455-4729-a2a8-e06e8394cc00 00000020:00080000:1.0:1788838081.421123:0:88422:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ff610240000) has no exports 00000100:00100000:1.0:1788838081.421201:0:87114:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8ff6270dcc00:87114] 3 exiting: rc = 0 00000020:00000080:2.0:1788838081.421374:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604fe3800/4043f878-3455-4729-a2a8-e06e8394cc00 for MGS 00000020:00000080:2.0:1788838081.421401:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff604fe6800 for MGS 00000100:00100000:1.0:1788838081.421423:0:87110:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ff62bc18c00:87110] 1 exiting: rc = 0 00010000:00010000:3.0:1788838081.421524:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838081.421558:0:87108:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ff637d31400:87108] 0 exiting: rc = 1 00000100:00100000:1.0:1788838081.421864:0:87111:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ff63298ea00:87111] 2 exiting: rc = 0 00000100:00100000:2.0:1788838081.421980:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.421988:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.421992:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.421996:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422001:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422006:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422010:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422014:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422020:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422024:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422029:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422033:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422037:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422042:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422054:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422059:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422063:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422096:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422104:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422112:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422118:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422123:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422129:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422135:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422155:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422186:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422193:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422201:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422209:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422218:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422227:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422236:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422244:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422253:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422261:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422269:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422278:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422287:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422296:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422305:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422313:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422321:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422328:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422337:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422344:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422350:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422357:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422369:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422381:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422408:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422417:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422424:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422526:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422534:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422542:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422552:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422562:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422570:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422577:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422585:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422594:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422602:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422609:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788838081.422615:0:88422:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788838081.424381:0:88422:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff50441cd80 - data ffff8ff63fc995e8/ffff8ff639527400 00000020:01000000:2.0:1788838081.424605:0:88422:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff611ab39c0 - data ffff8ff63fe5dd80/ffff8ff63a3e8800 00000020:00000080:2.0:1788838081.425619:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc82eb 00000020:00000080:2.0:1788838081.425632:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff604965800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788838081.425658:0:88422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff605444800 from MGS, refs=2 00000020:01000004:2.0:1788838081.425663:0:88422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff605444800 2 00000020:01000004:2.0:1788838081.425667:0:88422:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff605444800 from MGS 00000020:00000080:3.0:1788838081.425690:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604965800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788838081.425699:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838081.425708:0:88422:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788838081.425712:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff604960000/MGS 00000020:00000080:2.0:1788838081.425714:0:88422:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604960000/MGS for MGS 00000020:01000000:2.0:1788838081.425722:0:88422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788838081.425855:0:88422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788838081.425861:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838081.425873:0:88422:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788838081.425882:0:88422:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ff610292800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788838081.425889:0:88422:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8ff503ca0000) has exports, disconnecting them 00000020:00080000:2.0:1788838081.425895:0:88422:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ff610292800), last request at 1788838042 00000020:00000080:2.0:1788838081.425911:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8426 00000020:00080000:2.0:1788838081.425924:0:88422:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff610292800): rc 0 00000020:00000080:2.0:1788838081.425931:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff610292800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788838081.426217:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff610292800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788838081.432513:0:88422:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788838081.432527:0:88422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788838081.432533:0:88422:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788838081.432544:0:88422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788838081.432650:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6104de800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788838081.432844:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838081.432863:0:88422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788838081.432872:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff610292000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788838081.432876:0:88422:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff610292000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788838081.432885:0:88422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788838081.433060:0:88422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff605444800 1 00000020:00000080:3.0:1788838081.433070:0:88422:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc82dd 00000020:00000080:3.0:1788838081.433078:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff604961800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788838081.433092:0:88422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788838081.433098:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788838081.433104:0:88422:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788838081.433109:0:88422:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ff6271c8000) has no exports 00000020:00000080:2.0:1788838081.433129:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604961800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788838081.461357:0:88422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838081.461380:0:88422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788838081.461388:0:88422:0:(genops.c:885:class_export_put()) final put ffff8ff63f789800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788838081.461394:0:88422:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff63f789800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788838081.461410:0:88422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788838081.461596:0:88422:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ff63f78e000 00000020:02000400:2.0:1788838081.461682:0:88422:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788838081.533343:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838082.557192:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838082.942250:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135022592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838082.942332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838082.942494:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135022592 00000100:00100000:2.0:1788838082.942506:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135022592 00000100:00100000:2.0:1788838082.942577:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:2.0:1788838082.942588:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135022592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838082.942623:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788838082.942691:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838082.942708:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135022720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838082.942747:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838082.943264:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135022720 00000100:00100000:1.0:1788838082.943269:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135022720 00000100:00100000:1.0:1788838082.943308:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:1.0:1788838082.943316:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135022720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838082.943334:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838082.943371:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135022720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838082.943378:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:3.0:1788838082.943484:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135022720:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788838082.943531:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838082.944319:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135022592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1731us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838082.944328:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:1.0:1788838082.944428:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135022592:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788838083.588445:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838083.967053:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135022976:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.967136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838083.967198:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135022976 00000100:00100000:0.0:1788838083.967205:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135022976 00000100:00100000:0.0:1788838083.967260:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:0.0:1788838083.967268:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875729135022976:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788838083.967275:0:66253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788838083.967327:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875729135022976:12345-0@lo:400:kworker.0 Request processed in 46us (178us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788838083.967336:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00080000:0.0:1788838083.967377:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788838083.967383:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788838083.967387:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788838083.967393:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838083.967396:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3442 00000100:00080000:0.0:1788838083.967403:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838083.967427:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071cc380 x1875729135023104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838083.967458:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135022976:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.967481:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135023104:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788838083.967506:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838083.967536:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135023104 00000100:00100000:0.0:1788838083.967540:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135023104 00000100:00100000:0.0:1788838083.967562:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1788838083.967566:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135023104:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788838083.967586:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838083.967627:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135023104:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 59us (120us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838083.967633:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00080000:0.0:1788838083.967659:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838083.967664:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838083.967666:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135023104:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788838083.967699:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135023232:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.967723:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838083.967751:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135023232 00000100:00100000:0.0:1788838083.967755:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135023232 00000100:00100000:0.0:1788838083.967788:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1788838083.967794:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135023232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.967859:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135023232:12345-0@lo:400:kworker.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838083.967866:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1788838083.967893:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135023232:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.967941:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135023616:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.967969:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838083.968011:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135023744:0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.968033:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838083.968062:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135023744 00000100:00100000:0.0:1788838083.968066:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135023744 00000100:00100000:0.0:1788838083.968092:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510 00000100:00100000:0.0:1788838083.968099:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135023744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838083.968134:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135023744:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838083.968148:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510 00000100:00100000:0.0:1788838083.968179:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135023744:0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.968293:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135022848:0@lo:400:kworker.0 00000400:00000100:3.0:1788838083.968319:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135022848 offset 0 length 224: 4 00000100:00100000:3.0:1788838083.968342:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135023488:0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.968362:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838083.968386:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135024000:0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.968404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838083.968423:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788838083.968428:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135023360:0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.968461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838083.968475:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135023872:0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.968493:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838083.968518:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838083.968528:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135023488 00000100:00100000:3.0:1788838083.968531:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135023488 00000100:00100000:3.0:1788838083.968558:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135024000 00000100:00100000:3.0:1788838083.968560:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135024000 00000100:00100000:3.0:1788838083.968570:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135023360 00000100:00100000:3.0:1788838083.968572:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135023360 00000100:00100000:3.0:1788838083.968581:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1788838083.968586:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135023488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.968628:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135023488:12345-0@lo:400:kworker.0 Request processed in 41us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838083.968634:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1788838083.968647:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1788838083.968650:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875729135024000:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838083.968655:0:66255:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838083.968672:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875729135024000:12345-0@lo:400:kworker.0 Request processed in 21us (268us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838083.968677:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1788838083.968684:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1788838083.968688:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875729135023360:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838083.968691:0:66255:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838083.968706:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875729135023360:12345-0@lo:400:kworker.0 Request processed in 17us (245us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838083.968711:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1788838083.968724:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135023616 00000100:00100000:3.0:1788838083.968727:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135023616 00000100:00100000:3.0:1788838083.968746:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075 00000100:00100000:3.0:1788838083.968751:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1875729135023616:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838083.968755:0:8472:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838083.968779:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3645:x1875729135023616:12345-0@lo:400:kworker.0 Request processed in 28us (810us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838083.968784:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075 00000100:00100000:3.0:1788838083.968816:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135023872 00000100:00100000:3.0:1788838083.968819:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135023872 00000100:00100000:3.0:1788838083.968840:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511 00000100:00100000:3.0:1788838083.968845:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135023872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.968880:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135023872:12345-0@lo:400:kworker.0 Request processed in 35us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838083.968885:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511 00000100:00080000:3.0:1788838083.968908:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838083.968928:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838083.968931:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838083.968934:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788838083.968938:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838083.968941:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3442 00000100:00080000:3.0:1788838083.968946:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838083.968964:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd3800 x1875729135024128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838083.968981:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135023360:0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.968993:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135023872:0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.969003:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135023488:0@lo:400:kworker.0 00000100:00080000:3.0:1788838083.969009:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838083.969012:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838083.969015:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788838083.969017:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838083.969020:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3442 00000100:00080000:3.0:1788838083.969024:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838083.969036:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd1180 x1875729135024256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838083.969053:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135024000:0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.969076:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135024128:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788838083.969100:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838083.969116:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135024256:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788838083.969135:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838083.969158:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135024128 00000100:00100000:3.0:1788838083.969162:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135024128 00000100:00100000:3.0:1788838083.969180:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135024256 00000100:00100000:3.0:1788838083.969183:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135024256 00000100:00100000:3.0:1788838083.969195:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1788838083.969198:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135024128:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788838083.969214:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838083.969244:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135024128:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 44us (143us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838083.969251:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1788838083.969261:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1788838083.969265:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135024256:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788838083.969274:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838083.969296:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135024256:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 30us (160us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838083.969302:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:3.0:1788838083.969326:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838083.969330:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838083.969333:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135024128:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788838083.969349:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838083.969352:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838083.969355:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135024256:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788838083.969383:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838083.969385:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838083.969388:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788838083.969393:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838083.969396:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3442 00000100:00080000:3.0:1788838083.969400:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838083.969413:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd1180 x1875729135024384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838083.969426:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135023616:0@lo:400:kworker.0 00000100:00100000:3.0:1788838083.969455:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135024384:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788838083.969477:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838083.969503:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135024384 00000100:00100000:3.0:1788838083.969506:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135024384 00000100:00100000:3.0:1788838083.969529:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4076 00000100:00100000:3.0:1788838083.969533:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135024384:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788838083.969543:0:8471:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838083.969571:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135024384:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 37us (93us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838083.969577:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4076 00000100:00080000:3.0:1788838083.969600:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838083.969610:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838083.969613:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135024384:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1788838084.606283:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838084.674165:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838084.674222:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838084.674478:0:66268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116402560 00000100:00100000:2.0:1788838084.674492:0:66268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116402560 00000100:00100000:2.0:1788838084.674548:0:66268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1788838084.674558:0:66268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2406:x1875729116402560:12345-192.168.203.30@tcp:4:dd.0 00000020:00080000:2.0:1788838084.674567:0:66268:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.30@tcp 00000100:00100000:2.0:1788838084.674643:0:66268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2406:x1875729116402560:12345-192.168.203.30@tcp:4:dd.0 Request processed in 85us (420us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788838084.674650:0:66268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1788838084.674736:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116402688 00000100:00100000:3.0:1788838084.674742:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116402688 00000100:00100000:3.0:1788838084.674784:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1172 00000100:00100000:3.0:1788838084.674790:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1875729116402688:12345-192.168.203.30@tcp:16:kworker.0 00000020:00080000:3.0:1788838084.674842:0:66254:0:(tgt_handler.c:807:tgt_request_handle()) operation 16 on unconnected OST from 12345-192.168.203.30@tcp 00000100:00100000:3.0:1788838084.674868:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1875729116402688:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 77us (718us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838084.674876:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1172 00000100:00100000:0.0:1788838084.680227:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838084.680535:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116402816 00000100:00100000:3.0:1788838084.680549:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116402816 00000100:00100000:3.0:1788838084.680619:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1173 00000100:00100000:3.0:1788838084.680631:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116402816:12345-192.168.203.30@tcp:38:ptlrpcd_01_00.0 00010000:00020000:3.0:1788838084.680664:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838084.680775:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116402816:12345-192.168.203.30@tcp:38:ptlrpcd_01_00.0 Request processed in 144us (564us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838084.680784:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1173 00000400:00000100:0.0:1788838085.183791:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116402944 offset 0 length 224: 4 00000100:00100000:0.0:1788838085.183889:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838085.183932:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838085.183968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838085.184053:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116403072 00000100:00100000:3.0:1788838085.184067:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116403072 00000100:00100000:1.0:1788838085.184099:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116403200 00000100:00100000:1.0:1788838085.184106:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116403200 00000100:00100000:1.0:1788838085.184174:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116403328 00000100:00100000:1.0:1788838085.184178:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116403328 00000100:00100000:1.0:1788838085.184203:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2512 00000100:00100000:1.0:1788838085.184217:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116403200:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838085.184251:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1182 00000100:00100000:3.0:1788838085.184263:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116403072:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838085.184317:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116403200:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 103us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838085.184325:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116403072:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 64us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838085.184327:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2512 00000100:00100000:3.0:1788838085.184338:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1182 00000100:00100000:1.0:1788838085.184352:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2513 00000100:00100000:1.0:1788838085.184361:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116403328:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838085.184395:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116403328:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838085.184402:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2513 00000100:00080000:0.0:1788838085.184544:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838085.184549:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838085.184552:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788838085.629446:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838086.653092:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788838087.039758:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788838087.039771:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff509c76800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788838087.039968:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c76800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788838087.040036:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff509c75000 for lustre-OST0001 00000001:00100000:1.0:1788838087.042843:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788838087.042858:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff611a89000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788838087.043033:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff611a89000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788838087.043131:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff509c61000 for lustre-OST0000 00000001:00100000:2.0:1788838087.046487:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788838087.046515:0:75678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411436 is committed 00000020:00000080:2.0:1788838087.046524:0:75678:0:(genops.c:885:class_export_put()) final put ffff8ff62ceaa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838087.046673:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceaa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788838087.046768:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff62cead800 for lustre-MDT0001 00010000:00010000:3.0:1788838087.677088:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838088.061370:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838088.061415:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135024512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838088.061521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838088.061881:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135024512 00000100:00100000:3.0:1788838088.061893:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135024512 00000100:00100000:3.0:1788838088.061987:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1788838088.062000:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135024512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838088.062050:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838088.062107:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135024512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838088.062116:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00080000:0.0:1788838088.062226:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838088.063934:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135024512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838088.068590:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135024640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838088.068701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838088.068895:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135024640 00000100:00100000:3.0:1788838088.068906:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135024640 00000100:00100000:3.0:1788838088.069008:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:3.0:1788838088.069021:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135024640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838088.069061:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788838088.069153:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838088.070854:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135024640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1823us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838088.070871:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:1.0:1788838088.075157:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135024640:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788838088.703680:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838089.085361:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838089.085372:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838089.085377:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838089.085390:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3477 00000100:00080000:3.0:1788838089.085425:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1788838089.085434:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1788838089.085435:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838089.085467:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135024768:0@lo:400:kworker.0 00000100:00100000:3.0:1788838089.085472:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd3b80 x1875729135024896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838089.085509:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838089.085513:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838089.085515:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838089.085520:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3477 00000100:00080000:3.0:1788838089.085524:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838089.085529:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838089.085542:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071cc380 x1875729135025152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1788838089.085558:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135024768 offset 0 length 224: 4 00000100:00080000:3.0:1788838089.085579:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838089.085585:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838089.085588:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838089.085593:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3477 00000100:00080000:3.0:1788838089.085596:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838089.085600:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838089.085613:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bc98700 x1875729135025408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838089.085635:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838089.085649:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838089.085651:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838089.085655:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3477 00000100:00080000:3.0:1788838089.085664:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838089.085668:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838089.085686:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd4000 x1875729135025792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838089.085694:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135025024:0@lo:400:kworker.0 00000100:00100000:3.0:1788838089.085739:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135025536:0@lo:400:kworker.0 00000100:00100000:1.0:1788838089.085745:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838089.085777:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838089.085785:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135025664:0@lo:400:kworker.0 00000100:00100000:3.0:1788838089.085790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838089.085847:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838089.085848:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838089.085858:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135025280:0@lo:400:kworker.0 00000100:00100000:3.0:1788838089.085891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838089.085891:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135025024 00000100:00100000:1.0:1788838089.085902:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135025024 00000100:00080000:3.0:1788838089.085937:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838089.085973:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135025280 00000100:00100000:1.0:1788838089.085976:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135025280 00000100:00100000:3.0:1788838089.085996:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00080000:0.0:1788838089.086423:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838089.086447:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135025536 00000100:00100000:0.0:1788838089.086452:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135025536 00000100:00100000:0.0:1788838089.086490:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135025664 00000100:00100000:0.0:1788838089.086493:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135025664 00000100:00100000:0.0:1788838089.086518:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:0.0:1788838089.086528:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135025536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838089.086606:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135025536:12345-0@lo:400:kworker.0 Request processed in 79us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838089.086614:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00100000:0.0:1788838089.086649:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515 00000100:00100000:0.0:1788838089.086656:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135025664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838089.086689:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135025664:12345-0@lo:400:kworker.0 Request processed in 34us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838089.086706:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515 00000100:00100000:0.0:1788838089.086761:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135025536:0@lo:400:kworker.0 00000100:00100000:0.0:1788838089.086817:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135025664:0@lo:400:kworker.0 00000100:00100000:2.0:1788838089.086882:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135024896:0@lo:38:kworker.0 00000100:00100000:2.0:1788838089.086925:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838089.091563:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135025024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838089.091775:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135025024:12345-0@lo:400:kworker.0 Request processed in 243us (6032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838089.092137:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135025152:0@lo:38:kworker.0 00000100:00100000:2.0:1788838089.092207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838089.092256:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135025408:0@lo:38:kworker.0 00000100:00100000:2.0:1788838089.092289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838089.092312:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135025792:0@lo:38:kworker.0 00000100:00100000:2.0:1788838089.092348:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838089.092432:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135024896 00000100:00100000:2.0:1788838089.092443:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135024896 00000100:00100000:1.0:1788838089.094936:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135025152 00000100:00100000:1.0:1788838089.094957:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135025152 00000100:00100000:1.0:1788838089.094994:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135025792 00000100:00100000:1.0:1788838089.095009:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135025792 00000100:00100000:1.0:1788838089.095031:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1788838089.095050:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135025280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838089.095194:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135025280:12345-0@lo:400:kworker.0 Request processed in 153us (9301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838089.095308:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1788838089.095392:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135025152:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838089.095432:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838089.095493:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135025152:12345-0@lo:38:kworker.0 Request processed in 102us (3285us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838089.095501:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1788838089.095528:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1788838089.095532:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135025792:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838089.095541:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838089.095564:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135025792:12345-0@lo:38:kworker.0 Request processed in 31us (3216us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838089.095570:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1788838089.096137:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1788838089.096331:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135025280:0@lo:400:kworker.0 00000100:00100000:1.0:1788838089.096411:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135025408 00000100:00100000:1.0:1788838089.096419:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135025408 00000100:00100000:1.0:1788838089.096454:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4077 00000100:00100000:1.0:1788838089.096461:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135025408:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838089.096479:0:8472:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838089.096528:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135025408:12345-0@lo:38:kworker.0 Request processed in 67us (4237us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838089.096535:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4077 00000100:00100000:1.0:1788838089.096572:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135025024:0@lo:400:kworker.0 00000100:00080000:1.0:1788838089.096786:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838089.096793:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838089.096826:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135025152:0@lo:38:kworker.0 00000100:00080000:1.0:1788838089.096841:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838089.096845:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838089.096850:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135025408:0@lo:38:kworker.0 00000100:00100000:3.0:1788838089.096852:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00080000:1.0:1788838089.096868:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838089.096874:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838089.096878:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135025792:0@lo:38:kworker.0 00000100:00100000:2.0:1788838089.097190:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1788838089.097199:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135024896:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838089.097215:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838089.097290:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135024896:12345-0@lo:38:kworker.0 Request processed in 90us (10364us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838089.097298:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00080000:3.0:1788838089.099025:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838089.099041:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838089.099047:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135024896:0@lo:38:kworker.0 00010000:00010000:3.0:1788838089.726957:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838090.307888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838090.307932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:1.0:1788838090.307957:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116403456 offset 0 length 224: 4 00000100:00100000:1.0:1788838090.307991:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838090.308034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838090.308066:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116403712 00000100:00100000:1.0:1788838090.308075:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116403712 00000100:00100000:0.0:1788838090.308115:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116403968 00000100:00100000:0.0:1788838090.308129:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116403968 00000100:00100000:0.0:1788838090.308202:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116403840 00000100:00100000:0.0:1788838090.308206:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116403840 00000100:00100000:0.0:1788838090.308246:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2516 00000100:00100000:0.0:1788838090.308264:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116403968:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838090.308275:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2517 00000100:00100000:2.0:1788838090.308293:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116403840:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838090.308383:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116403840:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 95us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838090.308402:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2517 00000100:00100000:0.0:1788838090.308440:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2405:x1875729116403968:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 182us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838090.308451:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2516 00000100:00080000:2.0:1788838090.308462:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838090.308472:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838090.308479:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838090.308535:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116403584 00000100:00100000:0.0:1788838090.308542:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116403584 00000100:00100000:0.0:1788838090.308573:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1185 00000100:00100000:0.0:1788838090.308585:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116403712:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838090.308709:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116403712:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 127us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838090.308719:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1185 00000100:00100000:3.0:1788838090.308752:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1177 00000100:00100000:3.0:1788838090.309334:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116403584:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:3.0:1788838090.309362:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838090.309426:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116403584:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 97us (1391us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838090.313122:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1177 00010000:00010000:1.0:1788838090.749232:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838091.773858:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838092.797423:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838093.184009:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838093.184052:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135025920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838093.184188:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838093.184517:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135026048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838093.184560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838093.184666:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135025920 00000100:00100000:3.0:1788838093.184678:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135025920 00000100:00100000:3.0:1788838093.184769:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135026048 00000100:00100000:3.0:1788838093.184773:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135026048 00000100:00100000:3.0:1788838093.184820:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:3.0:1788838093.184832:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135025920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838093.184877:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838093.184942:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135025920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838093.184950:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00100000:3.0:1788838093.184975:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:3.0:1788838093.184982:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135026048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838093.185000:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838093.185033:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135026048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838093.185040:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:3.0:1788838093.185102:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135025920:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788838093.185614:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838093.185621:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838093.185654:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135026048:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788838093.823871:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838094.204989:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838094.204998:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838094.205004:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838094.205015:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3483 00000100:00080000:3.0:1788838094.205023:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788838094.205032:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838094.205078:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd4a80 x1875729135026304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838094.205113:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838094.205118:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838094.205120:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838094.205123:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3483 00000100:00080000:3.0:1788838094.205127:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788838094.205131:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838094.205141:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd7b80 x1875729135026560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838094.205157:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838094.205161:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838094.205162:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838094.205166:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3483 00000100:00080000:3.0:1788838094.205169:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788838094.205172:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838094.205183:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd4700 x1875729135026816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838094.205207:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838094.205211:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838094.205213:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838094.205217:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3483 00000100:00080000:3.0:1788838094.205219:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788838094.205222:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838094.205237:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504d79180 x1875729135027200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838094.205274:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135026944:0@lo:400:kworker.0 00000100:00100000:3.0:1788838094.205381:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838094.205442:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788838094.205449:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135026176:0@lo:400:kworker.0 00000400:00000100:3.0:1788838094.205472:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135026176 offset 0 length 224: 4 00000100:00100000:3.0:1788838094.205496:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135027072:0@lo:400:kworker.0 00000100:00100000:3.0:1788838094.205517:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838094.205545:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135026304:0@lo:38:kworker.0 00000100:00100000:3.0:1788838094.205572:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838094.205587:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135026560:0@lo:38:kworker.0 00000100:00100000:3.0:1788838094.205619:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838094.205637:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135026816:0@lo:38:kworker.0 00000100:00100000:3.0:1788838094.205659:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838094.205676:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135027200:0@lo:38:kworker.0 00000100:00100000:3.0:1788838094.205699:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838094.205732:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135026688:0@lo:400:kworker.0 00000100:00100000:3.0:1788838094.205756:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838094.205775:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838094.205780:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135026432:0@lo:400:kworker.0 00000100:00100000:3.0:1788838094.205824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838094.205863:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135026944 00000100:00100000:3.0:1788838094.205871:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135026944 00000100:00100000:3.0:1788838094.205934:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135027072 00000100:00100000:3.0:1788838094.205937:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135027072 00000100:00100000:3.0:1788838094.205961:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518 00000100:00100000:3.0:1788838094.205971:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135026944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838094.206035:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135026944:12345-0@lo:400:kworker.0 Request processed in 65us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838094.206043:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518 00000100:00100000:3.0:1788838094.206060:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:3.0:1788838094.206066:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135027072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838094.206091:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135027072:12345-0@lo:400:kworker.0 Request processed in 26us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838094.206103:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:3.0:1788838094.206129:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135026304 00000100:00100000:3.0:1788838094.206132:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135026304 00000100:00100000:3.0:1788838094.206151:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135026560 00000100:00100000:3.0:1788838094.206154:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135026560 00000100:00100000:3.0:1788838094.206163:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135027200 00000100:00100000:3.0:1788838094.206166:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135027200 00000100:00100000:3.0:1788838094.206177:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135026688 00000100:00100000:3.0:1788838094.206180:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135026688 00000100:00100000:3.0:1788838094.206217:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135026432 00000100:00100000:3.0:1788838094.206220:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135026432 00000100:00100000:3.0:1788838094.206241:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1788838094.206247:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135026688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838094.206283:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135026688:12345-0@lo:400:kworker.0 Request processed in 36us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838094.206289:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1788838094.206300:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1788838094.206305:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135026432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838094.206335:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135026432:12345-0@lo:400:kworker.0 Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838094.206341:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1788838094.206353:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1788838094.206357:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135026304:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838094.206393:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838094.206428:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135026304:12345-0@lo:38:kworker.0 Request processed in 69us (855us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838094.206434:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1788838094.206444:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1788838094.206448:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135026560:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838094.206457:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838094.206481:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135026560:12345-0@lo:38:kworker.0 Request processed in 30us (861us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838094.206487:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1788838094.206498:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1788838094.206502:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135027200:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838094.206511:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838094.206533:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135027200:12345-0@lo:38:kworker.0 Request processed in 30us (833us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838094.206539:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1788838094.206558:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135026816 00000100:00100000:3.0:1788838094.206562:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135026816 00000100:00100000:3.0:1788838094.206584:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4078 00000100:00100000:3.0:1788838094.206589:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135026816:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838094.206605:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838094.206628:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135026816:12345-0@lo:38:kworker.0 Request processed in 38us (967us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838094.206634:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4078 00000100:00100000:3.0:1788838094.206714:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135026432:0@lo:400:kworker.0 00000100:00100000:3.0:1788838094.206725:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135026688:0@lo:400:kworker.0 00000100:00080000:3.0:1788838094.206758:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838094.206763:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838094.206766:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135026304:0@lo:38:kworker.0 00000100:00080000:3.0:1788838094.206774:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838094.206777:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838094.206780:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135026560:0@lo:38:kworker.0 00000100:00080000:3.0:1788838094.206787:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838094.206791:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838094.206794:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135026816:0@lo:38:kworker.0 00000100:00080000:3.0:1788838094.206828:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838094.206833:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838094.206836:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135027200:0@lo:38:kworker.0 00000100:00100000:3.0:1788838094.206872:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135027072:0@lo:400:kworker.0 00000100:00100000:3.0:1788838094.206882:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135026944:0@lo:400:kworker.0 00000100:00080000:2.0:1788838094.207075:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788838094.848101:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838095.433914:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:2.0:1788838095.433948:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116404096 offset 0 length 224: 4 00000100:00100000:2.0:1788838095.433964:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838095.433984:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838095.434007:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838095.434049:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116404352 00000100:00100000:2.0:1788838095.434059:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116404352 00000100:00100000:2.0:1788838095.434121:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116404224 00000100:00100000:2.0:1788838095.434125:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116404224 00000100:00100000:2.0:1788838095.434146:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1188 00000100:00100000:0.0:1788838095.434287:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1181 00000100:00100000:2.0:1788838095.434289:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116404352:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838095.434302:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116404224:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:0.0:1788838095.434330:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838095.434378:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116404352:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 214us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838095.434391:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1188 00000100:00100000:0.0:1788838095.434393:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116404224:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 89us (422us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838095.434417:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116404480 00000100:00100000:2.0:1788838095.434421:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116404480 00000100:00100000:2.0:1788838095.434447:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116404608 00000100:00100000:2.0:1788838095.434450:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116404608 00000100:00100000:2.0:1788838095.434472:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5937 00000100:00100000:2.0:1788838095.434479:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2403:x1875729116404480:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1788838095.434499:0:26211:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc872f 00000100:00080000:2.0:1788838095.434506:0:26211:0:(import.c:65:import_set_state_nolock()) ffff8ff50a9bd000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788838095.434545:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1181 00000001:00000004:2.0:1788838095.434547:0:26211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:2.0:1788838095.434674:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+2:2403:x1875729116404480:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 194us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838095.434681:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5937 00000100:00100000:2.0:1788838095.434693:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5938 00000100:00100000:2.0:1788838095.434700:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2403:x1875729116404608:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1788838095.434714:0:26211:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8736 00000100:00080000:2.0:1788838095.434719:0:26211:0:(import.c:65:import_set_state_nolock()) ffff8ff609253000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788838095.434963:0:26211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00010000:00010000:0.0:1788838095.435040:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838095.435042:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+2:2403:x1875729116404608:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 341us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838095.435053:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5938 00000100:00080000:2.0:1788838095.435077:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838095.435080:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838095.435091:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788838095.436371:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838095.875082:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838096.894189:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838097.923536:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838098.304606:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838098.304627:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135027328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838098.304695:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838098.304742:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135027328 00000100:00100000:1.0:1788838098.304750:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135027328 00000100:00100000:1.0:1788838098.310006:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:1.0:1788838098.310026:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135027328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838098.310059:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838098.310140:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135027328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (5444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.310148:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00080000:1.0:1788838098.310177:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838098.313610:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838098.313632:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135027456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838098.313696:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838098.313779:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135027456 00000100:00100000:1.0:1788838098.313787:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135027456 00000100:00100000:1.0:1788838098.313884:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:1.0:1788838098.313894:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135027456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838098.313921:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838098.313962:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135027456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838098.313969:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:0.0:1788838098.314919:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135027456:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788838098.314947:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838098.317085:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135027328:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788838098.948320:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838099.331352:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838099.331361:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838099.331365:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838099.331374:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3488 00000100:00080000:3.0:1788838099.331379:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788838099.331386:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838099.331410:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504d79180 x1875729135027712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838099.331437:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838099.331440:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838099.331442:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838099.331446:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3488 00000100:00080000:3.0:1788838099.331449:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788838099.331453:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838099.331463:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd4700 x1875729135027968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838099.331489:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838099.331492:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838099.331494:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838099.331497:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3488 00000100:00080000:3.0:1788838099.331499:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788838099.331503:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838099.331514:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd4a80 x1875729135028224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838099.331555:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838099.331558:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838099.331559:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838099.331562:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3488 00000100:00080000:3.0:1788838099.331565:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788838099.331568:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838099.331583:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640e57100 x1875729135028608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838099.331633:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135027584:0@lo:400:kworker.0 00000400:00000100:3.0:1788838099.331680:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135027584 offset 0 length 224: 4 00000100:00100000:3.0:1788838099.331716:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135028480:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.331747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838099.331774:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838099.331779:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135027840:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.331833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838099.331858:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135027712:0@lo:38:kworker.0 00000100:00100000:3.0:1788838099.331880:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838099.331896:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135027968:0@lo:38:kworker.0 00000100:00100000:3.0:1788838099.331915:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838099.331928:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135028224:0@lo:38:kworker.0 00000100:00100000:3.0:1788838099.331949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838099.331963:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135028608:0@lo:38:kworker.0 00000100:00100000:3.0:1788838099.331981:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000400:3.0:1788838099.332018:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838083/real 1788838083] req@ffff8ff5071cf480 x1875729135022848/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838099 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838099.332036:0:3644:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8ff5071cf480 x1875729135022848/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838099.332220:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788838099.332225:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788838099.332228:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788838099.332231:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788838099.332235:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff5071cf480 x1875729135022848/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838099.332245:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff62bcd3100 x1875729135024768/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838105 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838099.332254:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff609dd4380 x1875729135026176/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838110 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838099.332267:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff504d7a300 x1875729135027584/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838115 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788838099.332275:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788838099.332278:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788838099.332279:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788838099.332281:0:3644:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1788838099.332295:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135028352:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.332320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838099.332354:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135024768:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.332360:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135022848:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.332378:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838099.332384:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135028096:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.332417:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838099.332449:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135028480 00000100:00100000:3.0:1788838099.332455:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135028480 00000100:00100000:3.0:1788838099.332496:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135028352 00000100:00100000:3.0:1788838099.332499:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135028352 00000100:00100000:3.0:1788838099.332519:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:3.0:1788838099.332527:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135028480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.332572:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135028480:12345-0@lo:400:kworker.0 Request processed in 46us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838099.332580:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:3.0:1788838099.332598:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521 00000100:00100000:3.0:1788838099.332604:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135028352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.332637:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135028352:12345-0@lo:400:kworker.0 Request processed in 34us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838099.332643:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521 00000100:00100000:3.0:1788838099.332660:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135027840 00000100:00100000:3.0:1788838099.332663:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135027840 00000100:00100000:3.0:1788838099.332693:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135027712 00000100:00100000:3.0:1788838099.332696:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135027712 00000100:00100000:3.0:1788838099.332703:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135027968 00000100:00100000:3.0:1788838099.332705:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135027968 00000100:00100000:3.0:1788838099.332711:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135028608 00000100:00100000:3.0:1788838099.332713:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135028608 00000100:00100000:3.0:1788838099.332719:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135028096 00000100:00100000:3.0:1788838099.332721:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135028096 00000100:00100000:3.0:1788838099.332733:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1788838099.332739:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135027840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.332768:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135027840:12345-0@lo:400:kworker.0 Request processed in 29us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838099.332783:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1788838099.332829:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1788838099.332836:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135028096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.332864:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135028096:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838099.332870:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1788838099.332882:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1788838099.332886:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135027712:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838099.332903:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838099.332929:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135027712:12345-0@lo:38:kworker.0 Request processed in 41us (1048us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838099.332935:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1788838099.332945:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1788838099.332949:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135027968:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838099.332958:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838099.332977:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135027968:12345-0@lo:38:kworker.0 Request processed in 26us (1062us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838099.332982:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1788838099.332992:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1788838099.332996:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135028608:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838099.333004:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838099.333023:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135028608:12345-0@lo:38:kworker.0 Request processed in 26us (1042us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838099.333028:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00080000:0.0:1788838099.333787:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838099.334389:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135028224 00000100:00100000:3.0:1788838099.334401:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135028224 00000100:00100000:3.0:1788838099.334458:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4079 00000100:00100000:3.0:1788838099.334466:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135028224:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838099.334485:0:37907:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838099.334548:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135028224:12345-0@lo:38:kworker.0 Request processed in 81us (2596us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838099.334555:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4079 00000100:00080000:3.0:1788838099.334618:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838099.334624:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838099.334627:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135027712:0@lo:38:kworker.0 00000100:00080000:3.0:1788838099.334637:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838099.334641:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838099.334643:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135027968:0@lo:38:kworker.0 00000100:00080000:3.0:1788838099.334652:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838099.334654:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838099.334657:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135028224:0@lo:38:kworker.0 00000100:00080000:3.0:1788838099.334666:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838099.334669:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838099.334671:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135028608:0@lo:38:kworker.0 00000100:00100000:3.0:1788838099.334712:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135027840:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.334720:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135027584:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.334731:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135028480:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.334751:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135026176:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.334786:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135028096:0@lo:400:kworker.0 00000100:00100000:3.0:1788838099.335940:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135028352:0@lo:400:kworker.0 00000100:00080000:3.0:1788838099.335983:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838099.335988:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788838099.335990:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838099.335995:0:63434:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3436 00000100:00080000:3.0:1788838099.336002:0:63434:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838099.336030:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63956ad80 x1875729135028736/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838099.336958:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135028736:0@lo:250:kworker.0 00000400:00000100:3.0:1788838099.337012:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135028736 offset 0 length 520: 4 00010000:00010000:1.0:1788838099.972562:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838100.547217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:0.0:1788838100.547253:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116404736 offset 0 length 224: 4 00000100:00100000:0.0:1788838100.547303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838100.549176:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116404864 00000100:00100000:3.0:1788838100.549194:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116404864 00000100:00100000:3.0:1788838100.549245:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116404992 00000100:00100000:3.0:1788838100.549249:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116404992 00000100:00100000:3.0:1788838100.549362:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1191 00000100:00100000:3.0:1788838100.549373:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116404992:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838100.549458:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116404992:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 88us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838100.549466:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1191 00000100:00100000:3.0:1788838100.549483:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1185 00000100:00100000:3.0:1788838100.549488:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116404864:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:3.0:1788838100.549523:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838100.549550:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116404864:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 60us (2347us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838100.549557:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1185 00000100:00080000:0.0:1788838100.550054:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838100.611124:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:2.0:1788838100.611163:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116405120 offset 0 length 520: 4 00000100:00100000:0.0:1788838100.611414:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116405248 00000100:00100000:0.0:1788838100.611423:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116405248 00000100:00100000:0.0:1788838100.611486:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1192 00000100:00100000:0.0:1788838100.611495:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116405248:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838100.611584:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116405248:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 89us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838100.611591:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1192 00000001:00100000:3.0:1788838100.875065:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:3.0:1788838100.875074:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff609257000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:1.0:1788838100.875130:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff609257000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-OST0001 00000020:00000080:1.0:1788838100.875187:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff609253000 for lustre-OST0001 00000001:00100000:2.0:1788838100.876202:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:2.0:1788838100.876208:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff50a9bb000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:3.0:1788838100.876258:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50a9bb000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-OST0000 00000020:00000080:3.0:1788838100.876299:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50a9bd000 for lustre-OST0000 00010000:00010000:1.0:1788838100.999547:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838102.012935:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838103.039299:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838103.424333:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135028864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838103.424411:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838103.424855:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135028864 00000100:00100000:1.0:1788838103.424865:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135028864 00000100:00100000:1.0:1788838103.424925:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:1.0:1788838103.424934:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135028864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838103.424964:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838103.425014:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135028864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838103.425033:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00080000:1.0:1788838103.425053:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838103.425091:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135028864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838103.432920:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135028992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838103.432997:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838103.433313:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135028992 00000100:00100000:0.0:1788838103.433321:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135028992 00000100:00100000:0.0:1788838103.433380:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:0.0:1788838103.433390:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135028992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838103.433423:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838103.433465:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135028992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838103.433472:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00080000:0.0:1788838103.433493:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838103.433526:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135028992:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788838104.060985:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788838104.458202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838104.458210:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838104.458213:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838104.458216:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838104.458221:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838104.458229:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3493 00000100:00080000:1.0:1788838104.458233:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838104.458240:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838104.458276:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5048d3100 x1875729135029120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838104.458324:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838104.458327:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838104.458328:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838104.458338:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3493 00000100:00080000:1.0:1788838104.458341:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838104.458344:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838104.458357:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63333f100 x1875729135029376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838104.458384:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838104.458387:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838104.458389:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838104.458393:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3493 00000100:00080000:1.0:1788838104.458395:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838104.458398:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838104.458408:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639540000 x1875729135029632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838104.458429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838104.458432:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838104.458434:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838104.458437:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3493 00000100:00080000:1.0:1788838104.458439:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838104.458442:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838104.458453:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639540380 x1875729135030016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838104.458493:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135029760:0@lo:400:kworker.0 00000100:00100000:1.0:1788838104.458557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838104.458596:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838104.458609:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135029504:0@lo:400:kworker.0 00000100:00100000:1.0:1788838104.458638:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838104.458674:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135029504 00000100:00100000:1.0:1788838104.458683:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135029504 00000100:00100000:1.0:1788838104.458736:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1788838104.458746:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135029504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838104.458837:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135029504:12345-0@lo:400:kworker.0 Request processed in 83us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838104.458845:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1788838104.458884:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135029504:0@lo:400:kworker.0 00000100:00100000:0.0:1788838104.460004:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff633275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135029248:0@lo:400:kworker.0 00000100:00100000:0.0:1788838104.460078:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838104.460115:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838104.460121:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135029888:0@lo:400:kworker.0 00000100:00100000:0.0:1788838104.460147:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838104.460343:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135029760 00000100:00100000:0.0:1788838104.460350:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135029760 00000100:00100000:0.0:1788838104.460395:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135029888 00000100:00100000:0.0:1788838104.460398:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135029888 00000100:00100000:0.0:1788838104.460419:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:0.0:1788838104.460426:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135029760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838104.461280:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135029760:12345-0@lo:400:kworker.0 Request processed in 851us (2719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838104.461289:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:0.0:1788838104.461326:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:0.0:1788838104.461336:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135029888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838104.461392:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135029888:12345-0@lo:400:kworker.0 Request processed in 59us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838104.461397:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00080000:0.0:1788838104.461418:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838104.461464:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135029888:0@lo:400:kworker.0 00000100:00100000:0.0:1788838104.462591:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135029760:0@lo:400:kworker.0 00000100:00100000:1.0:1788838104.462724:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135029248 00000100:00100000:1.0:1788838104.462731:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135029248 00000100:00100000:1.0:1788838104.462816:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1788838104.462825:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135029248:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788838104.462965:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838104.462981:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135029120:0@lo:38:kworker.0 00000100:00100000:0.0:1788838104.463042:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838104.465743:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135029120 00000100:00100000:2.0:1788838104.465760:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135029120 00000100:00100000:2.0:1788838104.465838:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1788838104.465846:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135029120:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838104.465868:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838104.466965:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135029248:12345-0@lo:400:kworker.0 Request processed in 4135us (6879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838104.466978:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1788838104.467919:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff633275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135029248:0@lo:400:kworker.0 00000100:00100000:0.0:1788838104.468024:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135029376:0@lo:38:kworker.0 00000100:00100000:0.0:1788838104.468162:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838104.468287:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135029632:0@lo:38:kworker.0 00000100:00100000:0.0:1788838104.468327:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838104.468346:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135030016:0@lo:38:kworker.0 00000100:00100000:0.0:1788838104.468367:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838104.468441:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135029120:12345-0@lo:38:kworker.0 Request processed in 2593us (5397us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838104.468451:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00080000:0.0:1788838104.468650:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838104.468657:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838104.468660:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135029120:0@lo:38:kworker.0 00000100:00100000:0.0:1788838104.468688:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135029632 00000100:00100000:0.0:1788838104.468695:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135029632 00000100:00100000:0.0:1788838104.468734:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080 00000100:00100000:0.0:1788838104.468741:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135029632:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838104.468761:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838104.469286:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135029632:12345-0@lo:38:kworker.0 Request processed in 543us (956us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838104.469305:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080 00000100:00100000:2.0:1788838104.469384:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135029376 00000100:00100000:2.0:1788838104.469390:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135029376 00000100:00100000:2.0:1788838104.469416:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135030016 00000100:00100000:2.0:1788838104.469419:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135030016 00000100:00100000:2.0:1788838104.469434:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1788838104.469439:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135029376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838104.469453:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838104.469502:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135029376:12345-0@lo:38:kworker.0 Request processed in 62us (1341us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838104.469509:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1788838104.469520:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1788838104.469532:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135030016:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838104.469542:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838104.469568:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135030016:12345-0@lo:38:kworker.0 Request processed in 35us (1200us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838104.469574:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00080000:1.0:1788838104.476314:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838104.476336:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838104.476341:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135029376:0@lo:38:kworker.0 00000100:00080000:1.0:1788838104.476355:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838104.476359:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838104.476362:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135029632:0@lo:38:kworker.0 00000100:00080000:1.0:1788838104.476371:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838104.476384:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838104.476387:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135030016:0@lo:38:kworker.0 00000100:00100000:0.0:1788838104.644093:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838104.644217:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838104.644938:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116405376 00000100:00100000:3.0:1788838104.644949:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116405376 00000100:00100000:3.0:1788838104.645034:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1189 00000100:00100000:3.0:1788838104.645053:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116405376:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:3.0:1788838104.645076:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838104.645136:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116405376:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 82us (917us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838104.645144:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1189 00000100:00100000:1.0:1788838104.645192:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116405504 00000100:00100000:1.0:1788838104.645197:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116405504 00000100:00100000:0.0:1788838104.645260:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1195 00000100:00100000:0.0:1788838104.645270:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116405504:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838104.645320:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116405504:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 53us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838104.645327:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1195 00000100:00080000:0.0:1788838104.646883:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788838105.088057:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838105.662457:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838105.662564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838105.662705:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116405760 00000100:00100000:3.0:1788838105.662715:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116405760 00000100:00100000:3.0:1788838105.662779:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116405632 00000100:00100000:3.0:1788838105.662783:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116405632 00000100:00100000:3.0:1788838105.662827:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1196 00000100:00100000:3.0:1788838105.662838:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116405760:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838105.662911:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116405760:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838105.662929:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1196 00000100:00100000:3.0:1788838105.662948:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1190 00000100:00100000:3.0:1788838105.662953:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116405632:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:3.0:1788838105.662976:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838105.663002:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116405632:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 48us (438us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838105.663009:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1190 00010000:00010000:0.0:1788838106.110138:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788838106.863751:0:89040:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788838106.863763:0:89040:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788838106.863765:0:89040:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788838106.864482:0:89040:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ff627d1b000 00000020:01000004:2.0:1788838106.864501:0:89040:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788838106.864516:0:89040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788838106.864531:0:89040:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ff610240000) 00000020:00000080:2.0:1788838106.864549:0:89040:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788838107.092512:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788838107.102994:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788838107.106727:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788838107.111117:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788838107.111949:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788838107.114299:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788838107.115007:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788838107.115416:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788838107.115700:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788838107.118674:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788838107.120321:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788838107.120833:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788838107.121492:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788838107.121841:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788838107.128409:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788838107.129586:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.130069:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.130410:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.130659:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.131185:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.131451:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.131767:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.132435:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.132740:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00010000:00010000:2.0:1788838107.133165:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788838107.133419:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.133884:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.134361:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.134627:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.135054:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.135394:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.135649:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.136250:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.136504:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.136817:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.137247:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.137726:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.138327:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.138699:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.139538:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.144388:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.145038:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.145397:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.145606:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.146157:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.146370:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788838107.146716:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.148377:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788838107.150535:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788838107.151707:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788838107.152192:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788838107.153090:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788838107.153591:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788838107.153980:0:89040:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788838107.154603:0:89040:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788838107.155474:0:89040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788838107.155486:0:89040:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788838107.155498:0:89040:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc888d 00000020:01000004:2.0:1788838107.155505:0:89040:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788838107.155518:0:89040:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788838107.155524:0:89040:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff627d1b000 from MGS 00000020:01000004:2.0:1788838107.155528:0:89040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788838107.155539:0:89040:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ff6102419b8) 00000020:00000080:2.0:1788838107.155553:0:89040:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1788838107.155630:0:89040:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff627d1b000 from MGS, refs=2 00080000:01000000:2.0:1788838107.155635:0:89040:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788838107.155640:0:89040:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc889b 00010000:00010000:2.0:1788838107.155855:0:89040:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788838107.162015:0:89040:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788838107.166094:0:89044:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788838107.166136:0:89040:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788838107.166199:0:89040:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788838107.172209:0:89040:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788838107.172504:0:89040:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788838107.173437:0:89040:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788838107.173447:0:89040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788838107.176257:0:89040:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788838107.176268:0:89040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788838107.176592:0:89040:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788838107.176598:0:89040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788838107.177259:0:89040:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788838107.177293:0:89040:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788838107.177294:0:89040:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788838107.177298:0:89040:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788838107.177303:0:89040:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 59, was 0): CONNECTING 00000100:00100000:0.0:1788838107.177310:0:89040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00010000:00010000:3.0:1788838108.157180:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838108.543355:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135030144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838108.543503:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838108.543518:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135030272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838108.543564:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838108.544245:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838108.545955:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135030272 00000100:00100000:1.0:1788838108.545973:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135030272 00000100:00100000:1.0:1788838108.546097:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135030144 00000100:00100000:1.0:1788838108.546101:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135030144 00000100:00100000:1.0:1788838108.546135:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1788838108.546146:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135030272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838108.546202:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838108.546310:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135030272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838108.546337:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1788838108.546361:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:1.0:1788838108.546368:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135030144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838108.546387:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838108.546431:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135030144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838108.546436:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:1.0:1788838108.546502:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135030144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838108.546694:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135030272:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788838108.551362:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838108.551377:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788838109.181131:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00020000:3.0:1788838109.181241:0:89040:0:(import.c:339:ptlrpc_invalidate_import()) MGS: timeout waiting for callback (1 != 0) 00000100:00020000:3.0:1788838109.200531:0:89040:0:(import.c:363:ptlrpc_invalidate_import()) @@@ still on sending list req@ffff8ff63956ad80 x1875729135028736/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788838109 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00020000:3.0:1788838109.235952:0:89040:0:(import.c:373:ptlrpc_invalidate_import()) MGS: Unregistering RPCs found (0). Network is sluggish? Waiting for them to error out. 00000100:00100000:3.0:1788838109.255493:0:89040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788838109.570129:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838109.570139:0:63434:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838109.570142:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838109.570145:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838109.570150:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838109.570159:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3498 00000100:00080000:1.0:1788838109.570163:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838109.570170:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838109.570213:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639540000 x1875729135030400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838109.570288:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838109.570292:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838109.570294:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838109.570297:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3498 00000100:00080000:1.0:1788838109.570325:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838109.570330:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838109.570353:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639540700 x1875729135030656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838109.570385:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838109.570389:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838109.570391:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838109.570394:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3498 00000100:00080000:1.0:1788838109.570396:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838109.570400:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838109.570412:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639542680 x1875729135030912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838109.570434:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838109.570437:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838109.570438:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838109.570441:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3498 00000100:00080000:1.0:1788838109.570443:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838109.570446:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838109.570456:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639541500 x1875729135031296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838109.570491:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135031040:0@lo:400:kworker.0 00000100:00100000:1.0:1788838109.570561:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838109.570607:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838109.570613:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135030784:0@lo:400:kworker.0 00000100:00100000:1.0:1788838109.570751:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838109.570789:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135031040 00000100:00100000:1.0:1788838109.570825:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135031040 00000100:00100000:1.0:1788838109.570872:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:1.0:1788838109.570881:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135031040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838109.570936:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135031040:12345-0@lo:400:kworker.0 Request processed in 56us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.570943:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:1.0:1788838109.570986:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135031040:0@lo:400:kworker.0 00000100:00100000:2.0:1788838109.571088:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135031168:0@lo:400:kworker.0 00000100:00100000:2.0:1788838109.571121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838109.571155:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838109.571161:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135030528:0@lo:400:kworker.0 00000100:00100000:2.0:1788838109.571184:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.571540:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135030784 00000100:00100000:3.0:1788838109.571547:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135030784 00000100:00100000:1.0:1788838109.571572:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135031168 00000100:00100000:1.0:1788838109.571582:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135031168 00000100:00100000:1.0:1788838109.571616:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:1.0:1788838109.571624:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135031168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838109.571658:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135030528 00000100:00100000:3.0:1788838109.571664:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135030528 00000100:00100000:1.0:1788838109.571742:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135031168:12345-0@lo:400:kworker.0 Request processed in 52us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.571751:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:1.0:1788838109.571776:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1788838109.571783:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135030784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838109.572191:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135030784:12345-0@lo:400:kworker.0 Request processed in 408us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.572199:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1788838109.572257:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135030784:0@lo:400:kworker.0 00000100:00100000:1.0:1788838109.572331:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135031168:0@lo:400:kworker.0 00000100:00100000:0.0:1788838109.572496:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838099/real 1788838099] req@ffff8ff63956ad80 x1875729135028736/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838109 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838109.572516:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ff63956ad80 x1875729135028736/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838109 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838109.572532:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135030400:0@lo:38:kworker.0 00000100:00100000:0.0:1788838109.572566:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838109.572657:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135030656:0@lo:38:kworker.0 00000100:00100000:0.0:1788838109.572680:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838109.572760:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135030400 00000100:00100000:1.0:1788838109.572766:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135030400 00000100:00100000:1.0:1788838109.572795:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135030656 00000100:00100000:1.0:1788838109.572814:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135030656 00000100:00100000:1.0:1788838109.572831:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788838109.572836:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135030400:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838109.572857:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838109.572891:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135030400:12345-0@lo:38:kworker.0 Request processed in 53us (324us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838109.572897:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788838109.572909:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1788838109.572914:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135030656:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838109.572923:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838109.572942:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135030656:12345-0@lo:38:kworker.0 Request processed in 27us (261us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838109.572947:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:1.0:1788838109.572982:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838109.572988:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838109.572991:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135030656:0@lo:38:kworker.0 00000100:00100000:1.0:1788838109.572997:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135030912:0@lo:38:kworker.0 00000100:00100000:1.0:1788838109.573023:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838109.573045:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135030912 00000100:00100000:1.0:1788838109.573048:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135030912 00000100:00100000:1.0:1788838109.573068:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4081 00000100:00100000:1.0:1788838109.573073:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135030912:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838109.573082:0:37907:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838109.573105:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135030912:12345-0@lo:38:kworker.0 Request processed in 31us (81us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838109.573118:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4081 00000100:00080000:1.0:1788838109.573138:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838109.573142:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838109.573145:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135030912:0@lo:38:kworker.0 00000100:00100000:1.0:1788838109.573151:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135031296:0@lo:38:kworker.0 00000100:00100000:1.0:1788838109.573172:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838109.573190:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135031296 00000100:00100000:1.0:1788838109.573193:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135031296 00000100:00100000:1.0:1788838109.573211:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1788838109.573215:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135031296:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838109.573224:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838109.573247:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135031296:12345-0@lo:38:kworker.0 Request processed in 32us (75us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838109.573253:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00080000:1.0:1788838109.573288:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838109.573292:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838109.573294:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135031296:0@lo:38:kworker.0 00000100:00080000:1.0:1788838109.573299:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838109.573311:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788838109.573320:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135028736:0@lo:250:kworker.0 00000100:00080000:0.0:1788838109.573505:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838109.573511:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788838109.573513:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838109.573518:0:63434:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3493 00000100:00080000:0.0:1788838109.573523:0:63434:0:(import.c:589:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838109.573528:0:63434:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838109.573557:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61d27fb80 x1875729135031424/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1788838109.573609:0:89040:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788838109.573626:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc84e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc84ea expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.573638:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc84e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc84ea expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.573644:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788838109.573657:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.573668:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc84e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc84ea expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.573703:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc8449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8450 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.573710:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc8449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8450 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.573714:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838109.573729:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.573734:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc8449 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8450 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.573745:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607461400/0x88da08396ccc8465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc846c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.573751:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607461400/0x88da08396ccc8465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc846c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.573756:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838109.573771:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.573775:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607461400/0x88da08396ccc8465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc846c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.573784:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607460a00/0x88da08396ccc848f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8496 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.573790:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607460a00/0x88da08396ccc848f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8496 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.573826:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838109.573840:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.573844:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607460a00/0x88da08396ccc848f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8496 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.573853:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ee00/0x88da08396ccc849d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc84a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.573860:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ee00/0x88da08396ccc849d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc84a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.573876:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838109.573891:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.573896:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ee00/0x88da08396ccc849d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc84a4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.573910:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff600030400/0x88da08396ccc84b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc84c0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.573917:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff600030400/0x88da08396ccc84b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc84c0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.573922:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838109.573935:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.573939:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff600030400/0x88da08396ccc84b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc84c0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.573948:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607461600/0x88da08396ccc84c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc84ce expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.573954:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607461600/0x88da08396ccc84c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc84ce expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.573958:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838109.573972:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.573975:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607461600/0x88da08396ccc84c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc84ce expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.573984:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc84f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc84f8 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.574000:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc84f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc84f8 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.574005:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838109.574019:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.574023:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc84f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc84f8 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.574044:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ec00/0x88da08396ccc8457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc845e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.574051:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ec00/0x88da08396ccc8457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc845e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.574056:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838109.574062:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.574065:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ec00/0x88da08396ccc8457 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc845e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.574080:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607461200/0x88da08396ccc8473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc847a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.574087:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607461200/0x88da08396ccc8473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc847a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.574092:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838109.574097:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.574100:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607461200/0x88da08396ccc8473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc847a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.574125:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc8481 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8488 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.574132:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc8481 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8488 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.574137:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838109.574143:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.574146:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e000/0x88da08396ccc8481 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8488 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.574154:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff607460000/0x88da08396ccc84ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc84b2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.574160:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff607460000/0x88da08396ccc84ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc84b2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.574165:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838109.574174:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.574177:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff607460000/0x88da08396ccc84ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc84b2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.574184:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc84d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc84dc expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.574190:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc84d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc84dc expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.574196:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838109.574212:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.574216:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc84d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc84dc expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788838109.574237:0:89040:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 60, was 0): CONNECTING 00000100:00080000:0.0:1788838109.574241:0:89040:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788838109.574743:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135031424:0@lo:250:kworker.0 00000100:00100000:1.0:1788838109.574837:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788838109.574902:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838109.574908:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838109.574921:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135030400:0@lo:38:kworker.0 00000100:00100000:0.0:1788838109.575036:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135031424 00000100:00100000:0.0:1788838109.575043:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135031424 00000100:00100000:0.0:1788838109.575121:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788838109.575128:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1875729135031424:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1788838109.575156:0:89046:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo t0 exp 0000000000000000 cur 3503 last 0 00000020:00000080:0.0:1788838109.575186:0:89046:0:(genops.c:1385:class_connect()) connect: client 57943c9a-ca27-46d8-8845-5d2bce640e45, cookie 0x88da08396ccc88a2 00000100:00080000:0.0:1788838109.575334:0:89046:0:(import.c:65:import_set_state_nolock()) ffff8ff639653000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838109.575395:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:3642:x1875729135031424:12345-0@lo:250:kworker.0 Request processed in 265us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.575403:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788838109.575478:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 10000000:01000000:1.0:1788838109.575487:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:1.0:1788838109.575492:0:3642:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x88da08396ccc88a2 00000100:00080000:2.0:1788838109.579152:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838109.580968:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1788838109.580983:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135030528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838109.581088:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135030528:12345-0@lo:400:kworker.0 Request processed in 109us (9903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838109.581096:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1788838109.581139:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135030528:0@lo:400:kworker.0 00000100:00080000:1.0:1788838109.593994:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:1.0:1788838109.594015:0:3642:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:3.0:1788838109.599294:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135031424:0@lo:250:kworker.0 00000100:00080000:0.0:1788838109.599451:0:89040:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:0.0:1788838109.599468:0:89040:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788838109.599512:0:89040:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788838109.599518:0:89040:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788838109.599629:0:89040:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788838109.599663:0:89040:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788838109.599667:0:89040:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788838109.599669:0:89040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788838109.599670:0:89040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838109.599671:0:89040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838109.599673:0:89040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838109.599674:0:89040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838109.599676:0:89040:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838109.599677:0:89040:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788838109.599679:0:89040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838109.599685:0:89040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788838109.599688:0:89040:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788838109.599690:0:89040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788838109.599691:0:89040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788838109.599692:0:89040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838109.599693:0:89040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838109.599694:0:89040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838109.599695:0:89040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838109.599696:0:89040:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838109.599697:0:89040:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788838109.599697:0:89040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838109.599698:0:89040:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788838109.599731:0:89040:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788838109.599748:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505aec300 going to sleep for 0 seconds 00000100:00100000:0.0:1788838109.599756:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135031552:0@lo:253:mount.lustre.0 00000020:00080000:0.0:1788838109.599769:0:89040:0:(tgt_mount.c:1454:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:0.0:1788838109.599780:0:89040:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff627d1b000 from lustre-MDT0000 10000000:01000000:0.0:1788838109.599855:0:89040:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788838109.599858:0:89040:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788838109.599868:0:89040:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ff627d1b000 10000000:01000000:0.0:1788838109.599872:0:89040:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788838109.599876:0:89040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ff627d1b000 10000000:01000000:0.0:1788838109.599878:0:89040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788838109.599882:0:89040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff627d1b000 from 1 10000000:01000000:0.0:1788838109.599885:0:89040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788838109.599919:0:89040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.599930:0:89040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.599940:0:89040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838109.599961:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505aecb40 going to sleep for 0 seconds 00000100:00100000:0.0:1788838109.599965:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135031680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838109.599980:0:89040:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.599988:0:89040:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.599994:0:89040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.600001:0:89040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.600008:0:89040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.600015:0:89040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f200 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788838109.600018:0:89040:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.600026:0:89040:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838109.600032:0:89040:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.600037:0:89040:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838109.600040:0:89040:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838109.600051:0:89040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.600058:0:89040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50718f200/0x88da08396ccc88a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838109.600074:0:89040:0:(mgc_request.c:1817:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:0.0:1788838109.600076:0:89040:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:0.0:1788838109.600109:0:89050:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.203.130@tcp to MGS@0@lo 00000100:00100000:0.0:1788838109.600113:0:89050:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788838109.600116:0:89050:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:0.0:1788838109.600138:0:89050:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1788838109.600143:0:89050:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from RECOVER to FULL 10000000:01000000:0.0:1788838109.600145:0:89050:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788838109.600169:0:89050:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:0.0:1788838109.600172:0:89050:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) MGC192.168.203.130@tcp: Connection restored to 0@lo (at 0@lo) 10000000:01000000:3.0:1788838109.600760:0:89040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff627d1b000 from 1 10000000:01000000:3.0:1788838109.600771:0:89040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788838109.600861:0:89040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.600874:0:89040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.600886:0:89040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838109.600915:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135031808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838109.601320:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.601383:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff508ba43c0 going to sleep for 11 seconds 00000020:01000000:1.0:1788838109.601577:0:63434:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.130@tcp 10000000:01000000:1.0:1788838109.601604:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788838109.601608:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788838109.601610:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838109.601612:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838109.601614:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838109.601616:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838109.601617:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838109.601619:0:63434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838109.601621:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838109.601623:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788838109.601665:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788838109.601674:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788838109.601676:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788838109.601677:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788838109.601678:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838109.601679:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838109.601680:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838109.601682:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838109.601683:0:63434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838109.601684:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838109.601685:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788838109.601699:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788838109.601704:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1788838109.601706:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788838109.601707:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788838109.601708:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838109.601709:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838109.601710:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838109.601711:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838109.601720:0:63434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788838109.601721:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838109.601722:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788838109.601910:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1788838109.601948:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135032064:0@lo:253:kworker.0 00000100:00100000:1.0:1788838109.602079:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838109.602125:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838109.602132:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135032192:0@lo:253:kworker.0 00000100:00100000:1.0:1788838109.602165:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838109.602604:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135032320:0@lo:253:kworker.0 00000100:00100000:2.0:1788838109.602662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.602714:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135031936:0@lo:400:kworker.0 00000100:00100000:3.0:1788838109.602759:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838109.627231:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135031808 00000100:00100000:0.0:1788838109.627250:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135031808 00000100:00100000:0.0:1788838109.627357:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135032064 00000100:00100000:0.0:1788838109.627362:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135032064 00000100:00100000:0.0:1788838109.627375:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135032192 00000100:00100000:0.0:1788838109.627378:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135032192 00000100:00100000:0.0:1788838109.627386:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135032320 00000100:00100000:0.0:1788838109.627389:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135032320 00000100:00100000:0.0:1788838109.627396:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135031936 00000100:00100000:0.0:1788838109.627399:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135031936 00000100:00100000:0.0:1788838109.627416:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788838109.627427:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:89040:x1875729135031808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838109.627446:0:89048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838109.627475:0:89048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50718ea00/0x88da08396ccc88b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc88b0 expref: -99 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.627528:0:89048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50718ea00/0x88da08396ccc88b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc88b0 expref: 10 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.627538:0:89048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50718ea00/0x88da08396ccc88b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc88b0 expref: 10 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.627546:0:89048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718ea00, rc 0) 00000100:00100000:0.0:1788838109.627621:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89040:x1875729135031808:12345-0@lo:101:mount.lustre.0 Request processed in 197us (26303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.627626:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788838109.627656:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788838109.627663:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:3643:x1875729135032064:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788838109.627689:0:89048:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:0.0:1788838109.627857:0:89051:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788838109.627970:0:89048:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 113 00000100:00100000:3.0:1788838109.628318:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135031808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838109.628345:0:89040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.628365:0:89040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838109.628384:0:89040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788838109.628401:0:89040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.628409:0:89040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838109.628418:0:89040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788838109.628422:0:89040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788838109.628427:0:89040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ff627d1b000 10000000:01000000:3.0:1788838109.628430:0:89040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788838109.628433:0:89040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788838109.628436:0:89040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788838109.628465:0:89040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.628472:0:89040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.628482:0:89040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838109.628502:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135032448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838109.628555:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.628588:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff508ba43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838109.636786:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135032448 00000100:00100000:1.0:1788838109.636830:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135032448 00000100:00100000:0.0:1788838109.637004:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788838109.637021:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:3643:x1875729135032192:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788838109.637081:0:89046:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788838109.637613:0:89052:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788838109.637619:0:89052:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788838109.637623:0:89052:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788838109.637625:0:89052:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788838109.642373:0:89052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788838109.649985:0:89048:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788838109.650012:0:89048:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788838109.658143:0:89046:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788838109.658275:0:89048:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788838109.658324:0:89048:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788838109.658402:0:89051:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788838109.658407:0:89051:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788838109.658429:0:89051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.658446:0:89051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788838109.658477:0:89051:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000070466s 00010000:00010000:0.0:1788838109.658482:0:89051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.658490:0:89051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.658498:0:89051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.658506:0:89051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.658513:0:89051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838109.658517:0:89051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.658527:0:89051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.658541:0:89051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.658549:0:89051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.658556:0:89051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50718e600/0x88da08396ccc88c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838109.662516:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:3643:x1875729135032064:12345-0@lo:253:kworker.0 Request processed in 34841us (60425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.662531:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788838109.662577:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788838109.662589:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:3645:x1875729135032320:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788838109.662620:0:89048:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:3.0:1788838109.662694:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788838109.662698:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788838109.662699:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838109.662700:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838109.662701:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838109.662703:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838109.662704:0:3643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788838109.662706:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838109.662707:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788838109.662711:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135032064:0@lo:253:kworker.0 20000000:01000000:0.0:1788838109.662835:0:89046:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788838109.662859:0:89046:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788838109.662991:0:89051:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788838109.662996:0:89051:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788838109.663019:0:89051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.663044:0:89051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788838109.663054:0:89051:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000070466s 00010000:00010000:2.0:1788838109.663059:0:89051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.663067:0:89051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.663074:0:89051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.663093:0:89051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.663099:0:89051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5e200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838109.663104:0:89051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.663112:0:89051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.663124:0:89051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.663131:0:89051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.663138:0:89051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc88cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788838109.663477:0:89048:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788838109.664315:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:3643:x1875729135032192:12345-0@lo:253:kworker.0 Request processed in 27295us (62145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.664327:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788838109.664365:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838109.664376:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3646:x1875729135031936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838109.664428:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3646:x1875729135031936:12345-0@lo:400:kworker.0 Request processed in 55us (61668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.664435:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788838109.664452:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788838109.664459:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:89040:x1875729135032448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838109.664469:0:89046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838109.664488:0:89046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50718f200/0x88da08396ccc88d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc88be expref: -99 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.664509:0:89046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50718f200/0x88da08396ccc88d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc88be expref: 8 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.664521:0:89046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50718f200/0x88da08396ccc88d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc88be expref: 8 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.664530:0:89046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718f200, rc 0) 00000100:00100000:0.0:1788838109.664568:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:89040:x1875729135032448:12345-0@lo:101:mount.lustre.0 Request processed in 110us (36014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.664574:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788838109.664663:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135032448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838109.664680:0:89040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.664690:0:89040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838109.664780:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135032576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838109.664852:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838109.664909:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504937cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838109.665435:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135032576 00000100:00100000:0.0:1788838109.665443:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135032576 00000100:00100000:0.0:1788838109.665497:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788838109.665515:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:89040:x1875729135032576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838109.665683:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:89040:x1875729135032576:12345-0@lo:501:mount.lustre.0 Request processed in 169us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.665690:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788838109.665726:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135032576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838109.665781:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135032704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838109.665987:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838109.666006:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505aec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838109.666168:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135032704 00000100:00100000:0.0:1788838109.666173:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135032704 00000100:00100000:0.0:1788838109.666194:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788838109.666201:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:89040:x1875729135032704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838109.666613:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135031936:0@lo:400:kworker.0 00000100:00100000:2.0:1788838109.671572:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:89040:x1875729135032704:12345-0@lo:503:mount.lustre.0 Request processed in 5362us (5576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.671586:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788838109.671773:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135032704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838109.672487:0:89053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89053:1875729135032832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838109.672552:0:89053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838109.672589:0:89053:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5044653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838109.672635:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135032832 00000100:00100000:2.0:1788838109.672650:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135032832 00000100:00100000:2.0:1788838109.672694:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788838109.672702:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:89053:x1875729135032832:12345-0@lo:502:llog_process_th.0 20000000:01000000:1.0:1788838109.673346:0:89048:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788838109.673356:0:89048:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788838109.673577:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:3645:x1875729135032320:12345-0@lo:253:kworker.0 Request processed in 10990us (70912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.673586:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:3.0:1788838109.673691:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788838109.673694:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788838109.673696:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838109.673697:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838109.673698:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838109.673700:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838109.673701:0:3643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788838109.673702:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838109.673704:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788838109.673707:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135032192:0@lo:253:kworker.0 00000020:01000004:0.0:1788838109.673866:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788838109.673868:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788838109.673870:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838109.673871:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838109.673872:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838109.673873:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838109.673874:0:3645:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838109.673876:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838109.673877:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788838109.673879:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135032320:0@lo:253:kworker.0 20000000:01000000:2.0:1788838109.674000:0:89051:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788838109.674005:0:89051:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1788838109.674408:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:89053:x1875729135032832:12345-0@lo:502:llog_process_th.0 Request processed in 1706us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.674423:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788838109.674512:0:89053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89053:1875729135032832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788838109.674543:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838109.674558:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838109.674560:0:89053:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788838109.674567:0:89053:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788838109.674569:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838109.674583:0:89053:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ff6082219b8) 00000020:00000080:1.0:1788838109.674605:0:89053:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1788838109.674610:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788838109.674708:0:89053:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788838109.674715:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc88e8 00000020:00000080:1.0:1788838109.674962:0:89053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788838109.674966:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838109.674970:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838109.674971:0:89053:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788838109.674974:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838109.674977:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838109.674978:0:89053:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788838109.674981:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838109.674988:0:89053:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ff608220000) 00000020:00000080:1.0:1788838109.674999:0:89053:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1788838109.675002:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788838109.675004:0:89053:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788838109.675007:0:89053:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788838109.675012:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788838109.675376:0:89053:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff627d1b000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788838109.675388:0:89053:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ff608223370) 00000020:00000080:1.0:1788838109.675398:0:89053:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1788838109.675455:0:89053:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788838109.675461:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc88fd 00000020:00000080:1.0:1788838109.675561:0:89053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788838109.675567:0:89053:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788838109.675572:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88da08396ccc8904 00080000:01000000:1.0:1788838109.675578:0:89053:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788838109.675581:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc890b 00010000:00010000:2.0:1788838109.676982:0:89051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.677005:0:89051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788838109.677015:0:89051:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003010862s 00010000:00010000:2.0:1788838109.677020:0:89051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.677036:0:89051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.677043:0:89051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.677050:0:89051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.677056:0:89051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5fa00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838109.677060:0:89051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.677077:0:89051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.677090:0:89051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.677098:0:89051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.677104:0:89051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5fa00/0x88da08396ccc88da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.803698:0:89053:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1788838109.803873:0:89053:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: fdcf066d-ff07-4b2e-96ab-52415ed6bf72 idx: 0 lr: 103079215113 srv lr: 107374182400 lx: 0 gen 23 00000001:00080000:1.0:1788838109.803920:0:89053:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 22 00000001:00000004:1.0:1788838109.803944:0:89053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:1.0:1788838109.804055:0:89053:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1788838109.804109:0:89053:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff505a5e180: xid 1875729116398208, transno 107374182405, client gen 23, slot idx 0 00000001:00080000:1.0:1788838109.804119:0:89053:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff505a5e300: xid 1875729116398464, transno 107374182406, client gen 23, slot idx 1 00000020:00000080:1.0:1788838109.804538:0:89053:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ff608224d28) 00000020:00000080:1.0:1788838109.804557:0:89053:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1788838109.804627:0:89053:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788838109.804634:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8927 00000020:00000080:2.0:1788838109.825127:0:89053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788838109.829656:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88da08396ccc892e 00000020:00000080:1.0:1788838109.830525:0:89053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788838109.830544:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838109.830552:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838109.830555:0:89053:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788838109.830560:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788838109.830564:0:89053:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788838109.830566:0:89053:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788838109.830567:0:89053:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788838109.830569:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788838109.830571:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838109.830573:0:89053:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788838109.830575:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838109.830581:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838109.830582:0:89053:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788838109.830587:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788838109.830636:0:89053:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788838109.830652:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838109.830656:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838109.830657:0:89053:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788838109.830660:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838109.830675:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838109.830677:0:89053:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788838109.830680:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788838109.830686:0:89053:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:1.0:1788838109.830715:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838109.830734:0:89053:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ff6395619b8) 00000020:00000080:1.0:1788838109.830762:0:89053:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788838109.830768:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788838109.830858:0:89053:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788838109.830865:0:89053:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788838109.830872:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc893c 00010000:00080000:1.0:1788838109.830910:0:89053:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff503193800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788838109.832574:0:89053:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1788838109.841968:0:89053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838109.841986:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788838109.842024:0:89053:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788838109.842048:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8943 00000100:00080000:0.0:1788838109.842058:0:89053:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788838109.842065:0:89053:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ff503193800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838109.842104:0:89053:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61d27ce00 x1875729135032960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838109.842133:0:89053:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788838109.842194:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838109.842198:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838109.842200:0:89053:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788838109.842203:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838109.842207:0:89053:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788838109.842209:0:89053:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838109.842210:0:89053:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838109.842212:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838109.842214:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838109.842215:0:89053:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838109.842218:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788838109.842224:0:89053:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788838109.842227:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838109.842228:0:89053:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788838109.842231:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838109.842235:0:89053:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1788838109.842272:0:89053:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788838109.842275:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838109.842289:0:89053:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ff503ca19b8) 00000020:00000080:0.0:1788838109.842306:0:89053:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788838109.842321:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838109.842389:0:89053:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788838109.842396:0:89053:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788838109.842403:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8951 00010000:00080000:0.0:1788838109.842441:0:89053:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff509c71000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788838109.842646:0:89053:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1788838109.842968:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135032960:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838109.843043:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838109.843315:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135032960 00000100:00100000:0.0:1788838109.843325:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135032960 00000100:00100000:0.0:1788838109.843372:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4082 00000100:00100000:0.0:1788838109.843382:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135032960:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788838109.843410:0:23765:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3503 last 0 00000020:00000080:0.0:1788838109.843445:0:23765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8958 00000004:00100000:0.0:1788838109.843462:0:23765:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788838109.843567:0:23765:0:(import.c:65:import_set_state_nolock()) ffff8ff509c75000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838109.843627:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135032960:12345-0@lo:38:llog_process_th.0 Request processed in 244us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.843635:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4082 00000100:00100000:0.0:1788838109.843677:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838109.843685:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1788838109.843692:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788838109.843697:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788838109.843699:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff503193800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788838109.843711:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135032960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838109.843781:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838109.843789:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135033088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838109.843842:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838109.843978:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135033088 00000100:00100000:2.0:1788838109.843984:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135033088 00000100:00100000:2.0:1788838109.844018:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083 00000100:00100000:2.0:1788838109.844095:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135033088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838109.844119:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788838109.844169:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135033088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.844175:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083 00000100:00100000:0.0:1788838109.844359:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135033088:0@lo:41:osp-pre-1-0.0 00000040:01000000:3.0:1788838109.845572:0:89053:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788838109.845597:0:89053:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788838109.845723:0:89053:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1788838109.851383:0:89053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838109.851413:0:89053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:3.0:1788838109.859513:0:89053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:0.0:1788838109.864326:0:89059:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:0.0:1788838109.864334:0:89059:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788838109.864558:0:89059:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:0.0:1788838109.864581:0:89059:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788838109.864756:0:89059:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:0.0:1788838109.864760:0:89059:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788838109.866635:0:89053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788838109.866675:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788838109.866722:0:89053:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788838109.866762:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc895f 00000100:00080000:3.0:1788838109.866774:0:89053:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838109.866781:0:89053:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff509c71000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838109.867063:0:89053:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63956b800 x1875729135033216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838109.867116:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135033216:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788838109.867186:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838109.867285:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135033216 00000100:00100000:1.0:1788838109.867293:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135033216 00000100:00100000:1.0:1788838109.867327:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5939 00000100:00100000:1.0:1788838109.867334:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3642:x1875729135033216:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788838109.867360:0:26206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3503 last 0 00000020:00000080:1.0:1788838109.867384:0:26206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8966 00002000:00100000:1.0:1788838109.867399:0:26206:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ff632f52800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788838109.867403:0:26206:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788838109.867407:0:26206:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788838109.867485:0:26206:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788838109.867506:0:26206:0:(import.c:65:import_set_state_nolock()) ffff8ff632f50000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788838109.867563:0:89053:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788838109.867634:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838109.867653:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.867655:0:89053:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788838109.867659:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788838109.867661:0:89053:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788838109.867663:0:89053:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788838109.867665:0:89053:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788838109.867666:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788838109.867669:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.867670:0:89053:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788838109.867672:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788838109.867676:0:89053:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788838109.867679:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.867681:0:89053:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788838109.867683:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788838109.867687:0:89053:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1788838109.867706:0:89053:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788838109.867709:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788838109.867722:0:89053:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ff6271ccd28) 00000020:00000080:3.0:1788838109.867748:0:89053:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788838109.867754:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788838109.867843:0:89053:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788838109.867849:0:89053:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788838109.867864:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8974 00010000:00080000:3.0:1788838109.867893:0:89053:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff61d4bb800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788838109.868093:0:89053:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1788838109.868159:0:89053:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788838109.868172:0:89053:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788838109.869952:0:89053:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1788838109.874049:0:89053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838109.874084:0:89053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:3.0:1788838109.874230:0:89053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000100:00100000:1.0:1788838109.879617:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135033216:12345-0@lo:8:llog_process_th.0 Request processed in 12273us (12422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.879633:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5939 00000040:00080000:3.0:1788838109.882198:0:89061:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1788838109.882208:0:89061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788838109.882416:0:89061:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1788838109.882437:0:89061:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788838109.882570:0:89061:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1788838109.882574:0:89061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788838109.883707:0:89053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788838109.883719:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788838109.883767:0:89053:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788838109.883790:0:89053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc897b 00000100:00080000:3.0:1788838109.883824:0:89053:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838109.883830:0:89053:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ff61d4bb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838109.883861:0:89053:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639569180 x1875729135033344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838109.883878:0:89053:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788838109.883929:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838109.883934:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.883936:0:89053:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788838109.883939:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838109.883942:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.883944:0:89053:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788838109.883954:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788838109.883956:0:89053:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788838109.883958:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838109.883960:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.883961:0:89053:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788838109.883964:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838109.883967:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.883968:0:89053:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788838109.883971:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788838109.884002:0:89053:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89053:1875729135033472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838109.884078:0:89053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.884122:0:89053:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624433540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838109.884774:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838109.884784:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788838109.884791:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788838109.884827:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788838109.884831:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff509c71000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788838109.884887:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788838109.884894:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135033216:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788838109.884928:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135033472 00000100:00100000:0.0:1788838109.884933:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135033472 00000100:00100000:0.0:1788838109.884974:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788838109.884983:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:89053:x1875729135033472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838109.885102:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:89053:x1875729135033472:12345-0@lo:502:llog_process_th.0 Request processed in 118us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.885110:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788838109.885165:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135033344:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788838109.885198:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788838109.885323:0:89059:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788838109.885388:0:89059:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3503904589517ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788838109.885402:0:89059:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788838109.885487:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135033344 00000100:00100000:3.0:1788838109.885491:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135033344 00000100:00100000:3.0:1788838109.885521:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5940 00000100:00100000:3.0:1788838109.885526:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3642:x1875729135033344:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788838109.885550:0:26212:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3503 last 0 00000020:00000080:3.0:1788838109.885576:0:26212:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8982 00002000:00100000:3.0:1788838109.885589:0:26212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ff5021a6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788838109.885594:0:26212:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788838109.885597:0:26212:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788838109.885657:0:26212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788838109.885678:0:26212:0:(import.c:65:import_set_state_nolock()) ffff8ff61d4bb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838109.885727:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135033344:12345-0@lo:8:llog_process_th.0 Request processed in 199us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.885836:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788838109.885842:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788838109.885847:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788838109.885851:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788838109.885853:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff61d4bb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788838109.885865:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788838109.885869:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135033344:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788838109.885924:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135033600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838109.885955:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838109.885992:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135033600 00000100:00100000:1.0:1788838109.885996:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135033600 00000100:00100000:1.0:1788838109.886030:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:1.0:1788838109.886036:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875729135033600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838109.886050:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838109.886084:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875729135033600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.886091:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:1.0:1788838109.886120:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135033600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838109.886232:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5940 00000004:00080000:3.0:1788838109.886254:0:89061:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788838109.886297:0:89061:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3503905499034ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788838109.886303:0:89061:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788838109.886333:0:89053:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89053:1875729135033472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788838109.886363:0:89053:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838109.886370:0:89053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.886372:0:89053:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788838109.886376:0:89053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00080000:3.0:1788838109.890885:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:3.0:1788838109.893030:0:89040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788838109.893074:0:89040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788838109.893091:0:89040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.893105:0:89040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838109.893113:0:89040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff627d1b000 from 1 10000000:01000000:3.0:1788838109.893116:0:89040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788838109.893156:0:89040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.893163:0:89040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.893173:0:89040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838109.893196:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135033728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838109.893277:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.893321:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624433540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838109.893390:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135033728 00000100:00100000:1.0:1788838109.893398:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135033728 00000100:00100000:1.0:1788838109.893442:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838109.893452:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:89040:x1875729135033728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838109.893466:0:89046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838109.893482:0:89046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff505bb0c00/0x88da08396ccc8990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8989 expref: -99 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.893530:0:89046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff505bb0c00/0x88da08396ccc8990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8989 expref: 9 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.893540:0:89046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff505bb0c00/0x88da08396ccc8990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8989 expref: 9 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.893548:0:89046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff505bb0c00, rc 0) 00000100:00100000:1.0:1788838109.893596:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:89040:x1875729135033728:12345-0@lo:101:mount.lustre.0 Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.893602:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788838109.894153:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838109.894169:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135033856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838109.894216:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838109.894252:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135033856 00000100:00100000:0.0:1788838109.894257:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135033856 00000100:00100000:0.0:1788838109.894306:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:0.0:1788838109.894313:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135033856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838109.894329:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838109.894365:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135033856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.894372:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00080000:0.0:1788838109.894391:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838109.894421:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135033856:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788838109.895918:0:89041:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788838109.895948:0:89041:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788838109.896171:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135033728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838109.896217:0:89040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.896230:0:89040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838109.897308:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135033984:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788838109.897397:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.897543:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624433540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838109.900090:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135033984 00000100:00100000:1.0:1788838109.900105:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135033984 00000100:00100000:1.0:1788838109.900214:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838109.900224:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:89040:x1875729135033984:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788838109.900250:0:89048:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788838109.900286:0:89048:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788838109.900290:0:89048:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788838109.900294:0:89048:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788838109.900297:0:89048:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 116 00000100:00100000:1.0:1788838109.900446:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:89040:x1875729135033984:12345-0@lo:256:mount.lustre.0 Request processed in 224us (3049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838109.900454:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788838109.900545:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135033984:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788838109.901198:0:89040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788838109.901221:0:89040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.901232:0:89040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838109.901241:0:89040:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff627d1b000 from 1 10000000:01000000:3.0:1788838109.901244:0:89040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838109.901288:0:89040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.901296:0:89040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.901305:0:89040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838109.901325:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135034112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838109.901377:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.912149:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624433540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838109.915477:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135034112 00000100:00100000:0.0:1788838109.915492:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135034112 00000100:00100000:0.0:1788838109.915571:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788838109.915583:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a20a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:89040:x1875729135034112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838109.915602:0:89046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838109.915625:0:89046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50718e600/0x88da08396ccc899e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8997 expref: -99 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.915934:0:89046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50718e600/0x88da08396ccc899e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8997 expref: 10 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.915947:0:89046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50718e600/0x88da08396ccc899e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8997 expref: 10 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.915957:0:89046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718e600, rc 0) 00000100:00100000:0.0:1788838109.916041:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a20a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89040:x1875729135034112:12345-0@lo:101:mount.lustre.0 Request processed in 460us (14663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.916066:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788838109.916166:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135034112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838109.916185:0:89040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838109.916196:0:89040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838109.916281:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135034240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838109.916319:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.916356:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624433540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838109.916400:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135034240 00000100:00100000:0.0:1788838109.916404:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135034240 00000100:00100000:0.0:1788838109.916424:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788838109.916431:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a20b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89040:x1875729135034240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838109.916565:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a20b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89040:x1875729135034240:12345-0@lo:501:mount.lustre.0 Request processed in 134us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.916572:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788838109.916631:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135034240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838109.916675:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135034368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838109.916714:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.916737:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624433540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838109.916959:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135034368 00000100:00100000:0.0:1788838109.916963:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135034368 00000100:00100000:0.0:1788838109.916984:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788838109.916990:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a20a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89040:x1875729135034368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838109.917080:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a20a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89040:x1875729135034368:12345-0@lo:503:mount.lustre.0 Request processed in 89us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.917087:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788838109.917154:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135034368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838109.917505:0:89063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89063:1875729135034496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838109.917543:0:89063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.917575:0:89063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624433000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838109.917614:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135034496 00000100:00100000:0.0:1788838109.917618:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135034496 00000100:00100000:0.0:1788838109.917650:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788838109.917658:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a20a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89063:x1875729135034496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838109.918114:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a20a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89063:x1875729135034496:12345-0@lo:502:llog_process_th.0 Request processed in 455us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.918123:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788838109.918200:0:89063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89063:1875729135034496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788838109.918228:0:89063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838109.918238:0:89063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.918240:0:89063:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788838109.918247:0:89063:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff627d1b000 00000020:00000080:3.0:1788838109.918255:0:89063:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788838109.918275:0:89063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838109.918278:0:89063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.918280:0:89063:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788838109.918282:0:89063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838109.918285:0:89063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.918286:0:89063:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788838109.918289:0:89063:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff627d1b000 00000020:00000080:3.0:1788838109.918291:0:89063:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788838109.918369:0:89063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89063:1875729135034624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838109.918402:0:89063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838109.918431:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135034624 00000100:00100000:3.0:1788838109.918435:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135034624 00000100:00100000:3.0:1788838109.918456:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788838109.918462:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a20b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89063:x1875729135034624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838109.918533:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a20b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89063:x1875729135034624:12345-0@lo:502:llog_process_th.0 Request processed in 70us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838109.918539:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788838109.918573:0:89063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838109.918584:0:89063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89063:1875729135034624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788838109.918600:0:89063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838109.918604:0:89063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838109.918606:0:89063:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788838109.918609:0:89063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788838109.920986:0:89040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788838109.921023:0:89040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788838109.921049:0:89040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.921061:0:89040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838109.921135:0:89040:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788838109.921138:0:89040:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ff627d1b000 10000000:01000000:1.0:1788838109.921141:0:89040:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ff627d1b000 10000000:01000000:1.0:1788838109.921145:0:89040:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788838109.921151:0:89040:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627d1b000 from 1 10000000:01000000:1.0:1788838109.921153:0:89040:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838109.921187:0:89040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.921194:0:89040:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838109.921205:0:89040:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838109.921232:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135034752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788838109.921306:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838109.929165:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838109.929242:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135034752 00000100:00100000:2.0:1788838109.929251:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135034752 00000100:00100000:2.0:1788838109.929330:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788838109.929341:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:89040:x1875729135034752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838109.929359:0:89047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838109.929384:0:89047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc89ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc89a5 expref: -99 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.929412:0:89047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc89ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc89a5 expref: 11 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.929424:0:89047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc89ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc89a5 expref: 11 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.929434:0:89047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5e200, rc 0) 00000100:00100000:2.0:1788838109.929589:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89040:x1875729135034752:12345-0@lo:101:mount.lustre.0 Request processed in 249us (8281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.929596:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788838109.935876:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135034752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838109.935907:0:89040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838109.935932:0:89040:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838109.936051:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135034880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838109.936111:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838109.936149:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838109.936359:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135034880 00000100:00100000:2.0:1788838109.936366:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135034880 00000100:00100000:2.0:1788838109.936416:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788838109.936426:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89040:x1875729135034880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838109.936574:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89040:x1875729135034880:12345-0@lo:501:mount.lustre.0 Request processed in 149us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.936581:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788838109.936674:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135034880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838109.936708:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135035008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838109.936760:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838109.936786:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838109.937008:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135035008 00000100:00100000:2.0:1788838109.937012:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135035008 00000100:00100000:2.0:1788838109.937043:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788838109.937050:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89040:x1875729135035008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838109.937138:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89040:x1875729135035008:12345-0@lo:503:mount.lustre.0 Request processed in 88us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.937145:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788838109.937190:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135035008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838109.937898:0:89065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89065:1875729135035136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838109.937943:0:89065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838109.938487:0:89065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788838109.945209:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135035136 00000100:00100000:2.0:1788838109.945225:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135035136 00000100:00100000:2.0:1788838109.950467:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788838109.950488:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89065:x1875729135035136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838109.950700:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89065:x1875729135035136:12345-0@lo:502:llog_process_th.0 Request processed in 220us (12756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.950708:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788838109.950897:0:89065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89065:1875729135035136:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788838109.950973:0:89065:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788838109.950989:0:89065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ff503ca3370) 00000020:00000080:0.0:1788838109.951016:0:89065:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788838109.951111:0:89065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff627d1b000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788838109.951116:0:89065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff627d1b000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788838109.951118:0:89065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff627d1b000 4 00010000:00080000:0.0:1788838109.951145:0:89065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff50a580000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788838109.952824:0:89065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1788838109.958115:0:89065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788838109.958169:0:89065:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788838109.958182:0:89065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88da08396ccc89ba 00000100:00080000:3.0:1788838109.958193:0:89065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838109.958199:0:89065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff50a580000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838109.958240:0:89065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63956b100 x1875729135035264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838109.958278:0:89065:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788838109.958970:0:89065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89065:1875729135035392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838109.959059:0:89065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838109.959100:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135035392 00000100:00100000:2.0:1788838109.959106:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135035392 00000100:00100000:2.0:1788838109.959147:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838109.959155:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89065:x1875729135035392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838109.959272:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89065:x1875729135035392:12345-0@lo:502:llog_process_th.0 Request processed in 116us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.959280:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838109.959335:0:89065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503684480 going to sleep for 11 seconds 00000100:00100000:2.0:1788838109.959355:0:89065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89065:1875729135035392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838109.959395:0:89065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89065:1875729135035520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838109.959428:0:89065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838109.959444:0:89065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503684480 going to sleep for 11 seconds 00000100:00100000:2.0:1788838109.959459:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135035520 00000100:00100000:2.0:1788838109.959463:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135035520 00000100:00100000:2.0:1788838109.959487:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838109.959493:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89065:x1875729135035520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838109.959558:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89065:x1875729135035520:12345-0@lo:502:llog_process_th.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.959566:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838109.959601:0:89065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:89065:1875729135035520:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788838109.959620:0:89065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:1.0:1788838109.960476:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135035264:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788838109.960520:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788838109.960895:0:89040:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788838109.960918:0:89040:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838109.960936:0:89040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.960946:0:89040:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788838109.961009:0:89040:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788838109.961011:0:89040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838109.961012:0:89040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838109.961013:0:89040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838109.961014:0:89040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838109.961016:0:89040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838109.961017:0:89040:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838109.961018:0:89040:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838109.961020:0:89040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838109.961021:0:89040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838109.961025:0:89040:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788838109.961027:0:89040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788838109.961028:0:89040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838109.961029:0:89040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838109.961030:0:89040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838109.961031:0:89040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838109.961032:0:89040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838109.961033:0:89040:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838109.961034:0:89040:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838109.961035:0:89040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838109.961042:0:89040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838109.961060:0:89040:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788838109.961071:0:89040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135035648:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788838109.961107:0:89040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838109.961133:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135035648 00000100:00100000:2.0:1788838109.961138:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135035648 00000100:00100000:2.0:1788838109.961166:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788838109.961174:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89040:x1875729135035648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788838109.961197:0:89048:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788838109.961209:0:89048:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788838109.965942:0:89048:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788838109.965960:0:89048:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788838109.966058:0:89051:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788838109.966064:0:89051:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788838109.966091:0:89051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.966112:0:89051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff505bb0c00/0x88da08396ccc8990 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8989 expref: 11 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.966120:0:89051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.966165:0:89051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff505bb0c00/0x88da08396ccc8990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc8989 expref: 11 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.966180:0:89051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff505bb0c00/0x88da08396ccc8990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc8989 expref: 11 pid: 89046 timeout: 3603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838109.966194:0:89051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f44a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89051:1875729135035776:0@lo:104: 00000100:00100000:2.0:1788838109.966280:0:89051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838109.966339:0:89051:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838109.966547:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135035264 00000100:00100000:0.0:1788838109.966555:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135035264 00000100:00100000:0.0:1788838109.966590:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1788838109.966598:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135035264:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838109.966669:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135035264:12345-0@lo:38:llog_process_th.0 Request processed in 70us (6147us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788838109.966677:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1788838109.967940:0:10414:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788838109.967971:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135035776 00000100:00100000:2.0:1788838109.967979:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135035776 00000100:00100000:2.0:1788838109.968028:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788838109.968037:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba92c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:89051:x1875729135035776:12345-0@lo:104: 00010000:00010000:2.0:1788838109.968053:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.968127:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788838109.968133:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba92c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:89051:x1875729135035776:12345-0@lo:104: Request processed in 99us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.968139:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788838109.968209:0:89051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f44a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89051:1875729135035776:0@lo:104: 00010000:00010000:2.0:1788838109.968230:0:89051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.968247:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838109.968253:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838109.968355:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788838109.968363:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff50a580000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838109.968380:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788838109.968384:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135035264:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788838109.970008:0:89040:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503684480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838109.970211:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:89040:x1875729135035648:12345-0@lo:253:mount.lustre.0 Request processed in 9034us (9099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838109.970232:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788838109.970341:0:89040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:89040:1875729135035648:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788838109.970357:0:89040:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788838109.970360:0:89040:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788838109.970362:0:89040:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788838109.970363:0:89040:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838109.970364:0:89040:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838109.970365:0:89040:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838109.970367:0:89040:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838109.970368:0:89040:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788838109.970370:0:89040:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788838109.970371:0:89040:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838109.970373:0:89040:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788838109.970392:0:89040:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788838109.971945:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297be00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838109.971951:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.971964:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838109.971972:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838109.971986:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838109.972027:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972034:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838109.972061:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972069:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff63297be00/0x88da08396ccc8989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc8990 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972087:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838109.972089:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838109.972092:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838109.972108:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135035904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838109.972162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838109.972221:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135035904 00000100:00100000:2.0:1788838109.972227:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135035904 00010000:00010000:2.0:1788838109.972252:0:6533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff505bb0c00/0x88da08396ccc8990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc8989 expref: 11 pid: 89046 timeout: 3603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838109.972312:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:2.0:1788838109.972321:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:3645:x1875729135035904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838109.972333:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838109.972338:0:6533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff505bb0c00/0x88da08396ccc8990 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc8989 expref: 11 pid: 89046 timeout: 3603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972349:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff505bb0c00/0x88da08396ccc8990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc8989 expref: 11 pid: 89046 timeout: 3603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972370:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff505bb0c00/0x88da08396ccc8990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc8989 expref: 11 pid: 89046 timeout: 3603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972385:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972393:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788838109.972408:0:6533:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006344754s 00010000:00010000:2.0:1788838109.972412:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972420:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972427:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972434:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972440:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838109.972444:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972452:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972466:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972482:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838109.972515:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:3645:x1875729135035904:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838109.972523:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00010000:00010000:2.0:1788838109.972548:0:89051:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972557:0:89051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838109.972564:0:89051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f800/0x88da08396ccc89c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838109.972596:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135035904:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788838109.993603:0:89040:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:0.0:1788838109.995638:0:89040:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788838109.995812:0:89071:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:2.0:1788838109.995816:0:89071:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:2.0:1788838109.996298:0:89072:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788838109.996720:0:89072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838109.998992:0:89072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788838109.999075:0:89072:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1788838109.999882:0:89040:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788838110.000665:0:89073:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89073:1875729135036032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838110.000748:0:89073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838110.000786:0:89073:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838110.000953:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135036032 00000100:00100000:3.0:1788838110.000962:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135036032 00000100:00100000:3.0:1788838110.001012:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4084 00000100:00100000:3.0:1788838110.001021:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89073:x1875729135036032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788838110.001109:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89073:x1875729135036032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838110.001117:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4084 00000100:00100000:0.0:1788838110.001311:0:89073:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89073:1875729135036032:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788838110.001340:0:89073:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788838110.001366:0:89073:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89073:1875729135036160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838110.001398:0:89073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838110.001422:0:89073:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838110.001470:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135036160 00000100:00100000:1.0:1788838110.001475:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135036160 00000100:00100000:1.0:1788838110.001509:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4085 00000100:00100000:1.0:1788838110.001516:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89073:x1875729135036160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788838110.001630:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89073:x1875729135036160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 114us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838110.001637:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4085 00000100:00100000:0.0:1788838110.001860:0:89073:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89073:1875729135036160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838110.001919:0:89073:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89073:1875729135036288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838110.001946:0:89073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838110.001964:0:89073:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838110.002053:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135036288 00000100:00100000:3.0:1788838110.002058:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135036288 00000100:00100000:3.0:1788838110.002090:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086 00000100:00100000:3.0:1788838110.002097:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89073:x1875729135036288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788838110.002157:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89073:x1875729135036288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 60us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838110.002164:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086 00000100:00100000:1.0:1788838110.002238:0:89073:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89073:1875729135036288:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788838110.002295:0:89073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838110.006662:0:89073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000040:01000000:2.0:1788838110.007239:0:89040:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788838110.007291:0:89040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788838110.008680:0:89073:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1788838110.008689:0:89073:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:2.0:1788838110.008926:0:89040:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788838110.008939:0:89040:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788838110.009013:0:89040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838110.010250:0:89040:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788838110.011036:0:89040:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788838110.011090:0:89040:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788838110.011214:0:89040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788838110.012337:0:89040:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00010000:00080000:2.0:1788838110.015168:0:89040:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182406 00010000:00080000:0.0:1788838110.016138:0:89074:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 89074 00010000:02000000:0.0:1788838110.016186:0:89074:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1788838110.016191:0:89074:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788838110.016195:0:89074:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788838110.016279:0:89040:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788838110.016297:0:89040:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788838110.016327:0:89040:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788838110.016348:0:89040:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788838110.017311:0:89040:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838110.017569:0:89040:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788838110.219425:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838110.782209:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838110.782250:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838110.782360:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116406016 00000100:00100000:2.0:1788838110.782371:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116406016 00000100:00100000:2.0:1788838110.782600:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116405888 00000100:00100000:2.0:1788838110.782604:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116405888 00000100:00100000:2.0:1788838110.782621:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1199 00000100:00100000:2.0:1788838110.782631:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116406016:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838110.782707:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116406016:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 77us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838110.782714:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1199 00000100:00100000:2.0:1788838110.782740:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1195 00000100:00100000:2.0:1788838110.782745:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875729116405888:12345-192.168.203.30@tcp:38:kworker.0 00010000:00080000:2.0:1788838110.782779:0:66255:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'fdcf066d-ff07-4b2e-96ab-52415ed6bf72' at ffff8ff609253000, cookie 0x88da08396ccc8912 00010000:00080000:2.0:1788838110.782785:0:66255:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp recovering/t107374182407 exp ffff8ff609253000 cur 3504 last 1788838109 00010000:02000400:2.0:1788838110.782794:0:66255:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788838110.782845:0:66255:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788838110.782867:0:66255:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788838110.783027:0:66255:0:(import.c:65:import_set_state_nolock()) ffff8ff50a9bc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838110.783067:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116405888:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 319us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838110.783089:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1195 00000100:00080000:3.0:1788838110.783283:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838110.785659:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838110.785732:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116399360 00000100:00100000:1.0:1788838110.785761:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116399360 00000100:00100000:1.0:1788838110.785842:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1196 00000100:00100000:1.0:1788838110.785853:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116399360:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00080000:1.0:1788838110.785874:0:66254:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 107374182407, current: 107374182407, replaying 00000100:00100000:1.0:1788838110.785887:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116399360:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 39us (238us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838110.785893:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1196 00010000:00080000:2.0:1788838110.789022:0:89074:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1788838110.790719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838110.790825:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116406144 00000100:00100000:2.0:1788838110.790835:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116406144 00000100:00100000:2.0:1788838110.790880:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:2.0:1788838110.790888:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1875729116406144:12345-192.168.203.30@tcp:250:kworker.0 00010000:00080000:2.0:1788838110.790913:0:89046:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4043f878-3455-4729-a2a8-e06e8394cc00@192.168.203.30@tcp t0 exp 0000000000000000 cur 3504 last 0 00000020:00000080:2.0:1788838110.790940:0:89046:0:(genops.c:1385:class_connect()) connect: client 4043f878-3455-4729-a2a8-e06e8394cc00, cookie 0x88da08396ccc89c8 00000100:00080000:2.0:1788838110.791066:0:89046:0:(import.c:65:import_set_state_nolock()) ffff8ff50a9b9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838110.791129:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+5:2403:x1875729116406144:12345-192.168.203.30@tcp:250:kworker.0 Request processed in 241us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838110.791136:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00010000:00010000:3.0:1788838111.229957:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788838111.484916:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788838111.484924:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff627d1b000 from 117 10000000:01000000:0.0:1788838111.484929:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788838111.484979:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.485011:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.485023:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838111.485050:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135036416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.485153:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838111.485210:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.485415:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135036416 00000100:00100000:2.0:1788838111.485425:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135036416 00000100:00100000:2.0:1788838111.485485:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788838111.485495:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:6544:x1875729135036416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.485510:0:89048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.485526:0:89048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5e600/0x88da08396ccc89d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc89cf expref: -99 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.485552:0:89048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5e600/0x88da08396ccc89d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc89cf expref: 11 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.485564:0:89048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5e600/0x88da08396ccc89d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc89cf expref: 11 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.485573:0:89048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5e600, rc 0) 00000100:00100000:2.0:1788838111.485639:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135036416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.485646:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788838111.485750:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135036416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838111.485765:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.485786:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.485876:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135036544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.485908:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.485939:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.486049:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135036544 00000100:00100000:2.0:1788838111.486053:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135036544 00000100:00100000:2.0:1788838111.486092:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788838111.486099:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135036544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788838111.486112:0:89047:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788838111.486139:0:89047:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788838111.486142:0:89047:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 117 00000100:00100000:2.0:1788838111.486216:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135036544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.486223:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788838111.488379:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135036544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788838111.488452:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788838111.488462:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.488472:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838111.488482:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788838111.488484:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff503592800 from 52 10000000:01000000:1.0:1788838111.488487:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838111.488518:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0800/0x88da08396ccc89dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.488525:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0800/0x88da08396ccc89dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.488533:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0800/0x88da08396ccc89dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.488553:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135036672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.488621:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.488672:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.489268:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135036672 00000100:00100000:2.0:1788838111.489276:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135036672 00000100:00100000:2.0:1788838111.489338:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788838111.489347:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135036672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.489361:0:89047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.489376:0:89047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5f000/0x88da08396ccc89e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc89dd expref: -99 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.489414:0:89047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5f000/0x88da08396ccc89e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc89dd expref: 12 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.489426:0:89047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5f000/0x88da08396ccc89e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc89dd expref: 12 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.489434:0:89047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5f000, rc 0) 00000100:00100000:2.0:1788838111.489491:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135036672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.489507:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788838111.489777:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135036672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.489792:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0800/0x88da08396ccc89dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89e4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.489840:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0800/0x88da08396ccc89dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc89e4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.489904:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135036800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.489936:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.489973:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838111.490347:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135036800 00000100:00100000:3.0:1788838111.490353:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135036800 00000100:00100000:3.0:1788838111.490382:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788838111.490404:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135036800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.490531:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135036800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.490546:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788838111.490709:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135036800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.490741:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135036928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.490786:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.490836:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788838111.490947:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135036928 00000100:00100000:0.0:1788838111.490951:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135036928 00000100:00100000:0.0:1788838111.490972:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788838111.490978:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135036928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.491084:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135036928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.491091:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788838111.491332:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135036928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788838111.496771:0:89134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788838111.501733:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788838111.501787:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838111.502279:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0800/0x88da08396ccc89dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89e4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.502293:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0800/0x88da08396ccc89dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89e4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838111.502305:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788838111.502328:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff503592800 from 114 10000000:01000000:1.0:1788838111.502332:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788838111.502385:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1600/0x88da08396ccc89eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.502622:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1600/0x88da08396ccc89eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.502634:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1600/0x88da08396ccc89eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.502664:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.502744:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.505524:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788838111.505847:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135037056 00000100:00100000:0.0:1788838111.505859:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135037056 00000100:00100000:0.0:1788838111.505932:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788838111.505942:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50452d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135037056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838111.505957:0:89046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838111.505975:0:89046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50718f800/0x88da08396ccc89f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc89eb expref: -99 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.506023:0:89046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50718f800/0x88da08396ccc89f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc89eb expref: 13 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.506060:0:89046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50718f800/0x88da08396ccc89f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc89eb expref: 13 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.506070:0:89046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718f800, rc 0) 00000100:00100000:0.0:1788838111.506153:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50452d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135037056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (3409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.506160:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788838111.506414:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838111.506432:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1600/0x88da08396ccc89eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89f2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.506441:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1600/0x88da08396ccc89eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc89f2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.506505:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.506562:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.506593:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788838111.506612:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135037184 00000100:00100000:3.0:1788838111.506623:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135037184 00000100:00100000:3.0:1788838111.506651:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788838111.506658:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50452e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135037184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788838111.506674:0:89048:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788838111.506692:0:89048:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788838111.506697:0:89048:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788838111.506700:0:89048:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788838111.506703:0:89048:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788838111.506706:0:89048:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 117 00000100:00100000:3.0:1788838111.506794:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50452e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135037184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.506820:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788838111.506857:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788838111.506930:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788838111.506938:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1600/0x88da08396ccc89eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89f2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.506946:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1600/0x88da08396ccc89eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89f2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838111.506954:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788838111.506956:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1788838111.506959:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788838111.506981:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297ae00/0x88da08396ccc89f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.506987:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff63297ae00/0x88da08396ccc89f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.506995:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff63297ae00/0x88da08396ccc89f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.507393:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.507422:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.507456:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.507521:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135037312 00000100:00100000:2.0:1788838111.507526:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135037312 00000100:00100000:2.0:1788838111.507572:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788838111.507580:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50452d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135037312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.507589:0:89047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.507601:0:89047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5fe00/0x88da08396ccc8a00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc89f9 expref: -99 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.507619:0:89047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5fe00/0x88da08396ccc8a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc89f9 expref: 14 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.507628:0:89047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5fe00/0x88da08396ccc8a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc89f9 expref: 14 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.507636:0:89047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5fe00, rc 0) 00000100:00100000:2.0:1788838111.507677:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50452d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135037312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.507683:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788838111.507718:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.507729:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff63297ae00/0x88da08396ccc89f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a00 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.507737:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff63297ae00/0x88da08396ccc89f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a00 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.507830:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.507866:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838111.507881:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.507892:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135037440 00000100:00100000:2.0:1788838111.507895:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135037440 00000100:00100000:2.0:1788838111.507911:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788838111.507916:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50452ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135037440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.508379:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50452ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135037440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 460us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.508385:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788838111.508763:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.508836:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.508886:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.508912:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838111.509299:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135037568 00000100:00100000:0.0:1788838111.509306:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135037568 00000100:00100000:0.0:1788838111.509356:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788838111.509366:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50452e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135037568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.515436:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50452e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135037568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6061us (6538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.515454:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788838111.515563:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838111.517772:0:89135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788838111.519774:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788838111.519847:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788838111.519859:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297ae00/0x88da08396ccc89f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a00 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.519872:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff63297ae00/0x88da08396ccc89f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a00 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838111.519883:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788838111.519886:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff503592800 from 1 10000000:01000000:1.0:1788838111.519888:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788838111.519928:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1c00/0x88da08396ccc8a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.519936:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1c00/0x88da08396ccc8a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.519968:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1c00/0x88da08396ccc8a07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.519993:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.520068:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.520107:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838111.525484:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135037696 00000100:00100000:0.0:1788838111.525498:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135037696 00000100:00100000:0.0:1788838111.525589:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788838111.525599:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50452f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135037696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838111.525616:0:89048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838111.525635:0:89048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50718e000/0x88da08396ccc8a0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8a07 expref: -99 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.525663:0:89048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50718e000/0x88da08396ccc8a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8a07 expref: 15 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.525696:0:89048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50718e000/0x88da08396ccc8a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8a07 expref: 15 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.525705:0:89048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718e000, rc 0) 00000100:00100000:0.0:1788838111.525791:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50452f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135037696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (5722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.525814:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788838111.526051:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.526068:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1c00/0x88da08396ccc8a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a0e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.526078:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1c00/0x88da08396ccc8a07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a0e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838111.526096:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788838111.526101:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1c00/0x88da08396ccc8a07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a0e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.526109:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1c00/0x88da08396ccc8a07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a0e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838111.526117:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788838111.526119:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff503592800 from 7 10000000:01000000:1.0:1788838111.526122:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788838111.526144:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1000/0x88da08396ccc8a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.526151:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1000/0x88da08396ccc8a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.526179:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1000/0x88da08396ccc8a15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.526200:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.526237:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.526284:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.526302:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135037824 00000100:00100000:1.0:1788838111.526306:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135037824 00000100:00100000:1.0:1788838111.526336:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788838111.526343:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50452dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135037824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.526351:0:89046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838111.526360:0:89046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff505bb0000/0x88da08396ccc8a1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8a15 expref: -99 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.526374:0:89046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff505bb0000/0x88da08396ccc8a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8a15 expref: 16 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.526382:0:89046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff505bb0000/0x88da08396ccc8a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8a15 expref: 16 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.526389:0:89046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff505bb0000, rc 0) 00000100:00100000:1.0:1788838111.526421:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50452dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135037824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.526427:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788838111.526458:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.526467:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1000/0x88da08396ccc8a15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a1c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.526482:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1000/0x88da08396ccc8a15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a1c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.527015:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.527050:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.527068:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.527083:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135037952 00000100:00100000:1.0:1788838111.527086:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135037952 00000100:00100000:1.0:1788838111.527111:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788838111.527117:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50452c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135037952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.527327:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50452c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135037952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.527333:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788838111.527366:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135037952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.527393:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.527433:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.527445:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.527456:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135038080 00000100:00100000:1.0:1788838111.527459:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135038080 00000100:00100000:1.0:1788838111.527478:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788838111.527484:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135038080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.527713:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135038080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.527720:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788838111.527901:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838111.530919:0:89136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788838111.531935:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788838111.531966:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788838111.531978:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1000/0x88da08396ccc8a15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a1c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.531990:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1000/0x88da08396ccc8a15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a1c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838111.532001:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788838111.532003:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff63f7ce800 from 52 10000000:01000000:2.0:1788838111.532237:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788838111.532294:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ea00/0x88da08396ccc8a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.532303:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ea00/0x88da08396ccc8a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.532313:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ea00/0x88da08396ccc8a23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.532341:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.532990:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.533270:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135038208 00000100:00100000:1.0:1788838111.533279:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135038208 00000100:00100000:1.0:1788838111.533371:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788838111.533382:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135038208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.533397:0:89046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838111.533415:0:89046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff505bb0400/0x88da08396ccc8a2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8a23 expref: -99 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.533439:0:89046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff505bb0400/0x88da08396ccc8a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8a23 expref: 17 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.533451:0:89046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff505bb0400/0x88da08396ccc8a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8a23 expref: 17 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.533460:0:89046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff505bb0400, rc 0) 00000100:00100000:1.0:1788838111.533497:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135038208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.533504:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788838111.533560:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ecc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.533583:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.533598:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ea00/0x88da08396ccc8a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a2a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.533607:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ea00/0x88da08396ccc8a23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a2a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.533667:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.533696:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838111.541937:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ecc540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838111.542327:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135038336 00000100:00100000:3.0:1788838111.542339:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135038336 00000100:00100000:3.0:1788838111.542415:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788838111.542425:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135038336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.542851:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bdef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135038336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 426us (9153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.542861:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788838111.543060:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.543116:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.543183:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838111.543220:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ecc540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838111.543759:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135038464 00000100:00100000:3.0:1788838111.543765:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135038464 00000100:00100000:3.0:1788838111.543830:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788838111.543839:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135038464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.543957:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135038464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.543964:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788838111.544311:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838111.549152:0:89137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788838111.550297:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788838111.550335:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788838111.550347:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ea00/0x88da08396ccc8a23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a2a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.550380:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ea00/0x88da08396ccc8a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a2a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838111.550393:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788838111.550395:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788838111.550399:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788838111.550439:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297ac00/0x88da08396ccc8a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.550447:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff63297ac00/0x88da08396ccc8a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.550459:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff63297ac00/0x88da08396ccc8a31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.550485:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.550631:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.550678:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.550744:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135038592 00000100:00100000:1.0:1788838111.550752:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135038592 00000100:00100000:1.0:1788838111.550873:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788838111.550883:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135038592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.550899:0:89048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838111.550913:0:89048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff505bb1200/0x88da08396ccc8a38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8a31 expref: -99 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.550950:0:89048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff505bb1200/0x88da08396ccc8a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8a31 expref: 18 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.550961:0:89048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff505bb1200/0x88da08396ccc8a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8a31 expref: 18 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.550970:0:89048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff505bb1200, rc 0) 00000100:00100000:1.0:1788838111.551029:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135038592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.551035:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788838111.551411:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838111.551428:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff63297ac00/0x88da08396ccc8a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a38 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.551437:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff63297ac00/0x88da08396ccc8a31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a38 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.551497:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.551527:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.551575:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.551685:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135038720 00000100:00100000:1.0:1788838111.551690:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135038720 00000100:00100000:1.0:1788838111.551866:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788838111.551877:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135038720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.552033:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bdef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135038720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.552091:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.552121:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.552166:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.552401:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788838111.552474:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135038848 00000100:00100000:0.0:1788838111.552479:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135038848 00000100:00100000:1.0:1788838111.552609:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788838111.552714:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788838111.552723:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135038848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.554381:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135038848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1652us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.554392:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788838111.554736:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788838111.556449:0:89138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788838111.557156:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788838111.557266:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788838111.557280:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297ac00/0x88da08396ccc8a31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a38 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.557293:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff63297ac00/0x88da08396ccc8a31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a38 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838111.557390:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788838111.557394:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff63f7ce800 from 7 10000000:01000000:3.0:1788838111.557398:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838111.557437:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297a800/0x88da08396ccc8a3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.557444:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff63297a800/0x88da08396ccc8a3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.557452:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff63297a800/0x88da08396ccc8a3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.557476:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.557537:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.557692:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.558135:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135038976 00000100:00100000:1.0:1788838111.558144:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135038976 00000100:00100000:1.0:1788838111.558307:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788838111.558320:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135038976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.558335:0:89048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838111.558349:0:89048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff505bb1400/0x88da08396ccc8a46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8a3f expref: -99 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.558372:0:89048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff505bb1400/0x88da08396ccc8a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8a3f expref: 19 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.558393:0:89048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff505bb1400/0x88da08396ccc8a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8a3f expref: 19 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.558402:0:89048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff505bb1400, rc 0) 00000100:00100000:1.0:1788838111.558459:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135038976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.558466:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788838111.558536:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135038976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838111.558562:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff63297a800/0x88da08396ccc8a3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a46 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.558572:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff63297a800/0x88da08396ccc8a3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a46 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.558645:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.558673:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.558956:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.559157:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135039104 00000100:00100000:2.0:1788838111.559163:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135039104 00000100:00100000:2.0:1788838111.559202:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788838111.559210:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135039104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.559364:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135039104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.559371:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788838111.559683:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.559720:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.559781:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.559793:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.559980:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135039232 00000100:00100000:2.0:1788838111.559985:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135039232 00000100:00100000:2.0:1788838111.560006:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788838111.560086:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135039232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.560193:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135039232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.560201:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788838111.560286:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788838111.561345:0:89139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788838111.561633:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788838111.561660:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788838111.561671:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297a800/0x88da08396ccc8a3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a46 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.561683:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff63297a800/0x88da08396ccc8a3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a46 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838111.561693:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788838111.561696:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627f9a800 from 52 10000000:01000000:2.0:1788838111.561698:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788838111.563062:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e800/0x88da08396ccc8a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.563095:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e800/0x88da08396ccc8a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.563108:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e800/0x88da08396ccc8a4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.563669:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.563794:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.563976:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838111.564073:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135039360 00000100:00100000:0.0:1788838111.564081:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135039360 00000100:00100000:1.0:1788838111.564326:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788838111.564339:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135039360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.564356:0:89047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838111.564375:0:89047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff505bb1e00/0x88da08396ccc8a54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8a4d expref: -99 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.564414:0:89047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff505bb1e00/0x88da08396ccc8a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8a4d expref: 20 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.564424:0:89047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff505bb1e00/0x88da08396ccc8a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8a4d expref: 20 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.564432:0:89047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff505bb1e00, rc 0) 00000100:00100000:1.0:1788838111.564486:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135039360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.564493:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788838111.564578:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838111.564594:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e800/0x88da08396ccc8a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a54 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.564605:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e800/0x88da08396ccc8a4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a54 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838111.564674:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.564705:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838111.565051:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838111.565219:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135039488 00000100:00100000:3.0:1788838111.565227:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135039488 00000100:00100000:3.0:1788838111.565267:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788838111.565273:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6082c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135039488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.565522:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6082c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135039488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.565530:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788838111.565629:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.565665:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.565707:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838111.565716:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838111.565844:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135039616 00000100:00100000:3.0:1788838111.565849:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135039616 00000100:00100000:3.0:1788838111.565866:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788838111.565871:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6082c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135039616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.565951:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6082c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135039616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.565957:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788838111.566101:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838111.567371:0:89140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788838111.568347:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788838111.568377:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788838111.568674:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e800/0x88da08396ccc8a4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a54 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.568688:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e800/0x88da08396ccc8a4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a54 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838111.568700:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788838111.568702:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788838111.568705:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788838111.568960:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297b000/0x88da08396ccc8a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.568968:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff63297b000/0x88da08396ccc8a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.568979:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff63297b000/0x88da08396ccc8a5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838111.569008:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.569145:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838111.569312:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.569359:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135039744 00000100:00100000:1.0:1788838111.569369:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135039744 00000100:00100000:1.0:1788838111.569684:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788838111.569696:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff606d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135039744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.569837:0:89048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838111.569852:0:89048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff505bb1800/0x88da08396ccc8a62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8a5b expref: -99 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.569877:0:89048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff505bb1800/0x88da08396ccc8a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8a5b expref: 21 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.569889:0:89048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff505bb1800/0x88da08396ccc8a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8a5b expref: 21 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.569897:0:89048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff505bb1800, rc 0) 00000100:00100000:1.0:1788838111.569946:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff606d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135039744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.569953:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788838111.570053:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838111.570068:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff63297b000/0x88da08396ccc8a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a62 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.570077:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff63297b000/0x88da08396ccc8a5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a62 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838111.570143:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.570183:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838111.570515:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.570625:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135039872 00000100:00100000:2.0:1788838111.570631:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135039872 00000100:00100000:2.0:1788838111.570658:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788838111.570664:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff606d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135039872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.570941:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff606d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135039872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.570949:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788838111.571238:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135039872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.571279:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.571322:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838111.571378:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.571458:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135040000 00000100:00100000:2.0:1788838111.571463:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135040000 00000100:00100000:2.0:1788838111.571493:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788838111.571500:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff606d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135040000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.573167:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff606d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135040000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1658us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.573269:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788838111.573368:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838111.588685:0:89141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788838111.589329:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788838111.589356:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788838111.589371:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297b000/0x88da08396ccc8a5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a62 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.589469:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff63297b000/0x88da08396ccc8a5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a62 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838111.589479:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788838111.589482:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff627f9a800 from 7 10000000:01000000:0.0:1788838111.589485:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788838111.589521:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8a69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.589529:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8a69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838111.589613:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8a69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838111.589641:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.589715:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.590126:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838111.590164:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135040128 00000100:00100000:3.0:1788838111.590241:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135040128 00000100:00100000:1.0:1788838111.590449:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788838111.590463:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff606d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135040128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.590478:0:89046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838111.590492:0:89046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff505bb0200/0x88da08396ccc8a70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8a69 expref: -99 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.590516:0:89046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff505bb0200/0x88da08396ccc8a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8a69 expref: 22 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.590527:0:89046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff505bb0200/0x88da08396ccc8a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8a69 expref: 22 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.590536:0:89046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff505bb0200, rc 0) 00000100:00100000:1.0:1788838111.590723:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff606d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135040128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 264us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.590872:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788838111.591947:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.591975:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8a69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a70 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.591988:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8a69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a70 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838111.592321:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.592376:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838111.592458:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505bd7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838111.592509:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135040256 00000100:00100000:1.0:1788838111.592515:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135040256 00000100:00100000:1.0:1788838111.592672:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788838111.592684:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff606d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135040256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.592849:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff606d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135040256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838111.592857:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788838111.592928:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.592957:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.593002:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838111.593430:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505bd7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838111.593490:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135040384 00000100:00100000:3.0:1788838111.593502:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135040384 00000100:00100000:3.0:1788838111.593530:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788838111.593537:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff606d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135040384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.593858:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff606d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135040384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 320us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.593865:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788838111.594159:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838111.595461:0:89142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788838111.595709:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788838111.596351:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788838111.596365:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8a69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a70 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.596377:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8a69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a70 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838111.596388:0:6544:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788838111.596390:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ff610244d28 from 1 10000000:01000000:1.0:1788838111.596393:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788838111.596440:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1a00/0x88da08396ccc8a77 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.596448:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1a00/0x88da08396ccc8a77 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.596459:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1a00/0x88da08396ccc8a77 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.596504:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.596688:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.596871:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.596981:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135040512 00000100:00100000:2.0:1788838111.596989:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135040512 00000100:00100000:2.0:1788838111.597156:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788838111.597166:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135040512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.597259:0:89047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.597277:0:89047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5f200/0x88da08396ccc8a7e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8a77 expref: -99 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.597303:0:89047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5f200/0x88da08396ccc8a7e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8a77 expref: 23 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.597314:0:89047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5f200/0x88da08396ccc8a7e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8a77 expref: 23 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.597321:0:89047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5f200, rc 0) 00000100:00100000:2.0:1788838111.597407:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135040512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.597422:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788838111.597507:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.597522:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1a00/0x88da08396ccc8a77 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a7e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.597531:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1a00/0x88da08396ccc8a77 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a7e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838111.597620:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788838111.597625:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1a00/0x88da08396ccc8a77 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a7e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.597631:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1a00/0x88da08396ccc8a77 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a7e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838111.597638:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788838111.597640:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ff610244d28 from 1 10000000:01000000:1.0:1788838111.597642:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788838111.597658:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0a00/0x88da08396ccc8a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.597665:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0a00/0x88da08396ccc8a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.597672:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0a00/0x88da08396ccc8a85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.597698:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.597906:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.597983:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.598100:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135040640 00000100:00100000:2.0:1788838111.598106:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135040640 00000100:00100000:2.0:1788838111.598142:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788838111.598150:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135040640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.598157:0:89047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.598167:0:89047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc8a8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8a85 expref: -99 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.598296:0:89047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc8a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8a85 expref: 24 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.598305:0:89047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc8a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8a85 expref: 24 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.598313:0:89047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5f600, rc 0) 00000100:00100000:2.0:1788838111.598360:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135040640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.598367:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788838111.598436:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838111.598449:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0a00/0x88da08396ccc8a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a8c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.598458:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0a00/0x88da08396ccc8a85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8a8c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838111.598519:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.598630:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838111.598655:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838111.598694:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135040768 00000100:00100000:2.0:1788838111.598698:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135040768 00000100:00100000:1.0:1788838111.598865:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788838111.598875:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135040768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.598993:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135040768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (364us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838111.599000:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788838111.600956:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135040768:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788838111.601159:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788838111.601241:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0a00/0x88da08396ccc8a85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a8c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838111.601263:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0a00/0x88da08396ccc8a85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8a8c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838111.869299:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838111.869384:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116406272 00000100:00100000:3.0:1788838111.869394:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116406272 00000100:00100000:3.0:1788838111.869452:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1788838111.869462:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a3ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+5:42411:x1875729116406272:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838111.869477:0:89047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838111.869498:0:89047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff63297a600/0x88da08396ccc8a93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc98 expref: -99 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.869525:0:89047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff63297a600/0x88da08396ccc8a93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc98 expref: 6 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.869535:0:89047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff63297a600/0x88da08396ccc8a93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc98 expref: 6 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838111.869544:0:89047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63297a600, rc 0) 00000100:00100000:3.0:1788838111.869597:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a3ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116406272:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.869604:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1788838111.874000:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838111.874162:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116406400 00000100:00100000:0.0:1788838111.874182:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116406400 00000100:00100000:0.0:1788838111.874242:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:0.0:1788838111.874261:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a3eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116406400:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788838111.874287:0:89046:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788838111.874314:0:89046:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788838111.874318:0:89046:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788838111.874321:0:89046:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788838111.874331:0:89046:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788838111.874334:0:89046:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 117 00000100:00100000:0.0:1788838111.877621:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a3eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116406400:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 Request processed in 3352us (3619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.877636:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:0.0:1788838111.894939:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838111.897448:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116406528 00000100:00100000:2.0:1788838111.897462:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116406528 00000100:00100000:2.0:1788838111.897538:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1788838111.897549:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a3ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116406528:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.897569:0:89048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.897589:0:89048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5e400/0x88da08396ccc8a9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc9f expref: -99 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.897636:0:89048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5e400/0x88da08396ccc8a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc9f expref: 7 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.897648:0:89048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5e400/0x88da08396ccc8a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc9f expref: 7 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.897657:0:89048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5e400, rc 0) 00000100:00100000:2.0:1788838111.897727:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a3ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+7:42411:x1875729116406528:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 180us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.897734:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1788838111.900902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838111.901016:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116406656 00000100:00100000:0.0:1788838111.901026:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116406656 00000100:00100000:0.0:1788838111.901082:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:0.0:1788838111.901091:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+7:42411:x1875729116406656:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.901263:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116406656:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 172us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.901270:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1788838111.904112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838111.904220:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116406784 00000100:00100000:0.0:1788838111.904233:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116406784 00000100:00100000:0.0:1788838111.904309:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:0.0:1788838111.904321:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116406784:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838111.904489:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116406784:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 169us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838111.904498:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:3.0:1788838111.945878:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838111.945957:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116406912 00000100:00100000:2.0:1788838111.945969:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116406912 00000100:00100000:2.0:1788838111.946031:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:2.0:1788838111.946041:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116406912:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.946055:0:89048:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.946073:0:89048:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5fc00/0x88da08396ccc8aa1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cca6 expref: -99 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.946101:0:89048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5fc00/0x88da08396ccc8aa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cca6 expref: 9 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.946113:0:89048:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5fc00/0x88da08396ccc8aa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cca6 expref: 9 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.946123:0:89048:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5fc00, rc 0) 00000100:00100000:2.0:1788838111.946179:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116406912:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 139us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.946196:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:2.0:1788838111.952317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838111.952421:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116407040 00000100:00100000:3.0:1788838111.952433:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116407040 00000100:00100000:3.0:1788838111.952499:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1788838111.952509:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116407040:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838111.952893:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116407040:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 385us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838111.952902:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:0.0:1788838111.957325:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838111.958122:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116407168 00000100:00100000:2.0:1788838111.958141:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116407168 00000100:00100000:2.0:1788838111.958643:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:2.0:1788838111.958654:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116407168:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838111.958960:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116407168:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 307us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.958968:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1788838111.977020:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838111.977078:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116407296 00000100:00100000:2.0:1788838111.977087:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116407296 00000100:00100000:2.0:1788838111.977140:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:2.0:1788838111.977149:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116407296:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838111.977165:0:89046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838111.977181:0:89046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff61de5ec00/0x88da08396ccc8aa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccad expref: -99 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.977210:0:89046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff61de5ec00/0x88da08396ccc8aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccad expref: 10 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.977222:0:89046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff61de5ec00/0x88da08396ccc8aa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccad expref: 10 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838111.977231:0:89046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff61de5ec00, rc 0) 00000100:00100000:2.0:1788838111.977287:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116407296:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 139us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838111.977312:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:2.0:1788838111.983270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838111.987002:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116407424 00000100:00100000:1.0:1788838111.987032:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116407424 00000100:00100000:1.0:1788838111.987114:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:1.0:1788838111.987125:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116407424:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838111.987312:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503696050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116407424:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 188us (4049us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838111.987320:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00010000:00010000:2.0:1788838112.253138:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838113.279217:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838113.660997:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135040896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838113.661075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838113.661170:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135040896 00000100:00100000:1.0:1788838113.661178:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135040896 00000100:00100000:1.0:1788838113.661247:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1788838113.661257:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135040896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838113.661325:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838113.661371:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135040896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838113.661379:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00080000:2.0:1788838113.661426:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838113.661459:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135040896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838113.662079:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135041024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838113.662111:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838113.662144:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135041024 00000100:00100000:1.0:1788838113.662148:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135041024 00000100:00100000:1.0:1788838113.662176:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:1.0:1788838113.662182:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135041024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838113.662200:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838113.662231:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135041024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838113.662335:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00080000:1.0:1788838113.662352:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838113.662375:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135041024:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788838114.302344:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838115.199663:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135041152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838115.199871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.199971:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135041152 00000100:00100000:1.0:1788838115.199981:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135041152 00000100:00100000:1.0:1788838115.200048:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4087 00000100:00100000:1.0:1788838115.200058:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135041152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838115.200113:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:1.0:1788838115.200167:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135041152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838115.200175:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4087 00000100:00100000:1.0:1788838115.200242:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135041152:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788838115.206056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838115.206064:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838115.206068:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838115.206076:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3503 00000100:00080000:3.0:1788838115.206080:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838115.206088:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838115.206095:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135041280:0@lo:400:kworker.0 00000100:00100000:3.0:1788838115.206108:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63956b800 x1875729135041408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838115.206132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838115.206135:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838115.206137:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838115.206141:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3503 00000100:00080000:3.0:1788838115.206143:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838115.206147:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838115.206158:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640e57100 x1875729135041664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838115.206178:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838115.206189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838115.206191:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838115.206195:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3503 00000100:00080000:3.0:1788838115.206197:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838115.206201:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838115.206214:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd7b80 x1875729135041920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838115.206262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838115.206265:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838115.206267:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838115.206269:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3503 00000100:00080000:3.0:1788838115.206272:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838115.206274:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838115.206283:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd4000 x1875729135042304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838115.206300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788838115.206303:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838115.206304:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff50a580000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838115.206308:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff50a580000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838115.206320:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504d7a300 x1875729135042688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838115.206401:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135041408:0@lo:38:kworker.0 00000100:00100000:1.0:1788838115.206481:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.206528:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135041664:0@lo:38:kworker.0 00000100:00100000:1.0:1788838115.206554:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.206573:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135041920:0@lo:38:kworker.0 00000100:00100000:1.0:1788838115.206598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.206616:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135042304:0@lo:38:kworker.0 00000100:00100000:1.0:1788838115.206651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.206666:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135042688:0@lo:38:kworker.0 00000100:00100000:1.0:1788838115.206699:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.206750:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135041408 00000100:00100000:1.0:1788838115.206758:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135041408 00000100:00100000:1.0:1788838115.206784:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135041664 00000100:00100000:1.0:1788838115.206788:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135041664 00000100:00100000:3.0:1788838115.206826:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135042304 00000100:00100000:3.0:1788838115.206831:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135042304 00000100:00100000:3.0:1788838115.206845:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135042688 00000100:00100000:3.0:1788838115.206847:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135042688 00000100:00100000:3.0:1788838115.206868:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1788838115.206875:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135041408:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788838115.206901:0:66255:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3509 last 0 00000100:00100000:1.0:1788838115.206913:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1788838115.206918:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135041664:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788838115.206931:0:67312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3509 last 0 00000020:00000080:3.0:1788838115.206936:0:66255:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88da08396ccc8aaf 00000020:00000080:1.0:1788838115.206953:0:67312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88da08396ccc8ab6 00000004:00100000:3.0:1788838115.206965:0:66255:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00100000:1.0:1788838115.206965:0:67312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838115.207365:0:66255:0:(import.c:65:import_set_state_nolock()) ffff8ff6048e2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838115.207580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838115.207638:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135042176:0@lo:400:kworker.0 00000100:00100000:2.0:1788838115.207665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838115.207686:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788838115.207692:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135041536:0@lo:400:kworker.0 00000100:00100000:2.0:1788838115.207722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838115.207736:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135042432:0@lo:400:kworker.0 00000100:00100000:2.0:1788838115.207758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838115.207795:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135042176 00000100:00100000:2.0:1788838115.207821:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135042176 00000100:00100000:2.0:1788838115.207872:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135042432 00000100:00100000:2.0:1788838115.207876:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135042432 00000100:00100000:2.0:1788838115.207920:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:2.0:1788838115.207929:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135042176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838115.207985:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135042176:12345-0@lo:400:kworker.0 Request processed in 58us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838115.208007:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:2.0:1788838115.208026:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:2.0:1788838115.208032:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135042432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838115.208066:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135042432:12345-0@lo:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838115.208071:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1788838115.208593:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135041280 00000100:00100000:0.0:1788838115.208599:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135041280 00000100:00080000:1.0:1788838115.208754:0:67312:0:(import.c:65:import_set_state_nolock()) ffff8ff6104df800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838115.208835:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875729135041664:12345-0@lo:38:kworker.0 Request processed in 1914us (2279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838115.208844:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1788838115.208863:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135041536 00000100:00100000:1.0:1788838115.208866:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135041536 00000100:00100000:1.0:1788838115.208887:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1788838115.209014:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135041536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838115.209052:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135041536:12345-0@lo:400:kworker.0 Request processed in 158us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838115.209058:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1788838115.209073:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1788838115.209078:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135042304:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788838115.209101:0:67312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3509 last 0 00000020:00000080:1.0:1788838115.209213:0:67312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x88da08396ccc8abd 00000004:00100000:1.0:1788838115.209236:0:67312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788838115.209273:0:67312:0:(import.c:65:import_set_state_nolock()) ffff8ff6104d9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838115.209535:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875729135042304:12345-0@lo:38:kworker.0 Request processed in 453us (2881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838115.209542:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1788838115.209565:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1788838115.209569:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135042688:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788838115.209587:0:67312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3509 last 0 00000020:00000080:1.0:1788838115.209609:0:67312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88da08396ccc8ac4 00000004:00100000:1.0:1788838115.209617:0:67312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788838115.209775:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135042432:0@lo:400:kworker.0 00000100:00100000:2.0:1788838115.209810:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135042176:0@lo:400:kworker.0 00000100:00100000:2.0:1788838115.209843:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135041536:0@lo:400:kworker.0 00000100:00080000:1.0:1788838115.209998:0:67312:0:(import.c:65:import_set_state_nolock()) ffff8ff632fef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838115.210041:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729135042688:12345-0@lo:38:kworker.0 Request processed in 469us (3340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838115.210048:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1788838115.210077:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135041920 00000100:00100000:1.0:1788838115.210082:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135041920 00000100:00100000:0.0:1788838115.210235:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788838115.210248:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135041280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838115.210378:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503695850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135041280:12345-0@lo:400:kworker.0 Request processed in 133us (2798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838115.210385:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788838115.210432:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135041280:0@lo:400:kworker.0 00000100:00100000:1.0:1788838115.211017:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088 00000100:00100000:1.0:1788838115.211024:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135041920:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788838115.211050:0:23765:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8ff609257000, cookie 0x88da08396ccc8919 00010000:00080000:1.0:1788838115.211056:0:23765:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378651 exp ffff8ff609257000 cur 3509 last 1788838109 00000004:00100000:1.0:1788838115.211071:0:23765:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788838115.211101:0:23765:0:(import.c:65:import_set_state_nolock()) ffff8ff5031c0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838115.211440:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135041920:12345-0@lo:38:kworker.0 Request processed in 414us (4840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838115.211448:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088 00000100:00080000:1.0:1788838115.211489:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838115.211495:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838115.211506:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788838115.211526:0:89074:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788838115.211532:0:89074:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 107374182407 00000020:00080000:1.0:1788838115.211538:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838115.211542:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182407, next_transno: 107374182407 00010000:00080000:1.0:1788838115.211546:0:89074:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (107374182407) 00000020:00080000:1.0:1788838115.211548:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838115.211559:0:89074:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116399360 t107374182407 from 192.168.203.30@tcp req@ffff8ff62bd6fb80 x1875729116399360/t0(107374182407) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:11/0 lens 528/0 e 0 to 0 dl 1788838121 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838115.211630:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135041792:0@lo:400:kworker.0 00000100:00100000:1.0:1788838115.211669:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.211693:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135042560:0@lo:400:kworker.0 00000100:00100000:1.0:1788838115.211718:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.211740:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838115.211746:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135042048:0@lo:400:kworker.0 00000100:00100000:1.0:1788838115.211766:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.211793:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135042560 00000100:00100000:1.0:1788838115.211817:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135042560 00000100:00100000:1.0:1788838115.211854:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135042048 00000100:00100000:1.0:1788838115.211858:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135042048 00000100:00100000:1.0:1788838115.211879:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:1.0:1788838115.211886:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135042560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838115.212458:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875729135041408:12345-0@lo:38:kworker.0 Request processed in 5579us (5974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838115.212470:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1788838115.212497:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135041792 00000100:00100000:3.0:1788838115.212501:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135041792 00000100:00100000:3.0:1788838115.212599:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1788838115.212606:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135041792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838115.212649:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135041792:12345-0@lo:400:kworker.0 Request processed in 43us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838115.212655:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1788838115.212679:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:3.0:1788838115.212701:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135042048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838115.212735:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135042048:12345-0@lo:400:kworker.0 Request processed in 50us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838115.212741:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:1.0:1788838115.212924:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135042560:12345-0@lo:400:kworker.0 Request processed in 1037us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838115.212931:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00080000:1.0:1788838115.212952:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838115.212956:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838115.212970:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838115.213012:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135042048:0@lo:400:kworker.0 00000100:00100000:1.0:1788838115.213025:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135041792:0@lo:400:kworker.0 00000100:00100000:1.0:1788838115.213035:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135042560:0@lo:400:kworker.0 00010000:00080000:1.0:1788838115.213358:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff63956b800 x1875729135041408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838115.213373:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00080000:1.0:1788838115.214176:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8ff63956b800 x1875729135041408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838140 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838115.214187:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788838115.214193:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788838115.214197:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788838115.214203:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135041408:0@lo:38:kworker.0 00010000:00080000:1.0:1788838115.218212:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff640e57100 x1875729135041664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838115.218249:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00080000:1.0:1788838115.219698:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8ff640e57100 x1875729135041664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838140 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838115.219710:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788838115.219716:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788838115.219720:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788838115.219727:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135041664:0@lo:38:kworker.0 00000100:00080000:1.0:1788838115.219762:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:1.0:1788838115.219779:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788838115.219783:0:3642:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1788838115.219786:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:1.0:1788838115.219791:0:3642:0:(recover.c:53:ptlrpc_replay_next()) import ffff8ff6061da800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:1.0:1788838115.219794:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000004:00080000:2.0:1788838115.228608:0:89074:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16998us 00000100:00100000:0.0:1788838115.228881:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135041920:0@lo:38:kworker.0 00010000:00080000:0.0:1788838115.228924:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff609dd4000 x1875729135042304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838115.228943:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00000100:00080000:0.0:1788838115.229723:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8ff609dd4000 x1875729135042304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838140 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838115.229733:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788838115.229738:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788838115.229741:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788838115.229747:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135042304:0@lo:38:kworker.0 00010000:00080000:0.0:1788838115.229772:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff504d7a300 x1875729135042688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838115.229783:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:0.0:1788838115.229790:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788838115.229793:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788838115.229823:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff50a580000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788838115.229828:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135042688:0@lo:38:kworker.0 00010000:00080000:0.0:1788838115.229883:0:89311:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788838115.229886:0:89311:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788838115.229905:0:89311:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1788838115.230321:0:89311:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1788838115.230379:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135042816:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788838115.230443:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.238942:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135042816 00000100:00100000:1.0:1788838115.238959:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135042816 00000100:00100000:1.0:1788838115.239029:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089 00000100:00100000:1.0:1788838115.239041:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135042816:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788838115.239067:0:37907:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff62bd6e300 x1875729135042816/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:16/0 lens 224/0 e 0 to 0 dl 1788838126 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838115.239079:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135042816:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 42us (8637us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838115.239087:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089 00010000:00010000:2.0:1788838115.259995:0:89074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8acb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260024:0:89074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8acb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260041:0:89074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8acb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260056:0:89074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260064:0:89074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260070:0:89074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260587:0:89074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8acb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260597:0:89074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8acb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260603:0:89074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8acb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260610:0:89074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838115.260615:0:89074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8acb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260622:0:89074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8acb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260636:0:89074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff640e86c00) 00010000:00010000:2.0:1788838115.260639:0:89074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838115.260643:0:89074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8acb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260648:0:89074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f800/0x88da08396ccc8acb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838115.260664:0:89074:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a6fe94c reply state 000000007dfdaccf transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260675:0:89074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.260681:0:89074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff640e86b00) 00010000:00010000:2.0:1788838115.260691:0:89074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838115.260694:0:89074:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788838115.260870:0:89074:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788838115.260897:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838115.260901:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000020:00080000:2.0:1788838115.260907:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838115.260909:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000001:00080000:2.0:1788838115.270826:0:89041:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:3.0:1788838115.270928:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.270943:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.270968:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.270974:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5e000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838115.270979:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.270988:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.271013:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff640e86b00) 00010000:00010000:3.0:1788838115.271016:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838115.271021:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.271027:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5e000/0x88da08396ccc8ad2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838115.272647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838115.272736:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116399872 00000100:00100000:3.0:1788838115.272746:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116399872 00000100:00100000:3.0:1788838115.272832:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1201 00000100:00100000:3.0:1788838115.272844:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116399872:12345-192.168.203.30@tcp:36:rm.0 00010000:00080000:3.0:1788838115.272863:0:76060:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:3.0:1788838115.272878:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116399872:12345-192.168.203.30@tcp:36:rm.0 Request processed in 38us (239us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838115.272884:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1201 00000020:00080000:2.0:1788838115.272940:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838115.272945:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:2.0:1788838115.272950:0:89074:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:2.0:1788838115.272954:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838115.272965:0:89074:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116399872 t107374182408 from 192.168.203.30@tcp req@ffff8ff503f45c00 x1875729116399872/t0(107374182408) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:16/0 lens 512/0 e 0 to 0 dl 1788838126 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788838115.273072:0:89074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f400/0x88da08396ccc8ad9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273091:0:89074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f400/0x88da08396ccc8ad9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273102:0:89074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f400/0x88da08396ccc8ad9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273127:0:89074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273135:0:89074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273159:0:89074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273259:0:89074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8ae7 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273267:0:89074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8ae7 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273274:0:89074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8ae7 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273540:0:89074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8ae7 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273550:0:89074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8ae7 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273556:0:89074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8ae7 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273564:0:89074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838115.273567:0:89074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8ae7 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273575:0:89074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8ae7 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273586:0:89074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff8ff63f831300) 00010000:00010000:2.0:1788838115.273589:0:89074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788838115.273593:0:89074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8ae7 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273606:0:89074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8ae7 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273627:0:89074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f400/0x88da08396ccc8ad9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273633:0:89074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f400/0x88da08396ccc8ad9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273639:0:89074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f400/0x88da08396ccc8ad9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273644:0:89074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5f400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838115.273647:0:89074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f400/0x88da08396ccc8ad9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273653:0:89074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f400/0x88da08396ccc8ad9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273661:0:89074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831d00) 00010000:00010000:2.0:1788838115.273664:0:89074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838115.273666:0:89074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f400/0x88da08396ccc8ad9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273672:0:89074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5f400/0x88da08396ccc8ad9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838115.273683:0:89074:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082ad3d6d reply state 0000000023a505cc transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273693:0:89074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.273707:0:89074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff63f831100) 00010000:00010000:2.0:1788838115.273710:0:89074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838115.273712:0:89074:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788838115.273838:0:89074:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788838115.273861:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838115.273864:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:2.0:1788838115.273868:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838115.273870:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:2.0:1788838115.276490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838115.276582:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116401280 00000100:00100000:3.0:1788838115.276592:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116401280 00000100:00100000:3.0:1788838115.276661:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1202 00000100:00100000:3.0:1788838115.276673:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2403:x1875729116401280:12345-192.168.203.30@tcp:36:dd.0 00010000:00080000:3.0:1788838115.276695:0:66253:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182410, replaying 00000100:00100000:3.0:1788838115.276724:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2403:x1875729116401280:12345-192.168.203.30@tcp:36:dd.0 Request processed in 54us (242us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838115.276732:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1202 00000020:00080000:3.0:1788838115.276752:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838115.276756:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182410, next_transno: 107374182409 00010000:00080000:3.0:1788838115.276762:0:89074:0:(ldlm_lib.c:2284:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182409, ql: 1, comp: 1, conn: 2, next: 107374182410, next_update 0 last_committed: 107374182407) 00000020:00080000:3.0:1788838115.276768:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838115.276776:0:89074:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116401280 t107374182410 from 192.168.203.30@tcp req@ffff8ff503f44a80 x1875729116401280/t0(107374182410) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:16/0 lens 488/0 e 0 to 0 dl 1788838126 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788838115.277022:0:89074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.277040:0:89074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.277052:0:89074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838115.277163:0:89074:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8678b59 reply state 000000009aa16b04 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.277175:0:89074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.277183:0:89074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff60574c300) 00010000:00010000:3.0:1788838115.277191:0:89074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838115.277194:0:89074:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788838115.277310:0:89074:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788838115.277323:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838115.277326:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000020:00080000:3.0:1788838115.277329:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838115.277331:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000100:00100000:3.0:1788838115.280609:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838115.282336:0:66268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116401536 00000100:00100000:0.0:1788838115.282355:0:66268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116401536 00000100:00100000:0.0:1788838115.282443:0:66268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1788838115.282455:0:66268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2403:x1875729116401536:12345-192.168.203.30@tcp:10:dd.0 00010000:00080000:0.0:1788838115.282481:0:66268:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 107374182411, current: 107374182411, replaying 00000100:00100000:0.0:1788838115.282505:0:66268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2403:x1875729116401536:12345-192.168.203.30@tcp:10:dd.0 Request processed in 52us (1902us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838115.282515:0:66268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000020:00080000:3.0:1788838115.282564:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838115.282569:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182411, next_transno: 107374182411 00010000:00080000:3.0:1788838115.282574:0:89074:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (107374182411) 00000020:00080000:3.0:1788838115.282577:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838115.282590:0:89074:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116401536 t107374182411 from 192.168.203.30@tcp req@ffff8ff504d79180 x1875729116401536/t0(107374182411) o10->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:16/0 lens 440/0 e 0 to 0 dl 1788838126 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838115.282888:0:89074:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788838115.282905:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838115.282908:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000020:00080000:3.0:1788838115.282911:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838115.282913:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000100:00100000:3.0:1788838115.303936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838115.303982:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116407552 00000100:00100000:3.0:1788838115.303991:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116407552 00000100:00100000:3.0:1788838115.304050:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1203 00000100:00100000:3.0:1788838115.304064:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2403:x1875729116407552:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788838115.304692:0:75504:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff504d7a300 x1875729116407552/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:16/0 lens 328/0 e 0 to 0 dl 1788838126 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838115.304748:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2403:x1875729116407552:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 687us (827us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838115.304756:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1203 00000020:00080000:2.0:1788838115.306325:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838115.306339:0:89074:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182412 00010000:00080000:2.0:1788838115.306344:0:89074:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788838115.306348:0:89074:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838115.306361:0:89074:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788838115.306366:0:89074:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788838115.306385:0:89074:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff504d7a300 x1875729116407552/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:16/0 lens 328/0 e 0 to 0 dl 1788838126 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788838115.306424:0:89074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838115.306463:0:89074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 2/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cc8a expref: -99 pid: 89074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.306507:0:89074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 12 pid: 89074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.306522:0:89074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 12 pid: 89074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.306550:0:89074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8000, rc 0) 00010000:00080000:2.0:1788838115.306655:0:89074:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788838115.306677:0:89074:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788838115.310739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838115.317309:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116407680 00000100:00100000:0.0:1788838115.317325:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116407680 00000100:00100000:0.0:1788838115.317404:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1202 00000100:00100000:0.0:1788838115.317414:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2403:x1875729116407680:12345-192.168.203.30@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1788838115.317437:0:76060:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff5071cf480 x1875729116407680/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:16/0 lens 224/0 e 0 to 0 dl 1788838126 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838115.317462:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2403:x1875729116407680:12345-192.168.203.30@tcp:400:ptlrpcd_rcv.0 Request processed in 50us (6733us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838115.317469:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1202 00010000:00080000:0.0:1788838115.317488:0:89074:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788838115.317605:0:89074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:2.0:1788838115.319482:0:89041:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00100000:2.0:1788838115.319493:0:89041:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788838115.319537:0:89041:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182411 is committed 00000001:00080000:0.0:1788838115.319969:0:89074:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788838115.320017:0:89074:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788838115.320046:0:89074:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8ff62bd6e300 x1875729135042816/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:16/0 lens 224/0 e 0 to 0 dl 1788838126 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788838115.320184:0:89074:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.30@tcp: req@ffff8ff5071cf480 x1875729116407680/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:16/0 lens 224/0 e 0 to 0 dl 1788838126 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788838115.320252:0:89074:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1788838115.320275:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788838115.320295:0:3642:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8ff62bd6c380 x1875729135042816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838131 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838115.320306:0:3642:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8ff62bd6c380 x1875729135042816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838131 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838115.320315:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788838115.320329:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788838115.320334:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135042816:0@lo:400:ldlm_lock_repla.0 00010000:00010000:3.0:1788838115.321053:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321069:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321077:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321083:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff61de5ee00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838115.321089:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321097:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321116:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff63f831100) 00010000:00010000:3.0:1788838115.321119:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838115.321125:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321132:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff61de5ee00/0x88da08396ccc8ae0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321157:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321173:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321179:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321183:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297bc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838115.321187:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321193:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321201:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff60574c300) 00010000:00010000:3.0:1788838115.321204:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838115.321207:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.321213:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63297bc00/0x88da08396ccc8aee lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89074 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838115.326646:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135042944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838115.327042:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838115.327099:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135042944 00000100:00100000:3.0:1788838115.327118:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135042944 00000100:00100000:3.0:1788838115.327167:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4090 00000100:00100000:3.0:1788838115.327177:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135042944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838115.327209:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445085184 avail 1298845696 00000100:00100000:3.0:1788838115.327276:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135042944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838115.329025:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4090 00000100:00100000:2.0:1788838115.329751:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135042944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838115.333269:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838115.333329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838115.333365:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116402688 00000100:00100000:3.0:1788838115.333376:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116402688 00000100:00100000:3.0:1788838115.333434:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1204 00000100:00100000:3.0:1788838115.333444:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116402688:12345-192.168.203.30@tcp:16:kworker.0 00000100:00100000:3.0:1788838115.333569:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116402688:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 126us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838115.333577:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1204 00000100:00100000:2.0:1788838115.333838:0:66266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116402560 00000100:00100000:2.0:1788838115.333844:0:66266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116402560 00002000:00100000:2.0:1788838115.333873:0:66266:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff8ff63a360e00 x1875729116402560/t0(0) o4->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:16/0 lens 496/0 e 0 to 0 dl 1788838126 ref 1 fl New:/602/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788838115.333884:0:66266:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8ff63a360e00 with x1875729116402560 00002000:00010000:2.0:1788838115.333906:0:66266:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 7 pid: 89074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838115.333935:0:66266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1788838115.333959:0:66266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116402560:12345-192.168.203.30@tcp:4:dd.0 00000100:00100000:2.0:1788838115.336726:0:66266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:2406:x1875729116402560:12345-192.168.203.30@tcp:4:dd.0 Request processed in 2756us (3458us total) trans 111669149697 rc 0/0 00000100:00100000:2.0:1788838115.336740:0:66266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00002000:00100000:2.0:1788838115.336753:0:66266:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff8ff63a360e00 x1875729116402560/t111669149697(0) o4->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:16/0 lens 496/448 e 0 to 0 dl 1788838126 ref 1 fl Complete:/602/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788838115.336763:0:66266:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8ff63a360e00 with x1875729116402560 00002000:00010000:2.0:1788838115.336773:0:66266:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 9 pid: 89074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.361267:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788838115.374663:0:89074:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f518861fe10 00100000:10000000:2.0:1788838115.374679:0:89074:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1788838115.380186:0:89060:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:3.0:1788838115.380255:0:89060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a361f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89060:1875729135043072:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788838115.380328:0:89060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838115.380357:0:89060:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7300 going to sleep for 11 seconds 00000004:00080000:1.0:1788838115.380940:0:89062:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1788838115.380967:0:89062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604232a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89062:1875729135043200:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788838115.381014:0:89062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.381035:0:89062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838115.381057:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135043072 00000100:00100000:1.0:1788838115.381063:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135043072 00000100:00100000:1.0:1788838115.381105:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135043200 00000100:00100000:1.0:1788838115.381108:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135043200 00000100:00100000:1.0:1788838115.381129:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5941 00000100:00100000:1.0:1788838115.381137:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:89060:x1875729135043072:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788838115.381171:0:26214:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -625 00002000:02000040:1.0:1788838115.381176:0:26214:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:801) 00000100:00100000:0.0:1788838115.381275:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5942 00000100:00100000:0.0:1788838115.381285:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:89062:x1875729135043200:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788838115.381300:0:26220:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -127 00002000:02000040:0.0:1788838115.381303:0:26220:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:801) 00002000:00010000:1.0:1788838115.395878:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.395905:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc8afc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.395923:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x321:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.395928:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x321:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.395934:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc8afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.395951:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc8afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.395962:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc8afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.395970:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc8afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396272:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838115.396407:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.396413:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8b03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396422:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x320:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.396426:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x320:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.396430:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396454:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396470:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396477:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396490:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788838115.396534:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.396540:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8b0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396548:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31f:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.396551:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.396555:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8b0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396564:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8b0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396571:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8b0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396578:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8b0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396611:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788838115.396654:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.396659:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8b11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396668:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31e:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.396671:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.396675:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396685:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396693:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396700:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396714:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788838115.396755:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.396759:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc8b18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396767:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31d:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.396775:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.396779:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc8b18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396788:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc8b18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396831:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc8b18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396840:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc8b18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396848:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788838115.396889:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.396894:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc8b1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396902:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31c:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.396905:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.396909:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc8b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396916:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc8b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396924:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc8b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396938:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc8b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.396946:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788838115.397167:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788838115.397176:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc8afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397186:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.397190:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc8afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397198:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc8afc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397221:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc8afc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397254:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb379aef/0x88da08396ccc8afc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397285:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838115.397290:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397297:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.397300:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397308:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8b03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397319:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8b03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397327:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a0a8e91/0x88da08396ccc8b03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397340:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838115.397343:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8b0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397349:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.397360:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8b0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397368:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8b0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397379:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8b0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397387:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eee2fdb5/0x88da08396ccc8b0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397401:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838115.397404:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397411:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.397415:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397422:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8b11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397430:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8b11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397447:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000402a85a3/0x88da08396ccc8b11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397468:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838115.397472:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc8b18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397478:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.397481:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc8b18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397489:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc8b18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397499:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc8b18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397506:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a83939a/0x88da08396ccc8b18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397518:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838115.397521:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc8b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397527:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.397530:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc8b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397549:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc8b1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397560:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc8b1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397567:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc8b1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.397581:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.397583:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.397585:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.397778:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838115.397925:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.397932:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc8b26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.397942:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31b:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.397945:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.397949:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc8b26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.397958:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc8b26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.397966:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc8b26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.397973:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc8b26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.398006:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838115.398221:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838115.398238:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc8b26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.398247:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838115.398251:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc8b26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.398261:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc8b26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.398288:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc8b26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.398296:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000efe1c5/0x88da08396ccc8b26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.398710:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.398713:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.398715:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.398723:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.399740:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788838115.400512:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1788838115.400666:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.400678:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000231ee8b3/0x88da08396ccc8b2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400698:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31a:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.400703:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.400710:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000231ee8b3/0x88da08396ccc8b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400725:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000231ee8b3/0x88da08396ccc8b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400734:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000231ee8b3/0x88da08396ccc8b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400742:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000231ee8b3/0x88da08396ccc8b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400775:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838115.400854:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.400860:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a6d006f/0x88da08396ccc8b34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400868:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x319:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.400871:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x319:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.400875:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a6d006f/0x88da08396ccc8b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400883:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a6d006f/0x88da08396ccc8b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400891:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a6d006f/0x88da08396ccc8b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400898:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a6d006f/0x88da08396ccc8b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400912:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838115.400948:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.400953:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccd60e93/0x88da08396ccc8b3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400960:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x318:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.400970:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.400975:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd60e93/0x88da08396ccc8b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400985:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccd60e93/0x88da08396ccc8b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400992:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccd60e93/0x88da08396ccc8b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.400999:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd60e93/0x88da08396ccc8b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401013:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788838115.401053:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.401058:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000687867cc/0x88da08396ccc8b42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401066:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x317:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.401069:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x317:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.401074:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000687867cc/0x88da08396ccc8b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401082:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000687867cc/0x88da08396ccc8b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401090:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000687867cc/0x88da08396ccc8b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401248:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000687867cc/0x88da08396ccc8b42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401264:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788838115.401305:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.401310:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f0e273a/0x88da08396ccc8b49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401320:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x316:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.401323:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x316:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.401328:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f0e273a/0x88da08396ccc8b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.401328:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838115.401339:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000231ee8b3/0x88da08396ccc8b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401342:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f0e273a/0x88da08396ccc8b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.401363:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297bc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838115.401364:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f0e273a/0x88da08396ccc8b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.401370:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000231ee8b3/0x88da08396ccc8b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401374:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f0e273a/0x88da08396ccc8b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401394:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788838115.401432:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.401437:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c501ab8/0x88da08396ccc8b50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401453:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x315:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.401456:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x315:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.401460:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c501ab8/0x88da08396ccc8b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401468:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c501ab8/0x88da08396ccc8b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401475:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c501ab8/0x88da08396ccc8b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401483:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c501ab8/0x88da08396ccc8b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401492:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788838115.401529:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.401534:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf645de3/0x88da08396ccc8b57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401541:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x314:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.401544:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x314:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.401547:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf645de3/0x88da08396ccc8b57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401556:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf645de3/0x88da08396ccc8b57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401575:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf645de3/0x88da08396ccc8b57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401583:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf645de3/0x88da08396ccc8b57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401592:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788838115.401780:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.401786:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0f0d19/0x88da08396ccc8b5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401795:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x313:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.401818:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x313:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.401822:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f0f0d19/0x88da08396ccc8b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401831:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f0f0d19/0x88da08396ccc8b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401839:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f0f0d19/0x88da08396ccc8b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401847:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f0f0d19/0x88da08396ccc8b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401871:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788838115.401918:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.401924:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc8b65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401932:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x312:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.401935:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x312:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.401940:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc8b65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401950:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc8b65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401958:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc8b65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401964:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc8b65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.401974:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788838115.402007:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.402012:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb753c4/0x88da08396ccc8b6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.402019:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x311:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.402029:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.402033:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb753c4/0x88da08396ccc8b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.402042:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb753c4/0x88da08396ccc8b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.402049:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb753c4/0x88da08396ccc8b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.402057:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb753c4/0x88da08396ccc8b6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.402067:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:2.0:1788838115.402076:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000231ee8b3/0x88da08396ccc8b2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402115:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000231ee8b3/0x88da08396ccc8b2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402122:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000231ee8b3/0x88da08396ccc8b2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402181:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788838115.402185:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a6d006f/0x88da08396ccc8b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402192:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297a000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.402195:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a6d006f/0x88da08396ccc8b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402203:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a6d006f/0x88da08396ccc8b34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402214:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a6d006f/0x88da08396ccc8b34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402231:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a6d006f/0x88da08396ccc8b34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402247:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788838115.402251:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccd60e93/0x88da08396ccc8b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402263:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297a200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.402266:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd60e93/0x88da08396ccc8b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402273:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd60e93/0x88da08396ccc8b3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402284:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccd60e93/0x88da08396ccc8b3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402291:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccd60e93/0x88da08396ccc8b3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402306:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788838115.402309:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000687867cc/0x88da08396ccc8b42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402315:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297be00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.402318:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000687867cc/0x88da08396ccc8b42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402324:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000687867cc/0x88da08396ccc8b42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402333:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000687867cc/0x88da08396ccc8b42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402347:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000687867cc/0x88da08396ccc8b42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402360:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788838115.402364:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f0e273a/0x88da08396ccc8b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402370:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297b200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.402372:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f0e273a/0x88da08396ccc8b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402380:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f0e273a/0x88da08396ccc8b49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402390:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f0e273a/0x88da08396ccc8b49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402397:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f0e273a/0x88da08396ccc8b49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402411:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838115.402414:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c501ab8/0x88da08396ccc8b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.402421:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297b400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.402429:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c501ab8/0x88da08396ccc8b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838115.402990:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.402997:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc8b73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.403006:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x310:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.403009:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x310:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.403014:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc8b73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.403023:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc8b73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.403032:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc8b73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.403045:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc8b73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.403053:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788838115.403544:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c501ab8/0x88da08396ccc8b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403561:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c501ab8/0x88da08396ccc8b50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403569:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c501ab8/0x88da08396ccc8b50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403589:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838115.403593:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf645de3/0x88da08396ccc8b57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403599:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297ba00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.403603:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf645de3/0x88da08396ccc8b57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403609:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf645de3/0x88da08396ccc8b57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403618:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf645de3/0x88da08396ccc8b57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403623:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf645de3/0x88da08396ccc8b57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403643:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838115.403647:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f0f0d19/0x88da08396ccc8b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403653:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297b800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.403657:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0f0d19/0x88da08396ccc8b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403665:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f0f0d19/0x88da08396ccc8b5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403674:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f0f0d19/0x88da08396ccc8b5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403680:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f0f0d19/0x88da08396ccc8b5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403691:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838115.403695:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc8b65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403771:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.403775:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc8b65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403793:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc8b65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403819:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc8b65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403826:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba9984d/0x88da08396ccc8b65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403839:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838115.403842:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb753c4/0x88da08396ccc8b6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403847:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.403850:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb753c4/0x88da08396ccc8b6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403855:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb753c4/0x88da08396ccc8b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403863:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb753c4/0x88da08396ccc8b6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403869:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb753c4/0x88da08396ccc8b6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403892:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838115.403896:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc8b73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403902:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.403905:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc8b73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403914:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc8b73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403924:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc8b73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403930:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fee0e0d/0x88da08396ccc8b73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.403941:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.403943:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.403944:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.403958:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838115.406027:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.406042:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f5d4818/0x88da08396ccc8b7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.406060:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30f:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.406064:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.406071:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f5d4818/0x88da08396ccc8b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.406085:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f5d4818/0x88da08396ccc8b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.406096:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f5d4818/0x88da08396ccc8b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.406744:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f5d4818/0x88da08396ccc8b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.406773:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838115.406886:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.406893:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d30641b/0x88da08396ccc8b81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.406910:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30e:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.406914:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.406919:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d30641b/0x88da08396ccc8b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.406931:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d30641b/0x88da08396ccc8b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.406940:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d30641b/0x88da08396ccc8b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.406949:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d30641b/0x88da08396ccc8b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.406963:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838115.406999:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.407004:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ae1192/0x88da08396ccc8b88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.407012:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30d:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.407015:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.407018:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073ae1192/0x88da08396ccc8b88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.407026:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073ae1192/0x88da08396ccc8b88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.407044:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ae1192/0x88da08396ccc8b88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.407052:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073ae1192/0x88da08396ccc8b88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.407061:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788838115.407085:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838115.407095:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f5d4818/0x88da08396ccc8b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407106:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.407118:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f5d4818/0x88da08396ccc8b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407129:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f5d4818/0x88da08396ccc8b7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407146:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f5d4818/0x88da08396ccc8b7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407154:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f5d4818/0x88da08396ccc8b7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407174:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838115.407178:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d30641b/0x88da08396ccc8b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407185:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.407187:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d30641b/0x88da08396ccc8b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407194:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d30641b/0x88da08396ccc8b81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407203:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d30641b/0x88da08396ccc8b81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407210:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d30641b/0x88da08396ccc8b81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407239:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838115.407243:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073ae1192/0x88da08396ccc8b88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407249:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.407252:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ae1192/0x88da08396ccc8b88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407259:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ae1192/0x88da08396ccc8b88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407270:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073ae1192/0x88da08396ccc8b88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407278:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073ae1192/0x88da08396ccc8b88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.407290:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.407292:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.407293:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.407302:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838115.407960:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.407970:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d82f29a7/0x88da08396ccc8b8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.407983:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30c:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.407986:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.407990:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d82f29a7/0x88da08396ccc8b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408001:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d82f29a7/0x88da08396ccc8b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408011:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d82f29a7/0x88da08396ccc8b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408018:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d82f29a7/0x88da08396ccc8b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408051:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838115.408253:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838115.408255:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838115.408263:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc8b96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408264:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d82f29a7/0x88da08396ccc8b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408285:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30b:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:2.0:1788838115.408285:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838115.408290:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.408300:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc8b96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408301:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d82f29a7/0x88da08396ccc8b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408311:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d82f29a7/0x88da08396ccc8b8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408325:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d82f29a7/0x88da08396ccc8b8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408332:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d82f29a7/0x88da08396ccc8b8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408348:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.408350:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.408352:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.408710:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc8b96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408720:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc8b96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408728:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc8b96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408747:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838115.408818:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.408824:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc8b9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408834:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30a:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:2.0:1788838115.408834:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838115.408841:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc8b96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408845:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.408853:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc8b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408856:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.408862:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc8b96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408868:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc8b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408873:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc8b96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408881:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc8b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408890:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc8b96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408891:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc8b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408908:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838115.408908:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e28b6a5/0x88da08396ccc8b96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408928:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838115.408932:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc8b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408940:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.408944:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc8b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838115.408951:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838115.408953:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc8b9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408960:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098596178/0x88da08396ccc8ba4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408971:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc8b9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408973:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x309:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.408980:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.408984:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098596178/0x88da08396ccc8ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.408992:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098596178/0x88da08396ccc8ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.408997:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008264b728/0x88da08396ccc8b9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.409003:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098596178/0x88da08396ccc8ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.409014:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.409017:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.409018:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098596178/0x88da08396ccc8ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.409020:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.409029:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.409035:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838115.409038:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838115.409052:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098596178/0x88da08396ccc8ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.409060:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.409064:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098596178/0x88da08396ccc8ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.409071:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098596178/0x88da08396ccc8ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838115.409078:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838115.409086:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098596178/0x88da08396ccc8ba4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.409087:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b1fa70d/0x88da08396ccc8bab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.409106:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098596178/0x88da08396ccc8ba4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.409119:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.409121:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.409123:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.409213:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x308:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.409217:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x308:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.409230:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b1fa70d/0x88da08396ccc8bab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.409241:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b1fa70d/0x88da08396ccc8bab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.409249:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b1fa70d/0x88da08396ccc8bab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.409257:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b1fa70d/0x88da08396ccc8bab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.411055:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838115.411209:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.411219:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc8bb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.411266:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x307:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.411270:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x307:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.411278:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc8bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.411292:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc8bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.411312:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc8bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.411320:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc8bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838115.411963:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838115.411973:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5c1a54/0x88da08396ccc8bb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.411985:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x321:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:0.0:1788838115.411988:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x321:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838115.411992:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b5c1a54/0x88da08396ccc8bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.412006:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b5c1a54/0x88da08396ccc8bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.412016:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5c1a54/0x88da08396ccc8bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.412023:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b5c1a54/0x88da08396ccc8bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413632:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838115.413647:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b1fa70d/0x88da08396ccc8bab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413663:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.413668:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b1fa70d/0x88da08396ccc8bab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413695:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b1fa70d/0x88da08396ccc8bab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413719:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b1fa70d/0x88da08396ccc8bab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413726:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b1fa70d/0x88da08396ccc8bab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413750:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838115.413753:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc8bb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413760:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.413763:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc8bb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413771:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc8bb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413781:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc8bb2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413788:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838115.413792:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b5c1a54/0x88da08396ccc8bb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.413860:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.413867:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.413919:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718ee00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.413923:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5c1a54/0x88da08396ccc8bb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413931:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5c1a54/0x88da08396ccc8bb9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413943:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b5c1a54/0x88da08396ccc8bb9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.413952:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.413954:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.413956:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.416181:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788838115.416194:0:26214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085e64a5d/0x88da08396ccc8bb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.416259:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838115.416378:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.416385:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8bc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416398:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x306:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.416402:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x306:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.416408:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416430:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416440:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416447:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416470:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838115.416515:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.416520:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090f442d3/0x88da08396ccc8bc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416529:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x305:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.416532:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x305:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.416535:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090f442d3/0x88da08396ccc8bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416544:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090f442d3/0x88da08396ccc8bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416552:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090f442d3/0x88da08396ccc8bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416571:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090f442d3/0x88da08396ccc8bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416586:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788838115.416594:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838115.416600:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416609:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838115.416613:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416623:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8bc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416653:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8bc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416661:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092dcf804/0x88da08396ccc8bc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416676:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838115.416679:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090f442d3/0x88da08396ccc8bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416697:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838115.416711:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090f442d3/0x88da08396ccc8bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416720:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090f442d3/0x88da08396ccc8bc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416732:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090f442d3/0x88da08396ccc8bc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416739:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090f442d3/0x88da08396ccc8bc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416751:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.416753:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.416755:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838115.416815:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.416820:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb4b9c5d/0x88da08396ccc8bce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416829:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x304:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.416832:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x304:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.416836:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb4b9c5d/0x88da08396ccc8bce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416845:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb4b9c5d/0x88da08396ccc8bce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416859:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb4b9c5d/0x88da08396ccc8bce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416866:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb4b9c5d/0x88da08396ccc8bce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416880:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838115.416888:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838115.416892:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb4b9c5d/0x88da08396ccc8bce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416898:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f4e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838115.416902:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb4b9c5d/0x88da08396ccc8bce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416910:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb4b9c5d/0x88da08396ccc8bce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416920:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb4b9c5d/0x88da08396ccc8bce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416928:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb4b9c5d/0x88da08396ccc8bce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.416941:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.416948:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.416950:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838115.416990:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.416996:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc8bd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417004:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x303:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.417007:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x303:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.417011:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc8bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417019:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc8bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417026:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc8bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417033:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc8bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417044:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838115.417077:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838115.417082:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8bdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417090:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x302:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:3.0:1788838115.417093:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x302:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838115.417097:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8bdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.417112:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838115.417113:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8bdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.417123:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc8bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417125:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8bdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417146:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8bdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.417148:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059f5400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.417154:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc8bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417166:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838115.417166:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc8bd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417177:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838115.417182:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8bdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.417184:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc8bd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417198:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148e200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.417201:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b74810a8/0x88da08396ccc8bd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417203:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8bdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838115.417233:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8bdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.417241:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.417245:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.417247:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8bdc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.417248:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.417256:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8bdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.417258:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.417279:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.417281:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838115.417283:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838115.420279:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788838115.420294:0:26220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b5c1a54/0x88da08396ccc8bb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.420332:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838115.421099:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.421107:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe1d8ca/0x88da08396ccc8be3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421122:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x320:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.421127:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x320:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.421140:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efe1d8ca/0x88da08396ccc8be3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421155:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efe1d8ca/0x88da08396ccc8be3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421165:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe1d8ca/0x88da08396ccc8be3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421173:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efe1d8ca/0x88da08396ccc8be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421190:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838115.421199:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838115.421204:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efe1d8ca/0x88da08396ccc8be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421212:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.421217:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe1d8ca/0x88da08396ccc8be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421236:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe1d8ca/0x88da08396ccc8be3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421253:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efe1d8ca/0x88da08396ccc8be3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421272:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efe1d8ca/0x88da08396ccc8be3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421288:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.421290:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.421293:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838115.421343:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.421349:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083c36d9b/0x88da08396ccc8bea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421357:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31f:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.421361:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.421365:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083c36d9b/0x88da08396ccc8bea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421376:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083c36d9b/0x88da08396ccc8bea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421386:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083c36d9b/0x88da08396ccc8bea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421395:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083c36d9b/0x88da08396ccc8bea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.421411:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838115.421428:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838115.421434:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083c36d9b/0x88da08396ccc8bea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.422622:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.422628:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083c36d9b/0x88da08396ccc8bea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.422638:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083c36d9b/0x88da08396ccc8bea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.422657:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083c36d9b/0x88da08396ccc8bea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.422664:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083c36d9b/0x88da08396ccc8bea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.422684:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.422687:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.422689:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838115.424763:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.424774:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043de63f6/0x88da08396ccc8bf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.424793:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31e:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.424818:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.424826:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043de63f6/0x88da08396ccc8bf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.424859:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043de63f6/0x88da08396ccc8bf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.424869:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043de63f6/0x88da08396ccc8bf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.424875:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043de63f6/0x88da08396ccc8bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.424908:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838115.424947:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838115.424956:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043de63f6/0x88da08396ccc8bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.424966:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5c00 already unused, calling callback (ffffffffc0dd5350) 00002000:00010000:1.0:1788838115.424969:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838115.424972:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043de63f6/0x88da08396ccc8bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.424976:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da647b6/0x88da08396ccc8bf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.424996:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043de63f6/0x88da08396ccc8bf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.424999:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31d:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.425007:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.425015:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000da647b6/0x88da08396ccc8bf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425038:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000da647b6/0x88da08396ccc8bf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425048:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da647b6/0x88da08396ccc8bf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.425050:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043de63f6/0x88da08396ccc8bf1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.425066:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043de63f6/0x88da08396ccc8bf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425088:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000da647b6/0x88da08396ccc8bf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.425097:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.425100:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838115.425106:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788838115.425115:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000da647b6/0x88da08396ccc8bf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.425124:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.425128:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000da647b6/0x88da08396ccc8bf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.425136:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000da647b6/0x88da08396ccc8bf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.425146:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000da647b6/0x88da08396ccc8bf8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.425152:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000da647b6/0x88da08396ccc8bf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.425164:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.425172:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.425174:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788838115.425214:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788838115.425238:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838115.425253:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.425259:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1d7021a/0x88da08396ccc8bff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425268:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31c:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.425275:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.425279:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d7021a/0x88da08396ccc8bff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425299:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1d7021a/0x88da08396ccc8bff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425307:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1d7021a/0x88da08396ccc8bff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425313:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1d7021a/0x88da08396ccc8bff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425335:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838115.425373:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.425378:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b710050e/0x88da08396ccc8c06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425391:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31b:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.425394:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.425397:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b710050e/0x88da08396ccc8c06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425405:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b710050e/0x88da08396ccc8c06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425412:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b710050e/0x88da08396ccc8c06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425418:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b710050e/0x88da08396ccc8c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425433:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788838115.425442:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838115.425446:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1d7021a/0x88da08396ccc8bff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425452:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.425455:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1d7021a/0x88da08396ccc8bff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425463:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1d7021a/0x88da08396ccc8bff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425487:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1d7021a/0x88da08396ccc8bff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425495:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1d7021a/0x88da08396ccc8bff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425510:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838115.425514:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b710050e/0x88da08396ccc8c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425521:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.425525:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b710050e/0x88da08396ccc8c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425534:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b710050e/0x88da08396ccc8c06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425545:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b710050e/0x88da08396ccc8c06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425552:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b710050e/0x88da08396ccc8c06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425564:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.425566:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.425575:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838115.425628:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.425633:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f7697ec/0x88da08396ccc8c0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425641:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31a:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.425644:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.425647:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f7697ec/0x88da08396ccc8c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425656:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f7697ec/0x88da08396ccc8c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425663:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f7697ec/0x88da08396ccc8c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425670:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f7697ec/0x88da08396ccc8c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425681:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838115.425719:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.425724:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354e1db9/0x88da08396ccc8c14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425732:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x319:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.425735:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x319:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.425739:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354e1db9/0x88da08396ccc8c14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425759:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000354e1db9/0x88da08396ccc8c14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425768:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354e1db9/0x88da08396ccc8c14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425775:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000354e1db9/0x88da08396ccc8c14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425787:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788838115.425852:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.425857:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019393b7a/0x88da08396ccc8c1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425865:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x318:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.425869:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.425873:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019393b7a/0x88da08396ccc8c1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425883:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019393b7a/0x88da08396ccc8c1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425891:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019393b7a/0x88da08396ccc8c1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425910:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019393b7a/0x88da08396ccc8c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425931:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788838115.425982:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.425988:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb09f945/0x88da08396ccc8c22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.425995:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x317:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.425998:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x317:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.426001:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb09f945/0x88da08396ccc8c22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426009:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb09f945/0x88da08396ccc8c22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426016:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb09f945/0x88da08396ccc8c22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426022:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb09f945/0x88da08396ccc8c22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426030:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788838115.426041:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788838115.426049:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f7697ec/0x88da08396ccc8c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426059:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838115.426063:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f7697ec/0x88da08396ccc8c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838115.426069:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838115.426072:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f7697ec/0x88da08396ccc8c0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426077:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc8c29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426087:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f7697ec/0x88da08396ccc8c0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426094:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x316:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.426102:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x316:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.426107:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc8c29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426116:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc8c29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426124:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc8c29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426132:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc8c29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426140:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788838115.426181:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.426188:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b71cdb93/0x88da08396ccc8c30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426196:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x315:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.426199:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x315:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.426203:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71cdb93/0x88da08396ccc8c30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426212:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71cdb93/0x88da08396ccc8c30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426245:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b71cdb93/0x88da08396ccc8c30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426253:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b71cdb93/0x88da08396ccc8c30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426264:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788838115.426321:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.426327:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc8c37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426335:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x314:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.426338:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x314:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.426341:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc8c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426352:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc8c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426361:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc8c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426368:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc8c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426392:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788838115.426443:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.426450:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc8c3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426459:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x313:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.426463:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x313:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.426468:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc8c3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426479:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc8c3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426487:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc8c3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426495:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc8c3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426505:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788838115.426552:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.426557:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015587dc5/0x88da08396ccc8c45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426566:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x312:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.426576:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x312:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.426582:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015587dc5/0x88da08396ccc8c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426592:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015587dc5/0x88da08396ccc8c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426601:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015587dc5/0x88da08396ccc8c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426609:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015587dc5/0x88da08396ccc8c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426620:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1788838115.426669:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.426674:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dfcccd1/0x88da08396ccc8c4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426681:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x311:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.426684:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.426687:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dfcccd1/0x88da08396ccc8c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426696:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dfcccd1/0x88da08396ccc8c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426696:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f7697ec/0x88da08396ccc8c0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426706:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dfcccd1/0x88da08396ccc8c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426718:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dfcccd1/0x88da08396ccc8c4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426727:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788838115.426764:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.426773:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005664f87e/0x88da08396ccc8c53 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426782:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x310:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.426786:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x310:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838115.426787:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788838115.426791:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005664f87e/0x88da08396ccc8c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426793:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000354e1db9/0x88da08396ccc8c14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426829:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005664f87e/0x88da08396ccc8c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426842:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005664f87e/0x88da08396ccc8c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426849:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.426853:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005664f87e/0x88da08396ccc8c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426855:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000354e1db9/0x88da08396ccc8c14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426878:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000354e1db9/0x88da08396ccc8c14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426880:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:0.0:1788838115.426897:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000354e1db9/0x88da08396ccc8c14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426904:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000354e1db9/0x88da08396ccc8c14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426919:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788838115.426923:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019393b7a/0x88da08396ccc8c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838115.426926:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838115.426931:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.426935:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000366bdbcb/0x88da08396ccc8c5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426936:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019393b7a/0x88da08396ccc8c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.426948:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019393b7a/0x88da08396ccc8c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426958:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30f:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.426963:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838115.426964:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019393b7a/0x88da08396ccc8c1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426968:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000366bdbcb/0x88da08396ccc8c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426987:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000366bdbcb/0x88da08396ccc8c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.426994:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000366bdbcb/0x88da08396ccc8c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427002:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000366bdbcb/0x88da08396ccc8c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427010:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788838115.427051:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.427056:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df95a8c/0x88da08396ccc8c61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427064:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30e:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.427066:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.427070:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005df95a8c/0x88da08396ccc8c61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427077:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005df95a8c/0x88da08396ccc8c61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427096:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df95a8c/0x88da08396ccc8c61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427103:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005df95a8c/0x88da08396ccc8c61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427112:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1788838115.427149:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.427153:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc8c68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427161:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30d:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.427164:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.427168:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc8c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427177:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc8c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427185:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc8c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427191:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc8c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427210:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1788838115.427266:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.427270:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb3860a2/0x88da08396ccc8c6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427279:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30c:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.427281:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.427285:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb3860a2/0x88da08396ccc8c6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427294:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb3860a2/0x88da08396ccc8c6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427302:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb3860a2/0x88da08396ccc8c6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427309:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb3860a2/0x88da08396ccc8c6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427318:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1788838115.427356:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.427361:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002598d5d7/0x88da08396ccc8c76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427369:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30b:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.427380:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838115.427386:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019393b7a/0x88da08396ccc8c1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427387:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002598d5d7/0x88da08396ccc8c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427410:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002598d5d7/0x88da08396ccc8c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427416:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1788838115.427419:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002598d5d7/0x88da08396ccc8c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427422:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb09f945/0x88da08396ccc8c22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427437:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002598d5d7/0x88da08396ccc8c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427439:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838115.427445:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb09f945/0x88da08396ccc8c22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427457:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:0.0:1788838115.427458:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb09f945/0x88da08396ccc8c22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427473:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb09f945/0x88da08396ccc8c22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427480:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb09f945/0x88da08396ccc8c22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427494:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788838115.427498:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc8c29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838115.427505:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838115.427505:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.427512:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3cc69c1/0x88da08396ccc8c7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427518:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc8c29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427523:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30a:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.427532:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838115.427534:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc8c29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427537:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3cc69c1/0x88da08396ccc8c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427552:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc8c29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427554:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3cc69c1/0x88da08396ccc8c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427573:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5f82b3/0x88da08396ccc8c29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427576:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3cc69c1/0x88da08396ccc8c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427587:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788838115.427592:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3cc69c1/0x88da08396ccc8c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427592:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b71cdb93/0x88da08396ccc8c30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.427614:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.427618:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:0.0:1788838115.427619:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b71cdb93/0x88da08396ccc8c30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838115.427658:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.427663:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc8c84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427671:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x309:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.427674:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.427678:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc8c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427686:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc8c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427694:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc8c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427701:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc8c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427710:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1788838115.427744:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.427750:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc8c8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427764:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x308:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.427767:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x308:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.427771:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc8c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427780:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc8c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427786:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc8c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427792:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc8c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427826:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1788838115.427876:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.427882:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed8c94a5/0x88da08396ccc8c92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427891:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x307:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.427894:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x307:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.427898:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed8c94a5/0x88da08396ccc8c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427907:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed8c94a5/0x88da08396ccc8c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427929:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed8c94a5/0x88da08396ccc8c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427936:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed8c94a5/0x88da08396ccc8c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.427945:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1788838115.427994:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.428000:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027233875/0x88da08396ccc8c99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428007:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x306:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.428010:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x306:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.428014:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027233875/0x88da08396ccc8c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428023:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027233875/0x88da08396ccc8c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428029:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027233875/0x88da08396ccc8c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428035:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027233875/0x88da08396ccc8c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428063:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00010000:00010000:0.0:1788838115.428065:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b71cdb93/0x88da08396ccc8c30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428080:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b71cdb93/0x88da08396ccc8c30 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428089:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71cdb93/0x88da08396ccc8c30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838115.428108:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.428115:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc8ca0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428123:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x305:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.428126:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x305:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.428130:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc8ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428137:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc8ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428145:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc8ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428151:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc8ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428159:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00010000:00010000:0.0:1788838115.428176:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788838115.428182:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc8c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428190:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838115.428194:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc8c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838115.428198:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838115.428203:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc8c37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.428206:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee7370d2/0x88da08396ccc8ca7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428236:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc8c37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428244:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000239a4481/0x88da08396ccc8c37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428257:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788838115.428260:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc8c3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428267:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838115.428271:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc8c3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428290:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc8c3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428301:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc8c3e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428308:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1bddd6a/0x88da08396ccc8c3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428320:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788838115.428324:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015587dc5/0x88da08396ccc8c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428330:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838115.428333:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015587dc5/0x88da08396ccc8c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428342:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015587dc5/0x88da08396ccc8c45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428352:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015587dc5/0x88da08396ccc8c45 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428360:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015587dc5/0x88da08396ccc8c45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428382:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788838115.428386:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dfcccd1/0x88da08396ccc8c4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428392:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838115.428396:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dfcccd1/0x88da08396ccc8c4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428404:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dfcccd1/0x88da08396ccc8c4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428414:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dfcccd1/0x88da08396ccc8c4c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428422:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dfcccd1/0x88da08396ccc8c4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428433:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788838115.428436:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005664f87e/0x88da08396ccc8c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428443:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838115.428447:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005664f87e/0x88da08396ccc8c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428468:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005664f87e/0x88da08396ccc8c53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428479:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005664f87e/0x88da08396ccc8c53 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428492:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005664f87e/0x88da08396ccc8c53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428508:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788838115.428512:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000366bdbcb/0x88da08396ccc8c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428518:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838115.428521:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000366bdbcb/0x88da08396ccc8c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428529:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000366bdbcb/0x88da08396ccc8c5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428540:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000366bdbcb/0x88da08396ccc8c5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428547:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000366bdbcb/0x88da08396ccc8c5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428576:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788838115.428580:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005df95a8c/0x88da08396ccc8c61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428586:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838115.428589:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005df95a8c/0x88da08396ccc8c61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428597:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005df95a8c/0x88da08396ccc8c61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428609:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005df95a8c/0x88da08396ccc8c61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.428616:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005df95a8c/0x88da08396ccc8c61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428679:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788838115.428686:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc8c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428693:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.428697:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc8c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428704:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc8c68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428718:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc8c68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428725:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087aa7c32/0x88da08396ccc8c68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428739:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788838115.428742:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb3860a2/0x88da08396ccc8c6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428748:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.428751:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb3860a2/0x88da08396ccc8c6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428766:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb3860a2/0x88da08396ccc8c6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428779:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb3860a2/0x88da08396ccc8c6f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428786:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb3860a2/0x88da08396ccc8c6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428821:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788838115.428826:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002598d5d7/0x88da08396ccc8c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428833:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.428836:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002598d5d7/0x88da08396ccc8c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428846:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002598d5d7/0x88da08396ccc8c76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428859:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002598d5d7/0x88da08396ccc8c76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428868:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002598d5d7/0x88da08396ccc8c76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428896:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788838115.428901:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3cc69c1/0x88da08396ccc8c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428909:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.428913:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3cc69c1/0x88da08396ccc8c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428923:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3cc69c1/0x88da08396ccc8c7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428935:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3cc69c1/0x88da08396ccc8c7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428943:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3cc69c1/0x88da08396ccc8c7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428958:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838115.428963:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc8c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.428971:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.428975:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc8c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429007:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc8c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429019:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc8c84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429026:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9a22aa/0x88da08396ccc8c84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429041:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838115.429045:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc8c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429052:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607461e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.429055:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc8c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429063:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc8c8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429072:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc8c8b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429081:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096225ef3/0x88da08396ccc8c8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429106:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838115.429111:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed8c94a5/0x88da08396ccc8c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429117:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff607460800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.429120:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed8c94a5/0x88da08396ccc8c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429127:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed8c94a5/0x88da08396ccc8c92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429137:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed8c94a5/0x88da08396ccc8c92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429145:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed8c94a5/0x88da08396ccc8c92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429156:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838115.429160:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027233875/0x88da08396ccc8c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429166:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.429168:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027233875/0x88da08396ccc8c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429187:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027233875/0x88da08396ccc8c99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429200:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027233875/0x88da08396ccc8c99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.429201:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838115.429208:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc8ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429214:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027233875/0x88da08396ccc8c99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.429245:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.429248:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.429250:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.429259:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.429266:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838115.429605:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838115.429610:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc8ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.429630:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc8ca0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.429642:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc8ca0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.429649:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc8ca0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838115.429671:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838115.429673:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838115.429675:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.430545:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x304:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.430558:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x304:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.430567:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7370d2/0x88da08396ccc8ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430583:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee7370d2/0x88da08396ccc8ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430595:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee7370d2/0x88da08396ccc8ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430605:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7370d2/0x88da08396ccc8ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430638:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838115.430737:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.430744:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e619f0b/0x88da08396ccc8cae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430752:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x303:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.430754:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x303:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.430758:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e619f0b/0x88da08396ccc8cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430766:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e619f0b/0x88da08396ccc8cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430774:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e619f0b/0x88da08396ccc8cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430788:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e619f0b/0x88da08396ccc8cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430834:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788838115.430845:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838115.430852:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee7370d2/0x88da08396ccc8ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430860:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712cc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838115.430864:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7370d2/0x88da08396ccc8ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430873:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7370d2/0x88da08396ccc8ca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.430890:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee7370d2/0x88da08396ccc8ca7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.431070:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838115.431078:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e619f0b/0x88da08396ccc8cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.431086:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.431089:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e619f0b/0x88da08396ccc8cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.431097:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e619f0b/0x88da08396ccc8cae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.431109:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e619f0b/0x88da08396ccc8cae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.431124:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e619f0b/0x88da08396ccc8cae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.431144:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.431146:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.431148:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.431253:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee7370d2/0x88da08396ccc8ca7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.431268:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.431269:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838115.431271:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838115.431402:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838115.431413:0:26220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a80377/0x88da08396ccc8cb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.431422:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x302:0x0].0x0 since=3509s v=(0 0) 00010000:00010000:1.0:1788838115.431425:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x302:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838115.431429:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075a80377/0x88da08396ccc8cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.431604:0:26220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075a80377/0x88da08396ccc8cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.431614:0:26220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075a80377/0x88da08396ccc8cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.431621:0:26220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075a80377/0x88da08396ccc8cb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838115.431676:0:26220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788838115.432590:0:26220:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:1.0:1788838115.432690:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:89062:x1875729135043200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 51404us (51672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838115.432874:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5942 00000100:00100000:1.0:1788838115.433079:0:89062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604232a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89062:1875729135043200:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788838115.433094:0:89062:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x321:0x0] from OST, last_created [0x2c0000401:0x321:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1788838115.433176:0:89062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89062:1875729135043456:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788838115.433214:0:89062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.433265:0:89062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede540 going to sleep for 11 seconds 00002000:00080000:3.0:1788838115.433489:0:26214:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:3.0:1788838115.433537:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:89060:x1875729135043072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 52400us (53207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838115.433546:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5941 00000100:00100000:3.0:1788838115.433576:0:89060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a361f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89060:1875729135043072:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788838115.433587:0:89060:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x321:0x0] from OST, last_created [0x280000401:0x321:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:3.0:1788838115.433619:0:89060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a361500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89060:1875729135043712:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788838115.434873:0:89060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838115.434915:0:89060:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff508ba4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838115.434941:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135043456 00000100:00100000:3.0:1788838115.434948:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135043456 00000100:00100000:3.0:1788838115.435232:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135043712 00000100:00100000:3.0:1788838115.435237:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135043712 00000100:00100000:1.0:1788838115.435253:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135043328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838115.435267:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5943 00000100:00100000:3.0:1788838115.435276:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:89062:x1875729135043456:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788838115.435357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.435393:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838115.435408:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135043584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838115.435453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838115.435494:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5944 00000100:00100000:1.0:1788838115.435503:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:89060:x1875729135043712:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788838115.435534:0:8657:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 802 00002000:00080000:3.0:1788838115.436740:0:26214:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 802 00010000:00010000:2.0:1788838115.440080:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838115.440093:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075a80377/0x88da08396ccc8cb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.440106:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712da00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838115.440112:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a80377/0x88da08396ccc8cb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.440123:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075a80377/0x88da08396ccc8cb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.440145:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075a80377/0x88da08396ccc8cb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.440154:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075a80377/0x88da08396ccc8cb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838115.440179:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.440181:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838115.440192:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838115.444231:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135043328 00000100:00100000:0.0:1788838115.444244:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135043328 00000100:00100000:0.0:1788838115.444304:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135043584 00000100:00100000:0.0:1788838115.444307:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135043584 00000100:00100000:0.0:1788838115.444327:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:0.0:1788838115.444335:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135043328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788838115.444359:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838115.444433:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135043328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (9076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838115.444441:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:0.0:1788838115.444459:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:0.0:1788838115.444465:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135043584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838115.444475:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838115.444521:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135043584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (9067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838115.444527:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:1.0:1788838115.445915:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135043584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838115.445935:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135043328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838115.446272:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:89060:x1875729135043712:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10770us (11403us total) trans 4294969451 rc 0/0 00000100:00100000:1.0:1788838115.446281:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5944 00000100:00100000:1.0:1788838115.446663:0:89060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a361500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89060:1875729135043712:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788838115.446675:0:89060:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x321:0x0]-[0x280000401:0x341:0x0] 00000100:00100000:3.0:1788838115.451150:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:89062:x1875729135043456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15865us (17926us total) trans 4294969451 rc 0/0 00000100:00100000:3.0:1788838115.451166:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5943 00000100:00100000:1.0:1788838115.451193:0:89062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89062:1875729135043456:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788838115.451214:0:89062:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x321:0x0]-[0x2c0000401:0x341:0x0] 00000001:02000400:3.0:1788838115.474648:0:89328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00100000:2.0:1788838115.718935:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788838115.904135:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838115.904565:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838115.904662:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838115.904696:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116408192 00000100:00100000:1.0:1788838115.904705:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116408192 00000100:00100000:1.0:1788838115.904760:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116408320 00000100:00100000:1.0:1788838115.904764:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116408320 00000100:00100000:1.0:1788838115.904827:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1203 00000100:00100000:1.0:1788838115.904850:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:2405:x1875729116408192:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838115.904946:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:2405:x1875729116408192:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 99us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838115.904955:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1203 00000100:00100000:1.0:1788838115.904977:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1204 00000100:00100000:1.0:1788838115.904983:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116408320:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838115.905009:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116408320:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838115.905015:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1204 00000100:00080000:1.0:1788838115.905038:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838115.906282:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116408064 00000100:00100000:2.0:1788838115.906303:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116408064 00000100:00100000:2.0:1788838115.906396:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:2.0:1788838115.906414:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f7dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2405:x1875729116408064:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838115.906524:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f7dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2405:x1875729116408064:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 116us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838115.906536:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00010000:00010000:0.0:1788838116.414653:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788838116.558660:0:89380:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838116.558849:0:89380:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788838117.437288:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788838117.858224:0:89430:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838117.858531:0:89430:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788838118.463742:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838118.781029:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135043840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838118.781113:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838118.781158:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135043968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838118.781181:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838118.781237:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135043840 00000100:00100000:2.0:1788838118.781245:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135043840 00000100:00100000:0.0:1788838118.781283:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135043968 00000100:00100000:0.0:1788838118.781288:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135043968 00000100:00100000:2.0:1788838118.781305:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00080000:1.0:1788838118.781341:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838118.781345:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838118.781380:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135043840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838118.781415:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838118.781494:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135043840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838118.781559:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135043840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838118.784169:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:0.0:1788838118.784195:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135043968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838118.784246:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838118.784342:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135043968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838118.784350:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:3.0:1788838118.785458:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135043968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838118.793711:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00010000:00010000:2.0:1788838119.488605:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838119.754162:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838119.754341:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116408448 00000100:00100000:0.0:1788838119.754355:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116408448 00000100:00100000:0.0:1788838119.754461:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1205 00000100:00100000:0.0:1788838119.754474:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:68174:x1875729116408448:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838119.754502:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838119.754541:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8cbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccb4 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838119.754639:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8cc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838119.754658:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838119.754674:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838119.754767:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788838119.754771:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788838119.754893:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838119.754924:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8cbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccb4 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838119.754946:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccb4 expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838119.754956:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff60b5cf200) 00010000:00010000:0.0:1788838119.754959:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788838119.754964:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718f000, rc 0) 00000100:00100000:0.0:1788838119.755033:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:68174:x1875729116408448:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 562us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838119.755042:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1205 00000100:00080000:2.0:1788838119.756363:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838119.760032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838119.760364:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116408576 00000100:00100000:3.0:1788838119.760376:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116408576 00000100:00100000:3.0:1788838119.760446:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1206 00000100:00100000:3.0:1788838119.760459:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:68174:x1875729116408576:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838119.760500:0:67312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 28672 free 1445081088 avail 1298841600 00000100:00100000:3.0:1788838119.760585:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:68174:x1875729116408576:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 128us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838119.760593:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1206 00000100:00100000:1.0:1788838119.762379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838119.762569:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116408704 00000100:00100000:2.0:1788838119.762578:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116408704 00000100:00100000:2.0:1788838119.762644:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1207 00000100:00100000:2.0:1788838119.762655:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:68174:x1875729116408704:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788838119.762703:0:66254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788838119.762785:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:68174:x1875729116408704:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 131us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838119.762841:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1207 00000100:00080000:1.0:1788838119.763548:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838119.765701:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838119.765874:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116408832 00000100:00100000:1.0:1788838119.765887:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116408832 00000100:00100000:1.0:1788838119.765959:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5945 00000100:00100000:1.0:1788838119.765970:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2403:x1875729116408832:12345-192.168.203.30@tcp:8:lfs.0 00010000:00080000:1.0:1788838119.766009:0:26218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp t0 exp 0000000000000000 cur 3513 last 0 00000020:00000080:1.0:1788838119.766063:0:26218:0:(genops.c:1385:class_connect()) connect: client fdcf066d-ff07-4b2e-96ab-52415ed6bf72, cookie 0x88da08396ccc8cca 00002000:00100000:1.0:1788838119.766078:0:26218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fdcf066d-ff07-4b2e-96ab-52415ed6bf72/ffff8ff608210000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788838119.766091:0:26218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788838119.766367:0:26218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788838119.766409:0:26218:0:(import.c:65:import_set_state_nolock()) ffff8ff608211000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838119.766498:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116408832:12345-192.168.203.30@tcp:8:lfs.0 Request processed in 528us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838119.766505:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5945 00000100:00100000:3.0:1788838119.771024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838119.771346:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116408960 00000100:00100000:1.0:1788838119.771360:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116408960 00000100:00100000:1.0:1788838119.771506:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2002 00000100:00100000:1.0:1788838119.771518:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:68174:x1875729116408960:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:1.0:1788838119.771548:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838119.771624:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:68174:x1875729116408960:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 108us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838119.771632:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2002 00000100:00080000:2.0:1788838119.771830:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838119.779881:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838119.780293:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116409088 00000100:00100000:1.0:1788838119.780305:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116409088 00000100:00100000:1.0:1788838119.780352:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5946 00000100:00100000:1.0:1788838119.780361:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2403:x1875729116409088:12345-192.168.203.30@tcp:8:lfs.0 00010000:00080000:1.0:1788838119.780402:0:26211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp t0 exp 0000000000000000 cur 3513 last 0 00000020:00000080:1.0:1788838119.780437:0:26211:0:(genops.c:1385:class_connect()) connect: client fdcf066d-ff07-4b2e-96ab-52415ed6bf72, cookie 0x88da08396ccc8cd1 00002000:00100000:1.0:1788838119.780463:0:26211:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fdcf066d-ff07-4b2e-96ab-52415ed6bf72/ffff8ff608210800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788838119.780475:0:26211:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788838119.780551:0:26211:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788838119.780584:0:26211:0:(import.c:65:import_set_state_nolock()) ffff8ff5031c7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838119.780684:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116409088:12345-192.168.203.30@tcp:8:lfs.0 Request processed in 322us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838119.780693:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5946 00000100:00100000:3.0:1788838119.782921:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838119.783036:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116409216 00000100:00100000:2.0:1788838119.783060:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116409216 00000100:00100000:2.0:1788838119.783163:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2003 00000100:00100000:2.0:1788838119.783175:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:68174:x1875729116409216:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838119.783215:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838119.783300:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:68174:x1875729116409216:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 127us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838119.783307:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2003 00000100:00080000:1.0:1788838119.783841:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838120.319363:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135044480:0@lo:400:kworker.0 00000100:00100000:2.0:1788838120.319433:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838120.319511:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135044224:0@lo:400:kworker.0 00000100:00100000:1.0:1788838120.319545:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838120.319591:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838120.319597:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135044352:0@lo:400:kworker.0 00000100:00100000:1.0:1788838120.319620:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838120.319666:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135044224 00000100:00100000:1.0:1788838120.319673:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135044224 00000100:00100000:1.0:1788838120.319718:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788838120.319727:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135044224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838120.319774:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503696450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135044224:12345-0@lo:400:kworker.0 Request processed in 48us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838120.319781:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788838120.319831:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135044480 00000100:00100000:1.0:1788838120.319835:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135044480 00000100:00100000:1.0:1788838120.319867:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135044352 00000100:00100000:1.0:1788838120.319870:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135044352 00000100:00100000:1.0:1788838120.319889:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1788838120.319895:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838120.321363:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135044096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838120.321427:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838120.321535:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838120.321541:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838120.321574:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135044224:0@lo:400:kworker.0 00000100:00100000:3.0:1788838120.321609:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1788838120.321623:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135044352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838120.321688:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135044352:12345-0@lo:400:kworker.0 Request processed in 71us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838120.321695:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1788838120.321733:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135044352:0@lo:400:kworker.0 00000100:00100000:3.0:1788838120.321763:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135044096 00000100:00100000:3.0:1788838120.321769:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135044096 00000100:00100000:3.0:1788838120.321828:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4091 00000100:00100000:3.0:1788838120.321850:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135044096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838120.321878:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838120.321977:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135044096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838120.321982:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4091 00000100:00100000:3.0:1788838120.322016:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135044096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838120.327316:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135044736:0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.327399:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838120.327448:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135045248:0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.327473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838120.327498:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788838120.327504:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135044864:0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.329358:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838120.329414:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135045376:0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.329459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838120.329588:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135044864 00000100:00100000:0.0:1788838120.329596:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135044864 00000100:00100000:0.0:1788838120.329655:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092 00000100:00100000:0.0:1788838120.329663:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135044864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.330896:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135044864:12345-0@lo:400:kworker.0 Request processed in 1227us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838120.330907:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092 00000100:00100000:0.0:1788838120.330954:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135045376 00000100:00100000:0.0:1788838120.330960:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135045376 00000100:00100000:0.0:1788838120.331012:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:0.0:1788838120.331021:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135045376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.331090:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135045376:12345-0@lo:400:kworker.0 Request processed in 70us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838120.331097:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:3.0:1788838120.331600:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135044608:0@lo:400:kworker.0 00000100:00100000:3.0:1788838120.331649:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838120.331695:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135045120:0@lo:400:kworker.0 00000100:00100000:3.0:1788838120.331722:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838120.331741:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135045632:0@lo:400:kworker.0 00000100:00100000:3.0:1788838120.331769:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838120.331781:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135045120 00000100:00100000:0.0:1788838120.331788:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135045120 00000100:00100000:3.0:1788838120.331823:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788838120.331832:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135044992:0@lo:400:kworker.0 00000100:00100000:3.0:1788838120.331857:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838120.331880:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135045504:0@lo:400:kworker.0 00000100:00100000:3.0:1788838120.331912:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838120.331995:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135044736 00000100:00100000:2.0:1788838120.332001:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135044736 00000100:00100000:2.0:1788838120.332035:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135045248 00000100:00100000:2.0:1788838120.332040:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135045248 00000100:00100000:2.0:1788838120.332072:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1788838120.332081:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135044736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838120.332135:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135044736:12345-0@lo:400:kworker.0 Request processed in 56us (4737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838120.332143:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1788838120.332156:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135044608 00000100:00100000:2.0:1788838120.332159:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135044608 00000100:00100000:2.0:1788838120.332175:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135045632 00000100:00100000:2.0:1788838120.332177:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135045632 00000100:00100000:2.0:1788838120.333367:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1788838120.333404:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135045248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838120.334202:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135045248:12345-0@lo:400:kworker.0 Request processed in 789us (6710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838120.334213:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1788838120.334243:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1788838120.334254:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135044608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838120.334310:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135044608:12345-0@lo:400:kworker.0 Request processed in 60us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838120.334317:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1788838120.334328:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1788838120.334334:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135045632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838120.334362:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135045632:12345-0@lo:400:kworker.0 Request processed in 29us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838120.334367:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1788838120.335131:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135044480:12345-0@lo:400:kworker.0 Request processed in 15231us (15693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838120.335157:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1788838120.335267:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135044864:0@lo:400:kworker.0 00000100:00100000:1.0:1788838120.335285:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135045376:0@lo:400:kworker.0 00000100:00100000:1.0:1788838120.335299:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135044736:0@lo:400:kworker.0 00000100:00100000:1.0:1788838120.335312:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135045248:0@lo:400:kworker.0 00000100:00080000:1.0:1788838120.335363:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788838120.335370:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838120.335374:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838120.335377:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838120.335989:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135044992 00000100:00100000:0.0:1788838120.335997:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135044992 00000100:00100000:0.0:1788838120.336049:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135045504 00000100:00100000:0.0:1788838120.336053:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135045504 00000100:00100000:0.0:1788838120.336093:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:0.0:1788838120.336103:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135045120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.336175:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135045120:12345-0@lo:400:kworker.0 Request processed in 73us (4451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838120.336182:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:0.0:1788838120.336211:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:0.0:1788838120.336217:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135044992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.336257:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135044992:12345-0@lo:400:kworker.0 Request processed in 41us (4399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838120.336264:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:0.0:1788838120.336277:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:0.0:1788838120.336282:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135045504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.336308:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135045504:12345-0@lo:400:kworker.0 Request processed in 26us (4397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838120.336314:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00080000:0.0:1788838120.336341:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838120.336344:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838120.336426:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135044992:0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.336441:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135045504:0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.336453:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135044608:0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.336464:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135045120:0@lo:400:kworker.0 00000100:00100000:0.0:1788838120.336476:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135045632:0@lo:400:kworker.0 00000100:00100000:2.0:1788838120.339459:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135044480:0@lo:400:kworker.0 00010000:00010000:0.0:1788838120.509343:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838120.830959:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135045760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838120.831229:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838120.831250:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135046016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838120.831342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838120.831397:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135046016 00000100:00100000:3.0:1788838120.831406:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135046016 00000100:00100000:3.0:1788838120.831460:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093 00000100:00100000:3.0:1788838120.831470:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135046016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838120.831502:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 28672 free 1445081088 avail 1298841600 00000100:00100000:3.0:1788838120.831558:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135046016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838120.831565:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093 00000100:00100000:3.0:1788838120.831616:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135046016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838120.834404:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838120.834449:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838120.834460:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135045888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838120.834481:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838120.834895:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135045760 00000100:00100000:2.0:1788838120.834905:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135045760 00000100:00100000:2.0:1788838120.834947:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135045888 00000100:00100000:2.0:1788838120.834950:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135045888 00000100:00100000:2.0:1788838120.834966:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:2.0:1788838120.834974:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135045760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838120.835002:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838120.835495:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135045760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 519us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838120.835505:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1788838120.835539:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:1.0:1788838120.835552:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135045888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838120.835573:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838120.835610:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135045888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838120.835616:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:1.0:1788838120.835817:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135045888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838120.835844:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135045760:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788838120.839356:0:89041:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149697 is committed 00000001:00100000:2.0:1788838120.839402:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00080000:2.0:1788838120.839413:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969451 is committed 00000001:00100000:1.0:1788838120.839727:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00080000:1.0:1788838120.839745:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969451 is committed 00000100:00100000:1.0:1788838121.027474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838121.027505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838121.027526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838121.027542:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838121.027563:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838121.027591:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116409600 00000100:00100000:1.0:1788838121.027600:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116409600 00000100:00100000:1.0:1788838121.027653:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116409472 00000100:00100000:1.0:1788838121.027657:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116409472 00000100:00100000:1.0:1788838121.027682:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1211 00000100:00100000:1.0:1788838121.027692:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116409600:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838121.027767:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116409600:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 76us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838121.027775:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1211 00000100:00100000:1.0:1788838121.027791:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1212 00000100:00100000:1.0:1788838121.027814:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116409472:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838121.027840:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116409472:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 43us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838121.027846:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1212 00000100:00100000:1.0:1788838121.027863:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116409856 00000100:00100000:1.0:1788838121.027867:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116409856 00000100:00100000:1.0:1788838121.027888:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116409728 00000100:00100000:1.0:1788838121.027891:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116409728 00000100:00100000:1.0:1788838121.027910:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2534 00000100:00100000:1.0:1788838121.027916:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116409856:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838121.027944:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116409856:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838121.027963:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2534 00000100:00100000:1.0:1788838121.027975:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2535 00000100:00100000:1.0:1788838121.027981:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116409728:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838121.028005:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116409728:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838121.028012:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2535 00000100:00080000:1.0:1788838121.028032:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838121.028035:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838121.028038:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788838121.028040:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838121.028145:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116409344 00000100:00100000:3.0:1788838121.028149:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116409344 00000100:00100000:3.0:1788838121.028182:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:3.0:1788838121.028201:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116409344:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838121.028229:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116409344:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838121.028235:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00010000:00010000:1.0:1788838121.533075:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838122.562836:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838123.587000:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838123.904227:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838123.904260:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135046144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838123.904364:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838123.904819:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838123.904832:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135046272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838123.904868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838123.905097:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135046144 00000100:00100000:2.0:1788838123.905109:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135046144 00000100:00100000:2.0:1788838123.905198:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135046272 00000100:00100000:2.0:1788838123.905202:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135046272 00000100:00100000:2.0:1788838123.905224:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1788838123.905235:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135046144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838123.905272:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838123.905331:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135046144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838123.905339:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1788838123.905356:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:2.0:1788838123.905362:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135046272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838123.905379:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838123.905410:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135046272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838123.905416:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:2.0:1788838123.905464:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135046144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838123.905632:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135046272:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788838123.905752:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838123.905758:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788838124.608456:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838125.441078:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838125.441105:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135046784:0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.441179:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135046528:0@lo:400:kworker.0 00000100:00100000:0.0:1788838125.441199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838125.441225:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838125.441239:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135046400:0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.441241:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135047040:0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.441320:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135046912:0@lo:400:kworker.0 00000100:00100000:1.0:1788838125.443253:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135046784 00000100:00100000:1.0:1788838125.443266:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135046784 00000100:00100000:1.0:1788838125.443328:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135046528 00000100:00100000:1.0:1788838125.443331:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135046528 00000100:00100000:1.0:1788838125.443353:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1788838125.443361:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135046784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838125.449344:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838125.459246:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838125.459330:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135047552:0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.459598:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838125.459649:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135048064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838125.459673:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838125.459700:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788838125.459707:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135046656:0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.459732:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838125.459760:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135047168:0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.459783:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838125.459822:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135047680:0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.459849:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838125.459975:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135047168 00000100:00100000:2.0:1788838125.459984:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135047168 00000100:00100000:2.0:1788838125.460035:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135047680 00000100:00100000:2.0:1788838125.460038:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135047680 00000100:00100000:2.0:1788838125.460062:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:2.0:1788838125.460089:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135047168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838125.460968:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135047040 00000100:00100000:0.0:1788838125.460976:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135047040 00000100:00100000:0.0:1788838125.461013:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135047552 00000100:00100000:0.0:1788838125.461016:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135047552 00000100:00100000:0.0:1788838125.461028:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135048064 00000100:00100000:0.0:1788838125.461031:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135048064 00000100:00100000:0.0:1788838125.461043:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4094 00000100:00100000:0.0:1788838125.461050:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135047040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838125.461209:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135047040:12345-0@lo:400:kworker.0 Request processed in 158us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838125.461216:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4094 00000100:00100000:0.0:1788838125.461237:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095 00000100:00100000:0.0:1788838125.461243:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135047552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838125.461275:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135047552:12345-0@lo:400:kworker.0 Request processed in 32us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838125.461280:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095 00000100:00100000:0.0:1788838125.461291:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096 00000100:00100000:0.0:1788838125.461297:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135048064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788838125.461320:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788838125.461431:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135048064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838125.461438:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096 00000100:00100000:0.0:1788838125.461460:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135046656 00000100:00100000:0.0:1788838125.461475:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135046656 00000100:00100000:0.0:1788838125.461508:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:0.0:1788838125.461516:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135046528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.462569:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135047168:12345-0@lo:400:kworker.0 Request processed in 63us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838125.462582:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00100000:2.0:1788838125.462611:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:2.0:1788838125.462622:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135047680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.462687:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135047680:12345-0@lo:400:kworker.0 Request processed in 69us (2837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838125.462693:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:2.0:1788838125.462739:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135047168:0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.462749:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:2.0:1788838125.462766:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135047680:0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.462812:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135048064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838125.462826:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135047040:0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.462835:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135047552:0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.467790:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135046400 00000100:00100000:1.0:1788838125.467933:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:1.0:1788838125.467956:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135046656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.468173:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135046400 00000100:00100000:3.0:1788838125.468224:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788838125.468231:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135046400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.468279:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135046400:12345-0@lo:400:kworker.0 Request processed in 48us (18943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838125.468286:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788838125.468516:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838125.468550:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135047424:0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.468627:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838125.469457:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135047936:0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.469499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838125.469524:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788838125.469531:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135047296:0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.469560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838125.469599:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135047296 00000100:00100000:3.0:1788838125.469605:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135047296 00000100:00100000:1.0:1788838125.469750:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135046656:12345-0@lo:400:kworker.0 Request processed in 1804us (10015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838125.469760:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:1.0:1788838125.469785:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135046912 00000100:00100000:1.0:1788838125.469789:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135046912 00000100:00100000:1.0:1788838125.469821:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135047424 00000100:00100000:1.0:1788838125.469825:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135047424 00000100:00100000:1.0:1788838125.469835:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135047936 00000100:00100000:1.0:1788838125.469848:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135047936 00000100:00100000:1.0:1788838125.469863:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:1.0:1788838125.469870:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135046912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838125.469911:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135046912:12345-0@lo:400:kworker.0 Request processed in 41us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838125.469917:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:1.0:1788838125.469929:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1788838125.469935:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135047424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838125.469961:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135047424:12345-0@lo:400:kworker.0 Request processed in 27us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838125.469968:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1788838125.469980:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1788838125.469986:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135047936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838125.470010:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135047936:12345-0@lo:400:kworker.0 Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838125.470016:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1788838125.470318:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135046784:12345-0@lo:400:kworker.0 Request processed in 26957us (29118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838125.470326:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1788838125.470596:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1788838125.470608:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135047296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.470719:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135047296:12345-0@lo:400:kworker.0 Request processed in 115us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838125.470725:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:3.0:1788838125.470766:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135047296:0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.470774:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135047808:0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.470817:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838125.470845:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135047808 00000100:00100000:3.0:1788838125.470850:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135047808 00000100:00100000:3.0:1788838125.470886:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1788838125.470893:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135047808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.470919:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135047808:12345-0@lo:400:kworker.0 Request processed in 27us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838125.470925:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:3.0:1788838125.470947:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:3.0:1788838125.471020:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135047808:0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.471036:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135046912:0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.471046:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135047424:0@lo:400:kworker.0 00000100:00100000:3.0:1788838125.471055:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135047936:0@lo:400:kworker.0 00000100:00100000:2.0:1788838125.472505:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135046656:0@lo:400:kworker.0 00000100:00080000:0.0:1788838125.472723:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838125.472730:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838125.472733:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838125.472736:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838125.472880:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135046400:0@lo:400:kworker.0 00000100:00100000:1.0:1788838125.472905:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135046784:0@lo:400:kworker.0 00000100:00100000:0.0:1788838125.473077:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135046528:12345-0@lo:400:kworker.0 Request processed in 11551us (31840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838125.473088:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:2.0:1788838125.473284:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135046528:0@lo:400:kworker.0 00010000:00010000:1.0:1788838125.628978:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788838125.812979:0:89623:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:2.0:1788838125.949907:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838125.949930:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135048192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838125.950004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838125.950065:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135048192 00000100:00100000:2.0:1788838125.950073:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135048192 00000100:00100000:2.0:1788838125.950119:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:2.0:1788838125.950128:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135048192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838125.950165:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838125.950210:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135048192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838125.950218:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:2.0:1788838125.950260:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135048192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838125.950448:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838125.950457:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135048320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838125.950487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838125.951994:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135048320 00000100:00100000:1.0:1788838125.952006:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135048320 00000100:00100000:1.0:1788838125.954366:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:1.0:1788838125.954385:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135048320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838125.954423:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838125.954499:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135048320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (4011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838125.954505:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1788838125.954661:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838125.954678:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135048448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838125.954729:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838125.954780:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135048448 00000100:00100000:2.0:1788838125.954788:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135048448 00000100:00100000:2.0:1788838125.954849:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4097 00000100:00100000:2.0:1788838125.954858:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135048448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838125.954893:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1788838125.954933:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135048320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838125.954937:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135048448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838125.954946:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4097 00000100:00100000:2.0:1788838125.954983:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135048448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838126.146308:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838126.146355:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838126.146393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838126.146427:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838126.146452:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838126.146489:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116410368 00000100:00100000:3.0:1788838126.146498:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116410368 00000100:00100000:3.0:1788838126.146564:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116410496 00000100:00100000:3.0:1788838126.146567:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116410496 00000100:00100000:3.0:1788838126.146591:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2540 00000100:00100000:3.0:1788838126.146602:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116410368:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838126.146674:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116410368:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 74us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838126.146682:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2540 00000100:00100000:3.0:1788838126.146700:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2541 00000100:00100000:3.0:1788838126.146706:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116410496:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838126.146749:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2406:x1875729116410496:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 42us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838126.146756:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2541 00000100:00100000:2.0:1788838126.147035:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116409984 00000100:00100000:2.0:1788838126.147040:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116409984 00000100:00100000:2.0:1788838126.147090:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:2.0:1788838126.147097:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116409984:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838126.147133:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116409984:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838126.147139:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00080000:0.0:1788838126.147383:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838126.147388:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838126.147829:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116410112 00000100:00100000:1.0:1788838126.147836:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116410112 00000100:00100000:1.0:1788838126.147881:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116410240 00000100:00100000:1.0:1788838126.147884:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116410240 00000100:00100000:1.0:1788838126.147910:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1219 00000100:00100000:1.0:1788838126.147919:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116410112:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838126.147963:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116410112:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 45us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838126.147970:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1219 00000100:00100000:1.0:1788838126.147984:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1220 00000100:00100000:1.0:1788838126.147990:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116410240:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838126.148014:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116410240:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838126.148020:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1220 00000100:00080000:0.0:1788838126.148086:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838126.148090:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788838126.653055:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838127.678845:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788838127.772202:0:89671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1788838128.702487:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838129.021056:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135048576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838129.021139:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838129.021170:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135048576 00000100:00100000:1.0:1788838129.021179:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135048576 00000100:00080000:3.0:1788838129.021211:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838129.021235:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:1.0:1788838129.021246:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135048576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838129.021274:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838129.021327:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135048576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838129.021335:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1788838129.021566:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135048576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838129.021684:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135048704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838129.021718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838129.021821:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135048704 00000100:00100000:2.0:1788838129.021826:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135048704 00000100:00100000:2.0:1788838129.021872:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:2.0:1788838129.021880:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135048704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838129.021906:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838129.021951:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135048704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838129.021958:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00100000:0.0:1788838129.022197:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135048704:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788838129.022251:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838129.391568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838129.391740:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116410624 00000100:00100000:0.0:1788838129.391753:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116410624 00000100:00100000:0.0:1788838129.391887:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1208 00000100:00100000:0.0:1788838129.391901:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:68642:x1875729116410624:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1788838129.391949:0:76060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445081088 avail 1298841600 00000100:00080000:3.0:1788838129.392191:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838129.392283:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:68642:x1875729116410624:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 383us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838129.392311:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1208 00000100:00100000:0.0:1788838129.407531:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838129.407619:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116410752 00000100:00100000:1.0:1788838129.407629:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116410752 00000100:00100000:1.0:1788838129.407697:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1209 00000100:00100000:1.0:1788838129.407711:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:68642:x1875729116410752:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:1.0:1788838129.407759:0:75504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:1.0:1788838129.407893:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:68642:x1875729116410752:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 184us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838129.407901:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1209 00000100:00080000:3.0:1788838129.408012:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838129.416113:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838129.416279:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116410880 00000100:00100000:1.0:1788838129.416292:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116410880 00000100:00100000:1.0:1788838129.416372:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2012 00000100:00100000:1.0:1788838129.416383:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:68642:x1875729116410880:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:1.0:1788838129.416414:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838129.416480:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:68642:x1875729116410880:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 99us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838129.416487:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2012 00000100:00080000:3.0:1788838129.416547:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838129.421433:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838129.421535:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116411008 00000100:00100000:1.0:1788838129.421545:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116411008 00000100:00100000:1.0:1788838129.421619:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2013 00000100:00100000:1.0:1788838129.421628:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:68642:x1875729116411008:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:1.0:1788838129.421655:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788838129.421701:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838129.421732:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:68642:x1875729116411008:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838129.421740:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2013 00000100:00100000:0.0:1788838129.450683:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838129.450847:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116411264 00000100:00100000:2.0:1788838129.450859:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116411264 00000100:00100000:2.0:1788838129.450925:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1210 00000100:00100000:2.0:1788838129.450953:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:68658:x1875729116411264:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:2.0:1788838129.450978:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838129.451006:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8cd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccbb expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451149:0:66255:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 9 pid: 89074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451170:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8cdf lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451186:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8cdf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451200:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8cdf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451322:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8cdf lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451330:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8cdf lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451336:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8cdf lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451343:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838129.451348:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8cdf lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451355:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8cdf lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451375:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff60574c300) 00010000:00010000:2.0:1788838129.451378:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838129.451383:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8cdf lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451390:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8cdf lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451450:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8cd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccbb expref: 10 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451461:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff60b5cf200) 00010000:00010000:2.0:1788838129.451464:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788838129.451468:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8cd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccbb expref: 10 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.451479:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9e00, rc 0) 00000100:00100000:2.0:1788838129.451554:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:68658:x1875729116411264:12345-192.168.203.30@tcp:101:cat.0 Request processed in 604us (879us total) trans 111669149698 rc 301/301 00000100:00100000:2.0:1788838129.451562:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1210 00000100:00100000:0.0:1788838129.454649:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838129.456029:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116411392 00000100:00100000:1.0:1788838129.456045:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116411392 00000100:00100000:1.0:1788838129.456152:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1211 00000100:00100000:1.0:1788838129.456169:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:68658:x1875729116411392:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:1.0:1788838129.456204:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838129.456236:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8ced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccc2 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.456311:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.456324:0:66253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 10 pid: 89074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.456332:0:66253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 4/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.456369:0:66253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 10 pid: 89074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.456383:0:66253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 10 pid: 89074 timeout: 3623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838129.456397:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66253:1875729135048832:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788838129.456502:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5044a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838129.460728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838129.461994:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116411520 00000100:00100000:2.0:1788838129.462012:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116411520 00010000:00010000:2.0:1788838129.462061:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 11 pid: 89074 timeout: 3623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838129.462111:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2544 00000100:00100000:2.0:1788838129.462122:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2406:x1875729116411520:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838129.462167:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:2.0:1788838129.462194:0:7497:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:2.0:1788838129.462197:0:7497:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1788838080 00000004:00010000:2.0:1788838129.462199:0:7497:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1788838070 00000004:00010000:2.0:1788838129.462202:0:7497:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1788838080 00010000:00010000:2.0:1788838129.462207:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 5/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 11 pid: 89074 timeout: 3623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.462221:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 11 pid: 89074 timeout: 3623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.462248:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff60574c300) 00010000:00010000:2.0:1788838129.462253:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.462264:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.462270:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 4/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838129.462289:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838129.462350:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2406:x1875729116411520:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 230us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838129.462358:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2544 00010000:00010000:1.0:1788838129.463760:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc8af5 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc8a expref: 10 pid: 89074 timeout: 3623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838129.463787:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66253:1875729135048832:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788838129.463858:0:66253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.463886:0:66253:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.463892:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838129.463964:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788838129.464005:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.464059:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8ced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccc2 expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.464077:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccc2 expref: 9 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.464087:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff60574c300) 00010000:00010000:1.0:1788838129.464090:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788838129.464093:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d200, rc 0) 00000100:00100000:1.0:1788838129.464186:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:68658:x1875729116411392:12345-192.168.203.30@tcp:101:cat.0 Request processed in 8025us (9547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838129.464196:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1211 00000100:00100000:0.0:1788838129.469369:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838129.469456:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116411648 00000100:00100000:1.0:1788838129.469468:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116411648 00000100:00100000:1.0:1788838129.469542:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1212 00000100:00100000:1.0:1788838129.469555:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:68658:x1875729116411648:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:1.0:1788838129.469577:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838129.469627:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccc8cfb lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccc9 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.469697:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccc8cfb lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccc9 expref: 10 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.469716:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccc8cfb lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccc9 expref: 10 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.469736:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff60574c300) 00010000:00010000:1.0:1788838129.469740:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788838129.469744:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c200, rc 0) 00000100:00100000:1.0:1788838129.469848:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:68658:x1875729116411648:12345-192.168.203.30@tcp:101:cat.0 Request processed in 295us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838129.469857:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1212 00000100:00100000:3.0:1788838129.475491:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838129.475942:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116411776 00000100:00100000:1.0:1788838129.475963:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116411776 00000100:00100000:1.0:1788838129.476062:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1213 00000100:00100000:1.0:1788838129.476074:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2404:x1875729116411776:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:1.0:1788838129.476101:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838129.476144:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc8d02 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccd0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.476197:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc8d02 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccd0 expref: 11 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838129.476233:0:67312:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:1.0:1788838129.476236:0:67312:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788838080 -> 1788838080 00000004:00010000:1.0:1788838129.476260:0:67312:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788838070 -> 1788838070 00000004:00010000:1.0:1788838129.476263:0:67312:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788838080 -> 1788838080 00000004:00010000:1.0:1788838129.476265:0:67312:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:1.0:1788838129.476271:0:67312:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:1.0:1788838129.476284:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc8d02 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccd0 expref: 11 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838129.476302:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8ff60574c300) 00010000:00010000:1.0:1788838129.476305:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788838129.476311:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712da00, rc 0) 00000100:00100000:1.0:1788838129.476392:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2404:x1875729116411776:12345-192.168.203.30@tcp:101:cat.0 Request processed in 320us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838129.476399:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1213 00000100:00100000:0.0:1788838129.489245:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838129.492987:0:66268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116411904 00000100:00100000:2.0:1788838129.493006:0:66268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116411904 00002000:00100000:2.0:1788838129.493242:0:66268:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff8ff624ebea00 x1875729116411904/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:30/0 lens 488/0 e 0 to 0 dl 1788838140 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788838129.493277:0:66268:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8ff624ebea00 with x1875729116411904 00000100:00100000:2.0:1788838129.493323:0:66268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1788838129.493348:0:66268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2407:x1875729116411904:12345-192.168.203.30@tcp:3:cat.0 00000100:00100000:2.0:1788838129.494322:0:66268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2407:x1875729116411904:12345-192.168.203.30@tcp:3:cat.0 Request processed in 972us (5085us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788838129.494334:0:66268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00002000:00100000:2.0:1788838129.494346:0:66268:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff8ff624ebea00 x1875729116411904/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:30/0 lens 488/4536 e 0 to 0 dl 1788838140 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788838129.494354:0:66268:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8ff624ebea00 with x1875729116411904 00000100:00100000:0.0:1788838129.500475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838129.501213:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116412160 00000100:00100000:2.0:1788838129.501232:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116412160 00000100:00100000:2.0:1788838129.501330:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 225 00000100:00100000:2.0:1788838129.501344:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:68658:x1875729116412160:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:2.0:1788838129.503942:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:68658:x1875729116412160:12345-192.168.203.30@tcp:35:cat.0 Request processed in 2577us (3469us total) trans 111669149699 rc 0/0 00000100:00100000:2.0:1788838129.503963:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 225 00010000:00010000:1.0:1788838129.725186:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838130.557058:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838130.557153:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838130.557178:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135049088:0@lo:400:kworker.0 00000100:00100000:1.0:1788838130.557196:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135049216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838130.557259:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838130.557260:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.557463:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135048960:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.557512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.557562:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135049088 00000100:00100000:0.0:1788838130.557570:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135049088 00000100:00100000:0.0:1788838130.557635:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1788838130.557645:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135049088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.557700:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135049088:12345-0@lo:400:kworker.0 Request processed in 57us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.557707:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1788838130.557737:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135049216 00000100:00100000:0.0:1788838130.557741:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135049216 00000100:00100000:3.0:1788838130.557842:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135048960 00000100:00100000:3.0:1788838130.557847:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135048960 00000100:00100000:3.0:1788838130.557881:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788838130.557888:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a20a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838130.557926:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a20a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135048960:12345-0@lo:400:kworker.0 Request processed in 38us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838130.557933:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788838130.559215:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4098 00000100:00100000:0.0:1788838130.559237:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135049216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788838130.559293:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788838130.559395:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135049216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.559428:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4098 00000100:00100000:0.0:1788838130.559496:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135049088:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.559530:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135048960:0@lo:400:kworker.0 00000100:00080000:1.0:1788838130.559615:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838130.559824:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135049216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838130.578672:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135049344:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.578763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.578823:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135049856:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.578852:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.578872:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135050368:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.578895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.578922:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788838130.578927:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135049728:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.578951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.578976:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135050240:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579000:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.579035:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135049344 00000100:00100000:0.0:1788838130.579043:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135049344 00000100:00100000:0.0:1788838130.579108:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1788838130.579119:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135049344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579184:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135049344:12345-0@lo:400:kworker.0 Request processed in 67us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.579191:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1788838130.579215:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135049856 00000100:00100000:0.0:1788838130.579219:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135049856 00000100:00100000:0.0:1788838130.579243:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135050368 00000100:00100000:0.0:1788838130.579256:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135050368 00000100:00100000:0.0:1788838130.579281:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135050240 00000100:00100000:0.0:1788838130.579284:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135050240 00000100:00100000:0.0:1788838130.579303:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:0.0:1788838130.579309:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135049856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579343:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135049856:12345-0@lo:400:kworker.0 Request processed in 34us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.579349:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:0.0:1788838130.579361:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:0.0:1788838130.579367:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135050368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579394:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135050368:12345-0@lo:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.579399:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:0.0:1788838130.579410:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:0.0:1788838130.579415:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135050240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579440:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135050240:12345-0@lo:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.579445:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00080000:0.0:1788838130.579463:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838130.579467:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838130.579469:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838130.579495:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135050240:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579505:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135049344:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579514:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135049856:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579523:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135050368:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579574:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135049600:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579603:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.579623:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135050112:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579645:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.579666:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788838130.579672:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135049472:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579714:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.579732:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135049984:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579754:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.579772:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135050496:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579793:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838130.579842:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135049600 00000100:00100000:0.0:1788838130.579846:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135049600 00000100:00100000:0.0:1788838130.579877:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135050112 00000100:00100000:0.0:1788838130.579880:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135050112 00000100:00100000:0.0:1788838130.579890:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135049472 00000100:00100000:0.0:1788838130.579893:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135049472 00000100:00100000:0.0:1788838130.579904:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135050496 00000100:00100000:0.0:1788838130.579906:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135050496 00000100:00100000:0.0:1788838130.579918:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:0.0:1788838130.579924:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135049600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.579959:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135049600:12345-0@lo:400:kworker.0 Request processed in 35us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.579965:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:0.0:1788838130.579976:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1788838130.579981:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135050112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.580021:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135050112:12345-0@lo:400:kworker.0 Request processed in 39us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.580027:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1788838130.580041:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:0.0:1788838130.580047:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135049472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.580071:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135049472:12345-0@lo:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.580077:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:0.0:1788838130.580088:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:0.0:1788838130.580093:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135050496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.580116:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135050496:12345-0@lo:400:kworker.0 Request processed in 24us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.580133:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:0.0:1788838130.580150:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135049984 00000100:00100000:0.0:1788838130.580153:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135049984 00000100:00100000:0.0:1788838130.580177:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:0.0:1788838130.580184:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135049984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.580215:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135049984:12345-0@lo:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838130.580221:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00080000:0.0:1788838130.580235:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838130.580239:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838130.580350:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135049472:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.580362:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135049984:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.580372:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135050496:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.580394:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135049600:0@lo:400:kworker.0 00000100:00100000:0.0:1788838130.580403:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135050112:0@lo:400:kworker.0 00000100:00100000:2.0:1788838130.586068:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135049728 00000100:00100000:2.0:1788838130.586082:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135049728 00000100:00100000:2.0:1788838130.586160:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099 00000100:00100000:2.0:1788838130.586171:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135049728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838130.586284:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135049728:12345-0@lo:400:kworker.0 Request processed in 114us (7329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838130.586292:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099 00000100:00100000:2.0:1788838130.586587:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135049728:0@lo:400:kworker.0 00010000:00010000:1.0:1788838130.750513:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838131.070386:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838131.070409:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135050624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838131.070481:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838131.070579:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135050624 00000100:00100000:3.0:1788838131.070600:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135050624 00000100:00100000:3.0:1788838131.070653:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:3.0:1788838131.070663:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135050624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838131.070692:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838131.070737:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135050624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838131.070745:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:3.0:1788838131.070788:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135050624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838131.071476:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838131.071489:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135050752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838131.071528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838131.072596:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135050752 00000100:00100000:0.0:1788838131.072607:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135050752 00000100:00100000:0.0:1788838131.072663:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4100 00000100:00100000:0.0:1788838131.072672:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135050752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838131.072707:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1788838131.072767:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135050752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838131.072774:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4100 00000100:00100000:3.0:1788838131.077138:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135050752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838131.082132:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838131.082162:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135050880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838131.082238:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838131.085393:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135050880 00000100:00100000:1.0:1788838131.085411:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135050880 00000100:00100000:1.0:1788838131.085482:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:1.0:1788838131.085493:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135050880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838131.085524:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838131.085604:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135050880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838131.085623:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00100000:1.0:1788838131.085678:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135050880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838131.265725:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838131.265769:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838131.265819:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838131.265846:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838131.265870:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838131.265897:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116412288 00000100:00100000:0.0:1788838131.265908:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116412288 00000100:00100000:0.0:1788838131.265965:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:0.0:1788838131.265976:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a20b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116412288:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838131.266026:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116412416 00000100:00100000:2.0:1788838131.266031:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116412416 00000100:00100000:3.0:1788838131.266095:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116412672 00000100:00100000:3.0:1788838131.266100:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116412672 00000100:00100000:0.0:1788838131.266254:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a20b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2404:x1875729116412288:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 279us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838131.266263:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:0.0:1788838131.266298:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116412544 00000100:00100000:0.0:1788838131.266302:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116412544 00000100:00100000:0.0:1788838131.266340:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1227 00000100:00100000:0.0:1788838131.266347:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116412544:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838131.266387:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116412544:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838131.266395:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1227 00000100:00100000:0.0:1788838131.266416:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116412800 00000100:00100000:0.0:1788838131.266420:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116412800 00000100:00100000:0.0:1788838131.266446:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2546 00000100:00100000:0.0:1788838131.266453:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116412800:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838131.266477:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116412800:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838131.266483:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2546 00000100:00100000:2.0:1788838131.266906:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1228 00000100:00100000:2.0:1788838131.266915:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2404:x1875729116412416:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838131.266955:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:2404:x1875729116412416:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 41us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838131.266963:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1228 00000100:00100000:3.0:1788838131.267077:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2547 00000100:00100000:3.0:1788838131.267088:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116412672:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838131.267212:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2404:x1875729116412672:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 127us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838131.267220:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2547 00000100:00080000:0.0:1788838131.268556:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838131.268565:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838131.268568:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838131.268571:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788838131.774477:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838132.796891:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838133.821184:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838134.143928:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135051008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838134.143936:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135051136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838134.150180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838134.150388:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135051008 00000100:00100000:1.0:1788838134.150402:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135051008 00000100:00100000:1.0:1788838134.150478:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1788838134.150489:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135051008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838134.150532:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838134.150619:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135051008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838134.150626:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00080000:1.0:1788838134.150651:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838134.152245:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135051008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838134.154443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838134.158721:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135051136 00000100:00100000:2.0:1788838134.158742:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135051136 00000100:00100000:2.0:1788838134.159839:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:2.0:1788838134.159854:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135051136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838134.159894:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838134.160019:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135051136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 170us (5590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838134.160026:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00080000:3.0:1788838134.165208:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838134.166223:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135051136:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788838134.848287:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788838135.172915:0:89041:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00000100:00100000:3.0:1788838135.677117:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135051392:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.677170:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135051520:0@lo:400:kworker.0 00000100:00100000:2.0:1788838135.677369:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135051264:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.677491:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838135.677530:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60925a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135052032:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.677556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838135.677574:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135052544:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.677594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838135.677616:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788838135.677622:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135051648:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.677659:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838135.677677:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60925aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135052160:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.677710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838135.677727:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135052672:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.677747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838135.677827:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135051520 00000100:00100000:0.0:1788838135.677837:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135051520 00000100:00100000:0.0:1788838135.677897:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135051648 00000100:00100000:0.0:1788838135.677900:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135051648 00000100:00100000:0.0:1788838135.677921:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:0.0:1788838135.677931:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135051520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.677992:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135051520:12345-0@lo:400:kworker.0 Request processed in 62us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838135.678001:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:0.0:1788838135.678021:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1788838135.678027:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135051648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.678056:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135051648:12345-0@lo:400:kworker.0 Request processed in 29us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838135.678062:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1788838135.678080:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135052032 00000100:00100000:0.0:1788838135.678605:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135052032 00000100:00100000:0.0:1788838135.678651:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135052544 00000100:00100000:0.0:1788838135.678655:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135052544 00000100:00100000:0.0:1788838135.678674:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135052160 00000100:00100000:0.0:1788838135.678677:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135052160 00000100:00100000:0.0:1788838135.678691:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135052672 00000100:00100000:0.0:1788838135.678693:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135052672 00000100:00100000:0.0:1788838135.678713:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:0.0:1788838135.678719:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135052032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.678760:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135052032:12345-0@lo:400:kworker.0 Request processed in 42us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838135.678781:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:0.0:1788838135.678792:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:0.0:1788838135.678821:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135052544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.678848:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135052544:12345-0@lo:400:kworker.0 Request processed in 51us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838135.678853:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:0.0:1788838135.678863:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1788838135.678868:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135052160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.679600:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135052160:12345-0@lo:400:kworker.0 Request processed in 729us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838135.679609:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1788838135.679630:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:0.0:1788838135.679638:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135052672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.679670:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135052672:12345-0@lo:400:kworker.0 Request processed in 34us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838135.679676:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:0.0:1788838135.679780:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135051648:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.679793:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60925aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135052160:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.679834:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135052672:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.679846:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135051520:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.679858:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60925a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135052032:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.679869:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135052544:0@lo:400:kworker.0 00000100:00080000:0.0:1788838135.680006:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838135.680012:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838135.680017:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838135.680021:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838135.681599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838135.681656:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135051904:0@lo:400:kworker.0 00000100:00100000:3.0:1788838135.681720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838135.681762:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135052416:0@lo:400:kworker.0 00000100:00100000:3.0:1788838135.681782:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838135.681825:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135052928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838135.681846:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838135.682443:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135051904 00000100:00100000:3.0:1788838135.682455:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135051904 00000100:00100000:3.0:1788838135.682511:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135052416 00000100:00100000:3.0:1788838135.682514:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135052416 00000100:00100000:3.0:1788838135.682526:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135052928 00000100:00100000:3.0:1788838135.682529:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135052928 00000100:00100000:3.0:1788838135.682541:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4101 00000100:00100000:3.0:1788838135.682549:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135051904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838135.682621:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135051904:12345-0@lo:400:kworker.0 Request processed in 72us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838135.682627:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4101 00000100:00100000:3.0:1788838135.682645:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4102 00000100:00100000:3.0:1788838135.682650:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135052416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838135.682678:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135052416:12345-0@lo:400:kworker.0 Request processed in 28us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838135.682683:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4102 00000100:00100000:3.0:1788838135.682693:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4103 00000100:00100000:3.0:1788838135.682698:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135052928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838135.682722:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838135.682769:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135052928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838135.682776:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4103 00000100:00100000:3.0:1788838135.682881:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135052416:0@lo:400:kworker.0 00000100:00100000:3.0:1788838135.682897:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135052928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838135.682907:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135051904:0@lo:400:kworker.0 00000100:00100000:2.0:1788838135.683174:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838135.683235:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135051776:0@lo:400:kworker.0 00000100:00100000:2.0:1788838135.683340:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838135.683410:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60925b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135052288:0@lo:400:kworker.0 00000100:00100000:2.0:1788838135.683438:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838135.683514:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135051264 00000100:00100000:3.0:1788838135.683519:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135051264 00000100:00100000:3.0:1788838135.683553:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788838135.683560:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a20a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135051264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838135.683600:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a20a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135051264:12345-0@lo:400:kworker.0 Request processed in 41us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838135.683607:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788838135.686243:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135052800:0@lo:400:kworker.0 00000100:00100000:2.0:1788838135.686374:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838135.688195:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135051392 00000100:00100000:1.0:1788838135.688211:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135051392 00000100:00100000:0.0:1788838135.689651:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135051776 00000100:00100000:0.0:1788838135.689664:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135051776 00000100:00100000:0.0:1788838135.689745:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135052288 00000100:00100000:0.0:1788838135.689750:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135052288 00000100:00100000:0.0:1788838135.689778:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1788838135.689790:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135051392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.690058:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135051392:12345-0@lo:400:kworker.0 Request processed in 269us (8464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838135.690068:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1788838135.690105:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1788838135.690114:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135051776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.690149:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135051776:12345-0@lo:400:kworker.0 Request processed in 36us (6879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838135.690155:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1788838135.690170:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1788838135.690176:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135052288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.690203:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135052288:12345-0@lo:400:kworker.0 Request processed in 26us (6764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838135.690209:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00080000:0.0:1788838135.690260:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838135.690266:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838135.690432:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135051264:0@lo:400:kworker.0 00000100:00100000:2.0:1788838135.690450:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135051776:0@lo:400:kworker.0 00000100:00100000:2.0:1788838135.690461:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60925b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135052288:0@lo:400:kworker.0 00000100:00100000:2.0:1788838135.691784:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135051392:0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.692660:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135052800 00000100:00100000:0.0:1788838135.692673:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135052800 00000100:00100000:0.0:1788838135.692754:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1788838135.692782:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135052800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838135.694078:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135052800:12345-0@lo:400:kworker.0 Request processed in 1290us (7696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838135.694102:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:2.0:1788838135.694325:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135052800:0@lo:400:kworker.0 00010000:00010000:3.0:1788838135.871125:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788838136.192692:0:89866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00000100:00100000:0.0:1788838136.194109:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135053056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838136.194172:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838136.194212:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838136.194218:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135053184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838136.194267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838136.194343:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135053056 00000100:00100000:3.0:1788838136.194352:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135053056 00000100:00100000:3.0:1788838136.194421:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1788838136.194431:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135053056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838136.194460:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838136.194510:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135053056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838136.194518:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1788838136.194542:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135053184 00000100:00100000:3.0:1788838136.194545:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135053184 00000100:00100000:3.0:1788838136.194570:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4104 00000100:00100000:3.0:1788838136.194576:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135053184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838136.194614:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1788838136.194643:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135053184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838136.194650:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4104 00000100:00100000:3.0:1788838136.194693:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135053184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838136.194708:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135053056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838136.204370:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838136.204393:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135053312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838136.204456:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838136.204815:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135053312 00000100:00100000:0.0:1788838136.204823:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135053312 00000100:00100000:0.0:1788838136.204867:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:0.0:1788838136.204875:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135053312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788838136.204902:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838136.204942:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135053312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838136.204948:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:3.0:1788838136.205277:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135053312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838136.384208:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838136.384245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838136.384272:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116412928 00000100:00100000:0.0:1788838136.384281:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116412928 00000100:00100000:0.0:1788838136.384327:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:0.0:1788838136.384336:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a20a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116412928:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838136.384412:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a20a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116412928:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 77us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838136.384419:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:0.0:1788838136.384465:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116413056 00000100:00100000:0.0:1788838136.384468:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116413056 00000100:00100000:0.0:1788838136.384508:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1235 00000100:00100000:0.0:1788838136.384514:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2406:x1875729116413056:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838136.384545:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2406:x1875729116413056:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838136.384552:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1235 00000100:00080000:0.0:1788838136.384663:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838136.394479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838136.394526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838136.394566:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838136.394599:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116413312 00000100:00100000:0.0:1788838136.394608:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116413312 00000100:00100000:0.0:1788838136.394667:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116413440 00000100:00100000:0.0:1788838136.394671:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116413440 00000100:00100000:0.0:1788838136.394695:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2552 00000100:00100000:0.0:1788838136.394704:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116413312:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838136.394782:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116413312:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838136.394790:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2552 00000100:00100000:0.0:1788838136.394830:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2553 00000100:00100000:0.0:1788838136.394837:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116413440:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838136.394864:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116413440:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838136.394870:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2553 00000100:00080000:0.0:1788838136.394893:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838136.394911:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838136.395118:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116413184 00000100:00100000:1.0:1788838136.395123:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116413184 00000100:00100000:1.0:1788838136.395178:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1236 00000100:00100000:1.0:1788838136.395186:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116413184:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838136.395221:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116413184:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838136.395227:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1236 00000100:00080000:0.0:1788838136.395359:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788838136.892990:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788838137.803621:0:89915:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 23:28:57 (1788838137) 00010000:00010000:3.0:1788838137.916984:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838137.940376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838137.941683:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116413568 00000100:00100000:2.0:1788838137.941701:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116413568 00000100:00100000:2.0:1788838137.941778:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1214 00000100:00100000:2.0:1788838137.941790:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:69382:x1875729116413568:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838137.941831:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838137.941859:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc8d09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccd7 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.941940:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.941956:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.941978:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.941994:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8d17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942001:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942008:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942069:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942088:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942094:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942102:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942107:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838137.942112:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942120:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942132:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff60b5cf200) 00010000:00010000:2.0:1788838137.942141:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838137.942147:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942154:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc8d10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942167:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942172:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8d17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942178:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8d17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942183:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838137.942187:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8d17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942193:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8d17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942201:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff63f831700) 00010000:00010000:2.0:1788838137.942204:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838137.942207:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8d17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942213:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc8d17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942246:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc8d09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccd7 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942264:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff60b5cf200) 00010000:00010000:2.0:1788838137.942266:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838137.942270:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc8d09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccd7 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838137.942280:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8600, rc 0) 00000100:00100000:2.0:1788838137.942344:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:69382:x1875729116413568:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 557us (1979us total) trans 0 rc 301/301 00000100:00100000:2.0:1788838137.942352:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1214 00000100:00100000:0.0:1788838137.955562:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838137.955670:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116413824 00000100:00100000:1.0:1788838137.955682:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116413824 00000100:00100000:1.0:1788838137.955769:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1215 00000100:00100000:1.0:1788838137.955820:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:69382:x1875729116413824:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788838137.955848:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838137.955852:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788838137.955886:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8cc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccb4 expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.955904:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff60b5cf200) 00010000:00010000:1.0:1788838137.955916:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838137.955931:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8d1e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccde expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956061:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8d25 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956086:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8d25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956096:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8d25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956110:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956117:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956122:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956610:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956629:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956637:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838137.956647:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:1.0:1788838137.956672:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8d25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956679:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8d25 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956687:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8d25 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956693:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838137.956698:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8d25 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956706:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8d25 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956716:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff619058b00) 00010000:00010000:1.0:1788838137.956719:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838137.956722:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8d25 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956727:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8d25 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838137.956740:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d51096d reply state 00000000fbcb3852 transno 111669149700 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956758:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956765:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff619058d00) 00010000:00010000:1.0:1788838137.956767:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838137.956771:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788838137.956826:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8d1e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccde expref: 12 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956844:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccde expref: 11 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.956851:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff619058c00) 00010000:00010000:1.0:1788838137.956853:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838137.956856:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c400, rc 0) 00000100:00100000:1.0:1788838137.956943:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:69382:x1875729116413824:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1154us (1397us total) trans 111669149700 rc 0/0 00000100:00100000:1.0:1788838137.956952:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1215 00000100:00100000:0.0:1788838137.970128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838137.970638:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116414080 00000100:00100000:1.0:1788838137.970649:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116414080 00000100:00100000:1.0:1788838137.970722:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1216 00000100:00100000:1.0:1788838137.970735:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:69382:x1875729116414080:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788838137.970763:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838137.970787:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc8d41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cce5 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.970931:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.970959:0:67312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccde expref: 13 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.970969:0:67312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.971006:0:67312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccde expref: 13 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.971021:0:67312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccde expref: 13 pid: 75504 timeout: 3631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838137.971036:0:67312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:67312:1875729135053440:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788838137.971145:0:67312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6096ba480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838137.981288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838137.981435:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116414208 00000100:00100000:3.0:1788838137.981444:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116414208 00010000:00010000:3.0:1788838137.981484:0:6533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccde expref: 14 pid: 75504 timeout: 3631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838137.981526:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2545 00000100:00100000:3.0:1788838137.981537:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+14:2404:x1875729116414208:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788838137.981550:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838137.981557:0:6533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 5/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccde expref: 14 pid: 75504 timeout: 3631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838137.981570:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccde expref: 14 pid: 75504 timeout: 3631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838137.981603:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff619058c00) 00010000:00010000:3.0:1788838137.981608:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838137.981616:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838137.981622:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838137.981638:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838137.981744:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+14:2404:x1875729116414208:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 208us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838137.981751:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2545 00010000:00010000:1.0:1788838137.983513:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d33 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccde expref: 13 pid: 75504 timeout: 3631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838137.983533:0:67312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:67312:1875729135053440:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788838137.983566:0:67312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.983575:0:67312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.983580:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838137.983600:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00000004:00080000:1.0:1788838137.983743:0:67312:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x2a3:0x0], count =127 00000004:00080000:1.0:1788838137.983751:0:67312:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x2a3:0x0]+127 in llog 00000004:00080000:1.0:1788838137.983787:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x322:0x0], index 1: 0 00010000:00010000:1.0:1788838137.983937:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.983944:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.983950:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.983956:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838137.983960:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.983968:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.983985:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff619058c00) 00010000:00010000:1.0:1788838137.983988:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788838137.983992:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.983999:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8d48 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.987493:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc8d41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cce5 expref: 13 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.987520:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff619058a00) 00010000:00010000:1.0:1788838137.987524:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788838137.987550:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc8d41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cce5 expref: 13 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838137.987574:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c000, rc 0) 00000100:00100000:1.0:1788838137.987670:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:69382:x1875729116414080:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 16936us (17552us total) trans 111669149701 rc 301/301 00000100:00100000:1.0:1788838137.987680:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1216 00000100:00100000:0.0:1788838138.007595:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838138.011250:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116414464 00000100:00100000:1.0:1788838138.011268:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116414464 00000100:00100000:1.0:1788838138.011348:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:1.0:1788838138.011359:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:69382:x1875729116414464:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1788838138.011667:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:69382:x1875729116414464:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 307us (4079us total) trans 111669149702 rc 0/0 00000100:00100000:1.0:1788838138.011675:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00080000:1.0:1788838138.011701:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838138.043972:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838138.044011:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116414720 00000100:00100000:0.0:1788838138.044022:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116414720 00000100:00100000:0.0:1788838138.044100:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:0.0:1788838138.044112:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:69382:x1875729116414720:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1788838138.044368:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+14:69382:x1875729116414720:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 259us (410us total) trans 111669149703 rc 0/0 00000100:00100000:0.0:1788838138.044376:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 227 00000001:00080000:3.0:1788838138.867926:0:89041:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149703 is committed 00010000:00010000:0.0:1788838138.868943:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838138.868957:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838138.868965:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838138.868971:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838138.868976:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838138.868983:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838138.869013:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff619058d00) 00010000:00010000:0.0:1788838138.869016:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838138.869020:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838138.869026:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8d2c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838138.941642:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838138.953449:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838138.953563:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116414848 00000100:00100000:3.0:1788838138.953778:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116414848 00000100:00100000:3.0:1788838138.953868:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1217 00000100:00100000:3.0:1788838138.953878:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:69398:x1875729116414848:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788838138.953905:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838138.953931:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccec expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838138.954017:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc8d5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838138.954033:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc8d5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838138.954060:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc8d5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838138.954138:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838138.954143:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838138.954172:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc8d5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838138.954200:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccec expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838138.954219:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc8d5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccec expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838138.954228:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff619120900) 00010000:00010000:3.0:1788838138.954231:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838138.954235:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e600, rc 0) 00000100:00100000:3.0:1788838138.954316:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:69398:x1875729116414848:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 439us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838138.954324:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1217 00000100:00100000:1.0:1788838138.958897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838138.959295:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116414976 00000100:00100000:3.0:1788838138.959309:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116414976 00000100:00100000:3.0:1788838138.959381:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1218 00000100:00100000:3.0:1788838138.959392:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:69398:x1875729116414976:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838138.959443:0:75504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1788838138.959527:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:69398:x1875729116414976:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 137us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838138.959566:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1218 00000100:00100000:2.0:1788838138.966905:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838138.968518:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116415104 00000100:00100000:3.0:1788838138.968532:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116415104 00000100:00100000:3.0:1788838138.968634:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1219 00000100:00100000:3.0:1788838138.968646:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:69398:x1875729116415104:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838138.968689:0:76060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838138.968782:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:69398:x1875729116415104:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 138us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838138.968791:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1219 00000100:00080000:2.0:1788838138.969313:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838138.974291:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838138.974914:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116415232 00000100:00100000:3.0:1788838138.974926:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116415232 00000100:00100000:3.0:1788838138.975014:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2020 00000100:00100000:3.0:1788838138.975026:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:69398:x1875729116415232:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1788838138.975073:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838138.975153:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:69398:x1875729116415232:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 129us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838138.975161:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2020 00000100:00080000:2.0:1788838138.975489:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838138.979969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838138.980125:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116415360 00000100:00100000:2.0:1788838138.980136:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116415360 00000100:00100000:2.0:1788838138.980200:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2021 00000100:00100000:2.0:1788838138.980212:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:69398:x1875729116415360:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838138.980245:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838138.980309:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:69398:x1875729116415360:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 100us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838138.980317:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2021 00000100:00080000:1.0:1788838138.980488:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838139.069784:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838139.070094:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116415616 00000100:00100000:2.0:1788838139.070106:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116415616 00000100:00100000:2.0:1788838139.070182:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1220 00000100:00100000:2.0:1788838139.070194:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:69405:x1875729116415616:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00010000:2.0:1788838139.070285:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838139.070315:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc8d5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccec expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070350:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff619120900) 00010000:00010000:2.0:1788838139.070368:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838139.070440:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070455:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070465:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070485:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070491:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070497:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070902:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070911:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070918:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070932:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070937:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838139.070942:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070949:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070959:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831700) 00010000:00010000:2.0:1788838139.070961:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838139.070965:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070972:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8d64 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838139.070987:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041f2030b reply state 00000000a41a8719 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.070998:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.071004:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff63f831200) 00010000:00010000:2.0:1788838139.071006:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838139.071008:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838139.081817:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:69405:x1875729116415616:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 11600us (12017us total) trans 111669149704 rc 0/0 00000100:00100000:0.0:1788838139.081830:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1220 00000100:00100000:2.0:1788838139.124941:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838139.125089:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116415744 00000100:00100000:1.0:1788838139.125100:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116415744 00000100:00100000:1.0:1788838139.125160:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1221 00000100:00100000:1.0:1788838139.125170:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:69408:x1875729116415744:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:1.0:1788838139.125196:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838139.125218:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccf3 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838139.125299:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8d79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838139.125314:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838139.125326:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838139.125380:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788838139.125384:0:75504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788838139.125411:0:75504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838139.125440:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccf3 expref: 13 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838139.125457:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8d79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccf3 expref: 12 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838139.125466:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff619058a00) 00010000:00010000:1.0:1788838139.125469:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788838139.125473:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712cc00, rc 0) 00000100:00100000:1.0:1788838139.125556:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:69408:x1875729116415744:12345-192.168.203.30@tcp:101:rm.0 Request processed in 376us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838139.125564:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1221 00000100:00100000:2.0:1788838139.128022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838139.133191:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116415872 00000100:00100000:3.0:1788838139.133206:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116415872 00000100:00100000:3.0:1788838139.133271:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1222 00000100:00100000:3.0:1788838139.133281:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:69408:x1875729116415872:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1788838139.133307:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838139.133332:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8d80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ccfa expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.133426:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.133444:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.133457:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.133469:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8d8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.133477:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.133485:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.134428:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccc8d95 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.134444:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccc8d95 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.134456:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccc8d95 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838139.134515:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0xa:0x0]: returning size 0 00000004:00200000:3.0:1788838139.134519:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838139.135078:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccc8d95 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135115:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccc8d95 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135127:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135135:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135142:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135151:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135158:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148e200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838139.135163:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135172:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135188:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff619058a00) 00010000:00010000:3.0:1788838139.135192:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838139.135197:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135204:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccc8d87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135222:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8d8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135234:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8d8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135241:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8d8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135246:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148fc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838139.135250:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8d8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135256:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8d8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135265:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff63f831200) 00010000:00010000:3.0:1788838139.135267:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838139.135271:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8d8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135278:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8d8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135318:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8d80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccfa expref: 14 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135333:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccc8d95 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccfa expref: 13 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838139.135342:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff8ff619120d00) 00010000:00010000:3.0:1788838139.135345:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838139.135353:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148f600, rc 0) 00000100:00100000:3.0:1788838139.135445:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:69408:x1875729116415872:12345-192.168.203.30@tcp:101:rm.0 Request processed in 2164us (7500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838139.135455:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1222 00000100:00100000:3.0:1788838139.138909:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838139.139008:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116416128 00000100:00100000:2.0:1788838139.139035:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116416128 00000100:00100000:2.0:1788838139.139120:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1223 00000100:00100000:2.0:1788838139.139131:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:69408:x1875729116416128:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1788838139.139195:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788838139.139232:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccc8d95 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccfa expref: 13 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139256:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff8ff619120d00) 00010000:00010000:2.0:1788838139.139277:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8d79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccf3 expref: 12 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139287:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff619058a00) 00010000:00010000:2.0:1788838139.139293:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838139.139324:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139339:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139348:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139359:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139366:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139372:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139476:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8daa lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139484:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8daa lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139490:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8daa lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139703:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139712:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139720:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139726:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139733:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139738:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139759:0:66253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838139.139776:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8daa lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139782:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8daa lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139823:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8daa lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139829:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838139.139835:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8daa lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139845:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8daa lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139854:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff8ff63f831a00) 00010000:00010000:2.0:1788838139.139857:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788838139.139861:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8daa lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139868:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8daa lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139888:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139893:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139898:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139903:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139908:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838139.139917:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139923:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139931:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831700) 00010000:00010000:2.0:1788838139.139934:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838139.139936:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139943:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8d9c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838139.139955:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f39e3ac1 reply state 0000000059ab77db transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139966:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.139972:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff63f831200) 00010000:00010000:2.0:1788838139.139974:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838139.139977:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838139.140076:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:69408:x1875729116416128:12345-192.168.203.30@tcp:36:rm.0 Request processed in 932us (1166us total) trans 111669149705 rc 0/0 00000100:00100000:2.0:1788838139.140085:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1223 00010000:00010000:2.0:1788838139.140125:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838139.140131:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.140137:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838139.140141:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.140154:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.140163:0:63563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff8ff63f831a00) 00010000:00010000:2.0:1788838139.140166:0:63563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788838139.140169:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.140174:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc8db1 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838139.140187:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838139.140189:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838139.140190:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838139.261111:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135053568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838139.261207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838139.261256:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135053696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838139.261280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838139.261563:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135053568 00000100:00100000:2.0:1788838139.261572:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135053568 00000100:00100000:1.0:1788838139.261633:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135053696 00000100:00100000:1.0:1788838139.261638:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135053696 00000100:00100000:2.0:1788838139.261643:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:2.0:1788838139.261654:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135053568:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838139.261676:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00002000:00000024:2.0:1788838139.261681:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838139.261682:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135053696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838139.261691:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788838139.261818:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838139.261822:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838139.261826:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135053696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838139.261833:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:2.0:1788838139.265668:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135053568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4004us (4449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838139.265685:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1788838139.265858:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135053568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838139.265878:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135053696:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788838139.966329:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838140.797194:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838140.797221:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135053824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838140.797290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838140.797411:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135053824 00000100:00100000:1.0:1788838140.797420:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135053824 00000100:00100000:1.0:1788838140.797481:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105 00000100:00100000:1.0:1788838140.797490:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135053824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838140.797528:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:1.0:1788838140.797692:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135053824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 203us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838140.797699:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105 00000100:00100000:2.0:1788838140.797772:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135053824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838140.802274:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135054080:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.802360:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838140.802393:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135054592:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.802419:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838140.802436:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135055104:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.802460:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838140.802487:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788838140.802493:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135054208:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.802514:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838140.802545:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135054720:0@lo:400:kworker.0 00000100:00100000:0.0:1788838140.802757:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135053952:0@lo:400:kworker.0 00000100:00100000:2.0:1788838140.803779:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135054080 00000100:00100000:2.0:1788838140.803789:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135054080 00000100:00100000:2.0:1788838140.803879:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135054208 00000100:00100000:2.0:1788838140.803882:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135054208 00000100:00100000:2.0:1788838140.803917:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:2.0:1788838140.803928:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135054080:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838140.803963:0:75504:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff609dd7b80 x1875729135054080/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:41/0 lens 224/224 e 0 to 0 dl 1788838151 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838140.804511:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838140.804566:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135054464:0@lo:400:kworker.0 00000100:00100000:0.0:1788838140.804597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838140.804615:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135054976:0@lo:400:kworker.0 00000100:00100000:0.0:1788838140.804637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838140.804660:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788838140.804665:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135054336:0@lo:400:kworker.0 00000100:00100000:0.0:1788838140.804685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838140.804694:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135054848:0@lo:400:kworker.0 00000100:00100000:0.0:1788838140.804715:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838140.804730:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135055360:0@lo:400:kworker.0 00000100:00100000:0.0:1788838140.804749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838140.806099:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838140.806148:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135055232:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.806198:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838140.806243:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135054592 00000100:00100000:3.0:1788838140.806250:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135054592 00000100:00100000:3.0:1788838140.806292:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4106 00000100:00100000:3.0:1788838140.806301:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135054592:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788838140.806326:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff609dd4700 x1875729135054592/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:41/0 lens 224/224 e 0 to 0 dl 1788838151 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838140.806366:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135054592:12345-0@lo:400:kworker.0 Request processed in 65us (3945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838140.806373:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4106 00000100:00100000:3.0:1788838140.806395:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135055104 00000100:00100000:3.0:1788838140.806400:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135055104 00000100:00100000:3.0:1788838140.806427:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135054848 00000100:00100000:3.0:1788838140.806430:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135054848 00000100:00100000:3.0:1788838140.806448:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135054720 00000100:00100000:3.0:1788838140.806451:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135054720 00000100:00100000:3.0:1788838140.806467:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135055232 00000100:00100000:3.0:1788838140.806469:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135055232 00000100:00100000:3.0:1788838140.806486:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:3.0:1788838140.806492:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135055104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.806522:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135055104:12345-0@lo:400:kworker.0 Request processed in 30us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838140.806527:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:3.0:1788838140.806552:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:3.0:1788838140.806559:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135054848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.806588:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135054848:12345-0@lo:400:kworker.0 Request processed in 30us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838140.806593:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:3.0:1788838140.806612:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1788838140.806618:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff641349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135054720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.806645:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff641349050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135054720:12345-0@lo:400:kworker.0 Request processed in 28us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838140.806650:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1788838140.806838:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:3.0:1788838140.806844:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135055232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.806866:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135055232:12345-0@lo:400:kworker.0 Request processed in 24us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838140.806872:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:3.0:1788838140.806887:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135054464 00000100:00100000:3.0:1788838140.806891:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135054464 00000100:00100000:3.0:1788838140.806919:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135054976 00000100:00100000:3.0:1788838140.806922:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135054976 00000100:00100000:3.0:1788838140.806931:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135054336 00000100:00100000:3.0:1788838140.807849:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135054336 00000100:00100000:3.0:1788838140.807894:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135055360 00000100:00100000:3.0:1788838140.807897:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135055360 00000100:00100000:1.0:1788838140.808664:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135053952 00000100:00100000:1.0:1788838140.808672:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135053952 00000100:00100000:1.0:1788838140.808715:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788838140.808724:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a20b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135053952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838140.808818:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a20b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135053952:12345-0@lo:400:kworker.0 Request processed in 95us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838140.808824:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788838140.809130:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1788838140.809142:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135054208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.809184:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135054208:12345-0@lo:400:kworker.0 Request processed in 45us (6668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838140.809190:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1788838140.809206:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1788838140.809213:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135054464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.809242:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135054464:12345-0@lo:400:kworker.0 Request processed in 30us (4645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838140.809260:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1788838140.809273:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1788838140.809278:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135054976:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788838140.809292:0:66254:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d57800 x1875729135054976/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:41/0 lens 224/224 e 0 to 0 dl 1788838151 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838140.809320:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135054976:12345-0@lo:400:kworker.0 Request processed in 42us (4682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838140.809325:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1788838140.809335:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1788838140.809341:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135054336:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788838140.809350:0:66254:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505930000 x1875729135054336/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:41/0 lens 224/224 e 0 to 0 dl 1788838151 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838140.809375:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135054336:12345-0@lo:400:kworker.0 Request processed in 35us (4690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838140.809380:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1788838140.809391:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1788838140.809396:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135055360:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788838140.809407:0:66254:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505931f80 x1875729135055360/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:41/0 lens 224/224 e 0 to 0 dl 1788838151 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838140.809430:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135055360:12345-0@lo:400:kworker.0 Request processed in 34us (4680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838140.809435:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00080000:3.0:1788838140.809454:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838140.809459:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838140.809469:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838140.809471:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838140.810246:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135054080:12345-0@lo:400:kworker.0 Request processed in 6317us (7883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838140.810257:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:2.0:1788838140.810413:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135054208:0@lo:400:kworker.0 00000100:00100000:2.0:1788838140.810430:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135054720:0@lo:400:kworker.0 00000100:00100000:2.0:1788838140.810443:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135055232:0@lo:400:kworker.0 00000100:00100000:2.0:1788838140.810455:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135054080:0@lo:400:kworker.0 00000100:00100000:2.0:1788838140.810467:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135054592:0@lo:400:kworker.0 00000100:00100000:2.0:1788838140.810479:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135055104:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.810886:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135054336:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.811126:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135054848:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.811143:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135055360:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.811153:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135053952:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.811164:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135054464:0@lo:400:kworker.0 00000100:00100000:3.0:1788838140.811176:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135054976:0@lo:400:kworker.0 00010000:00010000:3.0:1788838140.989066:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838141.308971:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135055616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838141.309046:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838141.309075:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838141.309093:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135055488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838141.309102:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838141.309111:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135055744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838141.309133:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838141.309147:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838141.309192:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135055744 00000100:00100000:3.0:1788838141.309199:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135055744 00000100:00100000:1.0:1788838141.309213:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135055616 00000100:00100000:1.0:1788838141.309220:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135055616 00000100:00100000:1.0:1788838141.309259:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135055488 00000100:00100000:1.0:1788838141.309262:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135055488 00000100:00100000:3.0:1788838141.309274:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4107 00000100:00100000:1.0:1788838141.309282:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:3.0:1788838141.309288:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135055744:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838141.309296:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135055616:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:3.0:1788838141.309335:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445081088 avail 1298841600 00002000:00000024:1.0:1788838141.309360:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00010000:00000080:3.0:1788838141.309367:0:23765:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff609dd6d80 x1875729135055744/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:42/0 lens 224/368 e 0 to 0 dl 1788838152 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838141.309423:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135055616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838141.309430:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:1.0:1788838141.309446:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:1.0:1788838141.309452:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135055488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838141.309467:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838141.309503:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135055488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838141.309508:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:1.0:1788838141.309552:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135055488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838141.312745:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135055744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3448us (3584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838141.312764:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4107 00000100:00100000:3.0:1788838141.312894:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135055744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838141.312913:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135055616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838141.502649:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838141.502687:0:89048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116416256 00000100:00100000:1.0:1788838141.502691:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838141.502701:0:89048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116416256 00000100:00100000:1.0:1788838141.502724:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838141.502746:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838141.502762:0:89048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:1.0:1788838141.502770:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838141.502774:0:89048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2407:x1875729116416256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838141.502875:0:89048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:2407:x1875729116416256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 103us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838141.502883:0:89048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:0.0:1788838141.502921:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116416768 00000100:00100000:0.0:1788838141.502925:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116416768 00000100:00100000:0.0:1788838141.502965:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116416640 00000100:00100000:0.0:1788838141.502968:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116416640 00000100:00100000:0.0:1788838141.502994:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2558 00000100:00100000:0.0:1788838141.503001:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116416768:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838141.503035:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116416768:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838141.503041:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2558 00000100:00100000:0.0:1788838141.503068:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2559 00000100:00100000:0.0:1788838141.503074:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116416640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838141.503102:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2407:x1875729116416640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838141.503108:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2559 00000100:00080000:0.0:1788838141.504695:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838141.504706:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838141.504752:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116416512 00000100:00100000:0.0:1788838141.504765:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116416512 00000100:00100000:0.0:1788838141.504858:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116416384 00000100:00100000:0.0:1788838141.504863:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116416384 00000100:00100000:0.0:1788838141.504890:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1243 00000100:00100000:0.0:1788838141.504912:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116416512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838141.504997:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116416512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 98us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838141.505005:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1243 00000100:00100000:0.0:1788838141.505023:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1244 00000100:00100000:0.0:1788838141.505029:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:2407:x1875729116416384:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000080:0.0:1788838141.505047:0:76060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff639568a80 x1875729116416384/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:42/0 lens 224/224 e 0 to 0 dl 1788838152 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838141.505082:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:2407:x1875729116416384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 54us (2335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838141.505088:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1244 00000100:00080000:1.0:1788838141.506030:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788838141.506038:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788838142.014226:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838143.037680:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838144.061174:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838144.381184:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135055872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838144.381268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838144.381343:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135055872 00000100:00100000:1.0:1788838144.381353:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135055872 00000100:00100000:1.0:1788838144.381411:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:1.0:1788838144.381420:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135055872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838144.381452:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838144.381497:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135055872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838144.381641:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00080000:1.0:1788838144.381668:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838144.381709:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135055872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838144.381906:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838144.381916:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135056000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838144.381950:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838144.382056:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135056000 00000100:00100000:2.0:1788838144.382061:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135056000 00000100:00100000:2.0:1788838144.382109:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:2.0:1788838144.382118:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135056000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838144.382143:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838144.382224:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135056000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838144.382230:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:2.0:1788838144.382275:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135056000:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788838144.382468:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788838144.894873:0:89041:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149705 is committed 00010000:00010000:0.0:1788838144.895004:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895021:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895038:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895044:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838144.895050:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895075:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895098:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff63f831200) 00010000:00010000:0.0:1788838144.895101:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838144.895106:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895112:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc8d6b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895139:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895146:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895152:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895161:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838144.895164:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895170:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895177:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff63f831200) 00010000:00010000:0.0:1788838144.895180:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838144.895183:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838144.895195:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc8da3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.085197:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788838145.622218:0:90310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1788838145.705677:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838145.705759:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116416896 00000100:00100000:0.0:1788838145.705771:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116416896 00000100:00080000:1.0:1788838145.707350:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838145.708787:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1224 00000100:00100000:1.0:1788838145.708846:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:69475:x1875729116416896:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838145.708876:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838145.708910:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc8db8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd01 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.708996:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8dbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.709012:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.709036:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838145.709084:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788838145.709088:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788838145.709112:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.709137:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc8db8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd01 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.709170:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8dbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd01 expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.709179:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff619058b00) 00010000:00010000:1.0:1788838145.709182:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788838145.709185:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d800, rc 0) 00010000:00000080:1.0:1788838145.709194:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff610ad3800 x1875729116416896/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 576/688 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838145.709259:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:69475:x1875729116416896:12345-192.168.203.30@tcp:101:dd.0 Request processed in 425us (3592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838145.709266:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1224 00000100:00100000:0.0:1788838145.714237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838145.714273:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116417152 00000100:00100000:0.0:1788838145.714283:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116417152 00000100:00100000:0.0:1788838145.714342:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1225 00000100:00100000:0.0:1788838145.714352:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:69475:x1875729116417152:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838145.714373:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838145.714376:0:76060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788838145.714401:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d800/0x88da08396ccc8dbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd01 expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714418:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff619058b00) 00010000:00010000:0.0:1788838145.714427:0:76060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838145.714442:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8dc6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd08 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714638:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714651:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714661:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714685:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8dd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714691:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714697:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714756:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc8ddb lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714763:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc8ddb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714769:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc8ddb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838145.714778:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:0.0:1788838145.714878:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714885:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714890:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714896:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714902:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838145.714912:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714920:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714929:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff60b5cf400) 00010000:00010000:0.0:1788838145.714932:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838145.714936:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714941:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714951:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714956:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8dd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714961:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714966:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838145.714968:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714974:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714980:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff60b5cf900) 00010000:00010000:0.0:1788838145.714982:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838145.714992:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8dd4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.714998:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8dd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.715050:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8dc6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd08 expref: 12 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.715067:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc8ddb lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd08 expref: 11 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.715073:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:0.0:1788838145.715075:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838145.715077:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718e200, rc 0) 00010000:00000080:0.0:1788838145.715085:0:76060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505933100 x1875729116417152/t111669149706(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 776/848 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838145.715146:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:69475:x1875729116417152:12345-192.168.203.30@tcp:101:dd.0 Request processed in 795us (919us total) trans 111669149706 rc 0/0 00000100:00100000:0.0:1788838145.715154:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1225 00000100:00100000:1.0:1788838145.718496:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838145.718627:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116417280 00000100:00100000:3.0:1788838145.718637:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116417280 00000100:00100000:3.0:1788838145.718702:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1226 00000100:00100000:3.0:1788838145.718712:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:69475:x1875729116417280:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838145.718735:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838145.718755:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8de9 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd0f expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.718790:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8df0 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.718893:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8df0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.718905:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8df0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.719145:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8de9 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd0f expref: 13 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.719178:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8df0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd0f expref: 12 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.719187:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:3.0:1788838145.719190:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838145.719194:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148fc00, rc 0) 00010000:00000080:3.0:1788838145.719202:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff610ad0a80 x1875729116417280/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 568/1344 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838145.719312:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:69475:x1875729116417280:12345-192.168.203.30@tcp:101:dd.0 Request processed in 601us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838145.719320:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1226 00000100:00100000:2.0:1788838145.735672:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838145.735852:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116417536 00000100:00100000:3.0:1788838145.735862:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116417536 00000100:00100000:3.0:1788838145.736077:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1227 00000100:00100000:3.0:1788838145.736089:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:69475:x1875729116417536:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:3.0:1788838145.736147:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838145.736175:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc8ddb lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd08 expref: 12 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.736194:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:3.0:1788838145.736199:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838145.736383:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.736398:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.736423:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788838145.736470:0:66253:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149707 00000004:00010000:3.0:1788838145.736493:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb723f90 reply state 000000000dde4339 transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.736517:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.736523:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:3.0:1788838145.736526:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838145.736529:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1788838145.736566:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504f06d80 x1875729116417536/t111669149708(0) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 488/456 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838145.736639:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+14:69475:x1875729116417536:12345-192.168.203.30@tcp:36:dd.0 Request processed in 552us (977us total) trans 111669149708 rc 0/0 00000100:00100000:3.0:1788838145.736646:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1227 00000020:00080000:3.0:1788838145.736651:0:66253:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788838145.742688:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838145.743619:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116417664 00000100:00100000:0.0:1788838145.743634:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116417664 00000100:00100000:0.0:1788838145.743702:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1228 00000100:00100000:0.0:1788838145.743713:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+14:69475:x1875729116417664:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838145.743738:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838145.743757:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8dfe lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd16 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.743848:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8dfe lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd16 expref: 15 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.743865:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8dfe lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd16 expref: 15 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.743884:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:0.0:1788838145.743887:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788838145.743892:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718fc00, rc 0) 00010000:00000080:0.0:1788838145.743899:0:66254:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff610ad0e00 x1875729116417664/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 376/584 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838145.743962:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+15:69475:x1875729116417664:12345-192.168.203.30@tcp:101:dd.0 Request processed in 250us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.743970:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1228 00000100:00100000:0.0:1788838145.758590:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838145.758715:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116417920 00000100:00100000:1.0:1788838145.758726:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116417920 00000100:00100000:1.0:1788838145.758792:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1229 00000100:00100000:1.0:1788838145.758825:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+15:69475:x1875729116417920:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838145.758848:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838145.758851:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788838145.758877:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8dfe lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd16 expref: 15 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.758895:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:1.0:1788838145.758914:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838145.758929:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc8e05 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd1d expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.759004:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8e0c lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.759031:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8e0c lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.759042:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8e0c lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788838145.759168:0:66255:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0xb1:0x0], count =625 00000004:00080000:1.0:1788838145.759178:0:66255:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0xb1:0x0]+625 in llog 00000004:00080000:1.0:1788838145.759203:0:66255:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x322:0x0], index 0: 0 00000004:00080000:1.0:1788838145.759210:0:66255:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x323:0x0], index 1: 0 00010000:00010000:1.0:1788838145.759316:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8e0c lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd1d expref: 17 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.759325:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:1.0:1788838145.759328:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788838145.759338:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccc8e05 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd1d expref: 17 pid: 66255 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.759352:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8e0c lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd1d expref: 16 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.759381:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:1.0:1788838145.759384:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788838145.759386:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d400, rc 0) 00010000:00000080:1.0:1788838145.759393:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505930700 x1875729116417920/t111669149709(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 376/608 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838145.759468:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+16:69475:x1875729116417920:12345-192.168.203.30@tcp:101:dd.0 Request processed in 645us (888us total) trans 111669149709 rc 0/0 00000100:00100000:1.0:1788838145.759477:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1229 00000100:00100000:2.0:1788838145.765457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838145.765623:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116418048 00000100:00100000:0.0:1788838145.765635:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116418048 00000100:00100000:0.0:1788838145.765747:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5947 00000100:00100000:0.0:1788838145.765760:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:69475:x1875729116418048:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838145.765780:0:26213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838145.765832:0:26213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055a03679/0x88da08396ccc8e13 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd24 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838145.765865:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838145.765890:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x322:0x0].0x0 since=3539s v=(0 0) 00010000:00010000:0.0:1788838145.765918:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838145.765931:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055a03679/0x88da08396ccc8e13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd24 expref: 6 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.765952:0:26213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055a03679/0x88da08396ccc8e13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd24 expref: 6 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.765966:0:26213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718ec00, rc 0) 00000100:00100000:0.0:1788838145.766034:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:69475:x1875729116418048:12345-192.168.203.30@tcp:101:dd.0 Request processed in 277us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.766041:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5947 00000100:00100000:0.0:1788838145.768446:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838145.768752:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116418176 00000100:00100000:3.0:1788838145.768762:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116418176 00000100:00080000:2.0:1788838145.768966:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838145.768971:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838145.769405:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5948 00000100:00100000:3.0:1788838145.769420:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:69475:x1875729116418176:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838145.769440:0:26207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838145.769462:0:26207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8e1a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd2b expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838145.769488:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838145.769530:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x322:0x0].0x0 since=3539s v=(0 0) 00010000:00010000:3.0:1788838145.769535:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838145.769546:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8e1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd2b expref: 6 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.769566:0:26207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8e1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd2b expref: 6 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838145.769579:0:26207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e200, rc 0) 00000100:00100000:3.0:1788838145.769635:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:69475:x1875729116418176:12345-192.168.203.30@tcp:101:dd.0 Request processed in 221us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838145.769642:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5948 00000100:00100000:0.0:1788838145.772199:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838145.772304:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116418304 00000100:00100000:2.0:1788838145.772314:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116418304 00000100:00100000:2.0:1788838145.772366:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5949 00000100:00100000:2.0:1788838145.772375:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:69475:x1875729116418304:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838145.772392:0:8460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838145.772413:0:8460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc8e21 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd32 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838145.772436:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838145.772456:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x323:0x0].0x0 since=3539s v=(0 0) 00010000:00010000:2.0:1788838145.772460:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x323:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838145.772469:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc8e21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd32 expref: 7 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838145.772483:0:8460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc8e21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd32 expref: 7 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838145.772495:0:8460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9800, rc 0) 00000100:00100000:2.0:1788838145.772554:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:69475:x1875729116418304:12345-192.168.203.30@tcp:101:dd.0 Request processed in 180us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838145.772560:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5949 00000100:00100000:2.0:1788838145.775276:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838145.775317:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838145.775375:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116418432 00000100:00100000:0.0:1788838145.775385:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116418432 00002000:00010000:0.0:1788838145.775422:0:26090:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/802 (1048576->18446744073709551615) 00002000:00100000:0.0:1788838145.775426:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bcd1880 with x1875729116418432 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1788838145.775440:0:26090:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff62bcd1880. 00000100:00100000:0.0:1788838145.775469:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116418560 00000100:00100000:0.0:1788838145.775471:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116418560 00002000:00010000:0.0:1788838145.775483:0:26090:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/803 (0->18446744073709551615) 00002000:00100000:0.0:1788838145.775486:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bcd0a80 with x1875729116418560 ext(0->18446744073709551615) 00002000:00010000:0.0:1788838145.775492:0:26090:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ff62bcd0a80. 00000100:00100000:0.0:1788838145.775521:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1000 00000100:00100000:0.0:1788838145.775531:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116418432:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:0.0:1788838145.775764:0:26090:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1788838145.775768:0:26090:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb mtime from disk: 0 -> 1788838146 00002000:00010000:0.0:1788838145.775786:0:26090:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788838145.775788:0:26090:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb ctime from disk: 0 -> 1788838146 00002000:00010000:0.0:1788838145.775790:0:26090:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788838145.775869:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2405:x1875729116418432:12345-192.168.203.30@tcp:10:dd.0 Request processed in 339us (601us total) trans 4294969452 rc 0/0 00000100:00100000:0.0:1788838145.775880:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1000 00002000:00010000:0.0:1788838145.775884:0:26090:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/802 (1048576->18446744073709551615) 00002000:00100000:0.0:1788838145.775886:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bcd1880 with x1875729116418432 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1788838145.775890:0:26090:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff62bcd1880. 00000100:00100000:0.0:1788838145.776044:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1001 00000100:00100000:0.0:1788838145.776053:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2405:x1875729116418560:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:0.0:1788838145.776155:0:26090:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788838145.776158:0:26090:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb mtime from disk: 0 -> 1788838146 00002000:00010000:0.0:1788838145.776160:0:26090:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788838145.776162:0:26090:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb ctime from disk: 0 -> 1788838146 00002000:00010000:0.0:1788838145.776164:0:26090:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788838145.776186:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2405:x1875729116418560:12345-192.168.203.30@tcp:10:dd.0 Request processed in 135us (869us total) trans 4294969452 rc 0/0 00000100:00100000:0.0:1788838145.776192:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1001 00002000:00010000:0.0:1788838145.776196:0:26090:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/803 (0->18446744073709551615) 00002000:00100000:0.0:1788838145.776198:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bcd0a80 with x1875729116418560 ext(0->18446744073709551615) 00002000:00010000:0.0:1788838145.776202:0:26090:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ff62bcd0a80. 00000100:00100000:2.0:1788838145.863885:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838145.864045:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116418816 00000100:00100000:0.0:1788838145.864060:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116418816 00000100:00100000:0.0:1788838145.864140:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:0.0:1788838145.864152:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502467450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+16:69475:x1875729116418816:12345-192.168.203.30@tcp:35:dd.0 00010000:00000080:0.0:1788838145.864512:0:85392:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff502467450 x1875729116418816/t111669149710(0) o35->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 392/456 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838145.864588:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502467450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+17:69475:x1875729116418816:12345-192.168.203.30@tcp:35:dd.0 Request processed in 438us (714us total) trans 111669149710 rc 0/0 00000100:00100000:0.0:1788838145.864595:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:0.0:1788838145.885638:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838145.886179:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116418944 00000100:00100000:2.0:1788838145.886194:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116418944 00000100:00100000:2.0:1788838145.886279:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1230 00000100:00100000:2.0:1788838145.886293:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+17:69476:x1875729116418944:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838145.886325:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838145.886358:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8e28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd39 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838145.886443:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8e2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838145.886459:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8e2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838145.886470:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8e2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838145.886646:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838145.886651:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838145.886679:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8e2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838145.886706:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc8e28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd39 expref: 19 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838145.886726:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8e2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd39 expref: 18 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838145.886754:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:2.0:1788838145.886757:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838145.886761:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9e00, rc 0) 00010000:00000080:2.0:1788838145.886769:0:76060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505931c00 x1875729116418944/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 576/688 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838145.887035:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+18:69476:x1875729116418944:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 745us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838145.887044:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1230 00000100:00100000:2.0:1788838145.893655:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838145.893722:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116419200 00000100:00100000:0.0:1788838145.893732:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116419200 00000100:00100000:0.0:1788838145.893869:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1231 00000100:00100000:0.0:1788838145.893879:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+18:69476:x1875729116419200:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838145.893909:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838145.893929:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd40 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.893994:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894007:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894028:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894044:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894051:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894085:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894171:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894179:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894186:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894192:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894198:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838145.894203:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894210:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894223:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:0.0:1788838145.894226:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838145.894230:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894237:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894249:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894260:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894266:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894271:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838145.894274:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894280:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894287:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838145.894289:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838145.894291:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894297:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894329:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd40 expref: 19 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894338:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:0.0:1788838145.894340:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838145.894344:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd40 expref: 19 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.894361:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718fc00, rc 0) 00010000:00000080:0.0:1788838145.894369:0:66254:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bcd1180 x1875729116419200/t0(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 800/608 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838145.894435:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+18:69476:x1875729116419200:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 557us (790us total) trans 0 rc 301/301 00000100:00100000:0.0:1788838145.894442:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1231 00000100:00100000:2.0:1788838145.897715:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838145.898152:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116419328 00000100:00100000:1.0:1788838145.898166:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116419328 00000100:00100000:1.0:1788838145.898315:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1232 00000100:00100000:1.0:1788838145.898326:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+18:69476:x1875729116419328:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1788838145.898422:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8e4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898441:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8e4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898455:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8e4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898473:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8e52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898480:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8e52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898487:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8e52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898612:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898621:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898646:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838145.898688:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:1.0:1788838145.898693:0:75504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788838145.898706:0:75504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898721:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8e4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898727:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8e4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898734:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8e4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898740:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838145.898744:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8e4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898751:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8e4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898763:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:1.0:1788838145.898767:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838145.898771:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8e4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898778:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396ccc8e4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898819:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8e52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898826:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8e52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898831:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8e52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898836:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712cc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838145.898839:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8e52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898845:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8e52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898853:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff619058800) 00010000:00010000:1.0:1788838145.898856:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838145.898858:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8e52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898863:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396ccc8e52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898877:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898883:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898889:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.898900:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838145.898903:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.899188:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.899206:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:1.0:1788838145.899208:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838145.899212:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.899217:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccc8e59 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1788838145.899241:0:75504:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bcd3b80 x1875729116419328/t0(0) o34->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 472/728 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838145.899309:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+18:69476:x1875729116419328:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 985us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838145.899317:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1232 00000100:00100000:0.0:1788838145.917636:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135056256:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.917718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.917758:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135056768:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.917865:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.917884:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135057280:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.917908:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.917940:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788838145.917947:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135056128:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.917980:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.918014:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135056640:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918050:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.918067:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135057152:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.918107:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135057664:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.918157:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135056384:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.918227:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135056896:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918251:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.918267:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135057408:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918286:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.918304:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788838145.918309:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135056512:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918332:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.918349:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135057024:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918372:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.918387:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135057536:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838145.918440:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135056768 00000100:00100000:0.0:1788838145.918448:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135056768 00000100:00100000:0.0:1788838145.918522:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135057280 00000100:00100000:0.0:1788838145.918526:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135057280 00000100:00100000:0.0:1788838145.918548:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4108 00000100:00100000:0.0:1788838145.918556:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135056768:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838145.918581:0:8471:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff632e65180 x1875729135056768/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:46/0 lens 224/224 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838145.918626:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135056768:12345-0@lo:400:kworker.0 Request processed in 70us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.918634:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4108 00000100:00100000:0.0:1788838145.918655:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4109 00000100:00100000:0.0:1788838145.918661:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135057280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918703:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135057280:12345-0@lo:400:kworker.0 Request processed in 42us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.918710:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4109 00000100:00100000:0.0:1788838145.918729:0:89047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135056128 00000100:00100000:0.0:1788838145.918733:0:89047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135056128 00000100:00100000:0.0:1788838145.918757:0:89047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788838145.918763:0:89047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135056128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.918817:0:89047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135056128:12345-0@lo:400:kworker.0 Request processed in 32us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.918825:0:89047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788838145.918855:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135056256 00000100:00100000:0.0:1788838145.918859:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135056256 00000100:00100000:0.0:1788838145.918886:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135056640 00000100:00100000:0.0:1788838145.918889:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135056640 00000100:00100000:0.0:1788838145.918902:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135057152 00000100:00100000:0.0:1788838145.918905:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135057152 00000100:00100000:0.0:1788838145.918916:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135057664 00000100:00100000:0.0:1788838145.918918:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135057664 00000100:00100000:0.0:1788838145.918926:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135056384 00000100:00100000:0.0:1788838145.918928:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135056384 00000100:00100000:0.0:1788838145.918939:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135056512 00000100:00100000:0.0:1788838145.918941:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135056512 00000100:00100000:0.0:1788838145.918954:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1788838145.918960:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135056256:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838145.918971:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff632e66300 x1875729135056256/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:46/0 lens 224/224 e 0 to 0 dl 1788838156 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838145.919005:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135056256:12345-0@lo:400:kworker.0 Request processed in 46us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.919034:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1788838145.919050:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1788838145.919057:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135056640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.919087:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135056640:12345-0@lo:400:kworker.0 Request processed in 32us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.919093:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1788838145.919104:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1788838145.919109:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135057152:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838145.919118:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637f6b480 x1875729135057152/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:46/0 lens 224/224 e 0 to 0 dl 1788838156 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838145.919141:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135057152:12345-0@lo:400:kworker.0 Request processed in 33us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.919146:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1788838145.919158:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1788838145.919163:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135057664:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838145.919174:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff604233b80 x1875729135057664/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:46/0 lens 224/224 e 0 to 0 dl 1788838156 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838145.919200:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135057664:12345-0@lo:400:kworker.0 Request processed in 37us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.919206:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1788838145.919217:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1788838145.919222:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135056384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.919256:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135056384:12345-0@lo:400:kworker.0 Request processed in 34us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.919270:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1788838145.919282:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1788838145.919287:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135056512:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838145.919302:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff604231880 x1875729135056512/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:46/0 lens 224/224 e 0 to 0 dl 1788838156 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838145.919329:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135056512:12345-0@lo:400:kworker.0 Request processed in 42us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.919334:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1788838145.919394:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135056512:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.919406:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135056384:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.919441:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135056128:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.919452:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135056640:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.919459:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135057152:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.919468:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135057664:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.919478:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135056256:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.919488:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135056768:0@lo:400:kworker.0 00000100:00100000:0.0:1788838145.919495:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135057280:0@lo:400:kworker.0 00000100:00080000:2.0:1788838145.919778:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838145.919785:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838145.919892:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135056896 00000100:00100000:3.0:1788838145.919899:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135056896 00000100:00100000:3.0:1788838145.919945:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135057408 00000100:00100000:3.0:1788838145.919949:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135057408 00000100:00100000:3.0:1788838145.919978:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135057024 00000100:00100000:3.0:1788838145.919981:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135057024 00000100:00100000:3.0:1788838145.919999:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135057536 00000100:00100000:3.0:1788838145.920001:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135057536 00000100:00100000:3.0:1788838145.920032:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1788838145.920040:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135056896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838145.920109:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135056896:12345-0@lo:400:kworker.0 Request processed in 70us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838145.920116:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1788838145.920130:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1788838145.920136:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135057408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838145.920178:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135057408:12345-0@lo:400:kworker.0 Request processed in 42us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838145.920185:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1788838145.920197:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1788838145.920203:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135057024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838145.920230:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135057024:12345-0@lo:400:kworker.0 Request processed in 28us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838145.920236:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1788838145.920246:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1788838145.920252:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135057536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838145.920276:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135057536:12345-0@lo:400:kworker.0 Request processed in 25us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838145.920282:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1788838145.920351:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135057024:0@lo:400:kworker.0 00000100:00100000:3.0:1788838145.920362:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135057536:0@lo:400:kworker.0 00000100:00100000:3.0:1788838145.920374:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135056896:0@lo:400:kworker.0 00000100:00100000:3.0:1788838145.920385:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135057408:0@lo:400:kworker.0 00000100:00100000:1.0:1788838145.920888:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838145.920906:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135057792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838145.920959:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838145.921004:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135057792 00000100:00100000:1.0:1788838145.921010:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135057792 00000100:00100000:1.0:1788838145.921058:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4110 00000100:00100000:1.0:1788838145.921066:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135057792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838145.921103:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:1.0:1788838145.921163:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135057792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838145.921171:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4110 00000100:00100000:1.0:1788838145.921216:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135057792:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788838145.922485:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838145.922507:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838145.930074:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838145.930248:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116419584 00000100:00100000:0.0:1788838145.930260:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116419584 00000100:00100000:0.0:1788838145.930354:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1233 00000100:00100000:0.0:1788838145.930366:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+18:69478:x1875729116419584:12345-192.168.203.30@tcp:101:md5sum.0 00010000:00010000:0.0:1788838145.930394:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838145.930419:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd47 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.930514:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.930530:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.930543:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.930559:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.930566:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.930573:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.930708:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc8e75 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.930718:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc8e75 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838145.930725:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc8e75 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838145.930749:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00010000:00010000:1.0:1788838145.934774:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934794:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934858:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934867:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934874:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838145.934880:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934890:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934913:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:1.0:1788838145.934916:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838145.934922:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934928:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e800/0x88da08396ccc8e67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934947:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934971:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934977:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934982:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838145.934986:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.934992:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.935001:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff60b5cf000) 00010000:00010000:1.0:1788838145.935003:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838145.935006:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.935012:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f000/0x88da08396ccc8e6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.935377:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd47 expref: 21 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.935395:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc8e75 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd47 expref: 20 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838145.935403:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:1.0:1788838145.935406:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838145.935416:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718e200, rc 0) 00010000:00000080:1.0:1788838145.935426:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bcd2680 x1875729116419584/t111669149711(0) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 800/872 e 0 to 0 dl 1788838156 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838145.935653:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+20:69478:x1875729116419584:12345-192.168.203.30@tcp:101:md5sum.0 Request processed in 5287us (5591us total) trans 111669149711 rc 0/0 00000100:00100000:1.0:1788838145.935662:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1233 00000100:00100000:2.0:1788838145.942350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838145.943677:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116419712 00000100:00100000:3.0:1788838145.943696:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116419712 00002000:00100000:3.0:1788838145.943756:0:24876:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff8ff62bcd0380 x1875729116419712/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 488/0 e 0 to 0 dl 1788838156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838145.943769:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bcd0380 with x1875729116419712 ext(0->32767) 00002000:00010000:3.0:1788838145.943775:0:24876:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ff62bcd0380 00000100:00100000:3.0:1788838145.943854:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1002 00000100:00100000:3.0:1788838145.943866:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2405:x1875729116419712:12345-192.168.203.30@tcp:3:md5sum.0 00000100:00100000:0.0:1788838145.949126:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2405:x1875729116419712:12345-192.168.203.30@tcp:3:md5sum.0 Request processed in 5251us (6776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838145.949141:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1002 00002000:00100000:0.0:1788838145.949156:0:24876:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff8ff62bcd0380 x1875729116419712/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 488/440 e 0 to 0 dl 1788838156 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838145.949166:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bcd0380 with x1875729116419712 ext(0->32767) 00002000:00010000:0.0:1788838145.949173:0:24876:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ff62bcd0380 00000100:00100000:2.0:1788838145.970956:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838145.971094:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116419840 00000100:00100000:0.0:1788838145.971107:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116419840 00002000:00100000:0.0:1788838145.971172:0:24878:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff8ff640ef0000 x1875729116419840/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 488/0 e 0 to 0 dl 1788838156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838145.971187:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff640ef0000 with x1875729116419840 ext(32768->1048575) 00002000:00010000:0.0:1788838145.971195:0:24878:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ff640ef0000 00000100:00100000:0.0:1788838145.971236:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1003 00000100:00100000:0.0:1788838145.971248:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2405:x1875729116419840:12345-192.168.203.30@tcp:3:md5sum.0 00000100:00100000:1.0:1788838145.981034:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2405:x1875729116419840:12345-192.168.203.30@tcp:3:md5sum.0 Request processed in 9769us (10069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838145.981051:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1003 00002000:00100000:1.0:1788838145.981066:0:24878:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff8ff640ef0000 x1875729116419840/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:46/0 lens 488/440 e 0 to 0 dl 1788838156 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838145.981076:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff640ef0000 with x1875729116419840 ext(32768->1048575) 00002000:00010000:1.0:1788838145.983149:0:24878:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ff640ef0000 00000100:00100000:2.0:1788838146.013164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838146.013432:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116420096 00000100:00100000:3.0:1788838146.013444:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116420096 00000100:00100000:3.0:1788838146.013527:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:3.0:1788838146.013539:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+20:69478:x1875729116420096:12345-192.168.203.30@tcp:35:md5sum.0 00010000:00000080:3.0:1788838146.013879:0:66257:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640ef1880 x1875729116420096/t111669149712(0) o35->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:47/0 lens 392/456 e 0 to 0 dl 1788838157 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838146.013968:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+21:69478:x1875729116420096:12345-192.168.203.30@tcp:35:md5sum.0 Request processed in 431us (819us total) trans 111669149712 rc 0/0 00000100:00100000:3.0:1788838146.013976:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:2.0:1788838146.045546:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838146.045647:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116420224 00000100:00100000:0.0:1788838146.045659:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116420224 00000100:00100000:0.0:1788838146.045736:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1234 00000100:00100000:0.0:1788838146.045748:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+21:69480:x1875729116420224:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:0.0:1788838146.045872:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.045890:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.045918:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.045933:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8e8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.045941:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.045947:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046034:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046044:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046052:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838146.046107:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1788838146.046112:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788838146.046125:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046141:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046148:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046166:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046173:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046179:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838146.046184:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046192:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046206:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831b00) 00010000:00010000:0.0:1788838146.046209:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838146.046214:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046220:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718f400/0x88da08396ccc8e83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046237:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046244:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8e8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046250:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8e8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046255:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718ee00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838146.046263:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8e8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046270:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8e8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046278:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff60b5cf500) 00010000:00010000:0.0:1788838146.046281:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838146.046283:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8e8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046289:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396ccc8e8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046306:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046312:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046318:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046322:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718fc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838146.046325:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046332:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046340:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:0.0:1788838146.046342:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838146.046355:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838146.046361:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396ccc8e91 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1788838146.046385:0:76060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640ef0380 x1875729116420224/t0(0) o34->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:47/0 lens 472/728 e 0 to 0 dl 1788838157 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838146.046461:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+21:69480:x1875729116420224:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 715us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838146.046470:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1234 00010000:00010000:2.0:1788838146.114384:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838146.116092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838146.116145:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838146.116249:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116420480 00000100:00100000:0.0:1788838146.116252:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116420352 00000100:00100000:3.0:1788838146.116261:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116420480 00000100:00100000:0.0:1788838146.116261:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116420352 00002000:00100000:0.0:1788838146.116333:0:24891:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff8ff639541f80 x1875729116420352/t0(0) o4->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:47/0 lens 488/0 e 0 to 0 dl 1788838157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838146.116346:0:24891:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff639541f80 with x1875729116420352 ext(1048576->2097151) 00002000:00010000:0.0:1788838146.116351:0:24891:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff639541f80 00000100:00100000:0.0:1788838146.116379:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1004 00000100:00100000:0.0:1788838146.116390:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116420352:12345-192.168.203.30@tcp:4:md5sum.0 00000100:00100000:3.0:1788838146.116466:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5950 00000100:00100000:3.0:1788838146.116477:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116420480:12345-192.168.203.30@tcp:16:kworker.0 00000001:00080000:2.0:1788838146.125279:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969452 is committed 00000100:00100000:3.0:1788838146.125584:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116420480:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 9103us (9432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838146.125597:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5950 00000100:00100000:0.0:1788838146.172542:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116420352:12345-192.168.203.30@tcp:4:md5sum.0 Request processed in 56142us (56456us total) trans 4294969453 rc 0/0 00000100:00100000:0.0:1788838146.172557:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1004 00002000:00100000:0.0:1788838146.172571:0:24891:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff8ff639541f80 x1875729116420352/t4294969453(0) o4->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:47/0 lens 488/448 e 0 to 0 dl 1788838157 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838146.172581:0:24891:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff639541f80 with x1875729116420352 ext(1048576->2097151) 00002000:00010000:0.0:1788838146.172588:0:24891:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff639541f80 00000100:00100000:3.0:1788838146.429303:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838146.429332:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135057920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838146.429404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838146.429449:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135057920 00000100:00100000:3.0:1788838146.429456:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135057920 00000100:00100000:3.0:1788838146.429500:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1788838146.429508:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135057920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838146.429556:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838146.429596:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135057920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838146.429604:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1788838146.429661:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135057920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838146.430030:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838146.430043:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135058048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838146.430081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838146.430210:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135058048 00000100:00100000:0.0:1788838146.430216:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135058048 00000100:00100000:0.0:1788838146.430256:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4111 00000100:00100000:0.0:1788838146.430263:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135058048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838146.430290:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445081088 avail 1298841600 00010000:00000080:0.0:1788838146.430304:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff639543480 x1875729135058048/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:47/0 lens 224/368 e 0 to 0 dl 1788838157 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838146.430354:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135058048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838146.430361:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4111 00000100:00100000:0.0:1788838146.430391:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135058048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838146.432377:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838146.432406:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135058176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838146.432493:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838146.432564:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135058176 00000100:00100000:2.0:1788838146.432572:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135058176 00000100:00100000:2.0:1788838146.432618:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:2.0:1788838146.432628:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135058176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838146.432663:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838146.432726:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135058176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838146.432733:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:2.0:1788838146.432784:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135058176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838146.623648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838146.623701:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838146.623740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838146.623763:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838146.623824:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838146.623853:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116421120 00000100:00100000:3.0:1788838146.623862:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116421120 00000100:00100000:3.0:1788838146.623917:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116420992 00000100:00100000:3.0:1788838146.623920:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116420992 00000100:00100000:3.0:1788838146.623941:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2564 00000100:00100000:3.0:1788838146.623950:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116421120:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838146.624027:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116421120:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 66us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838146.624034:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2564 00000100:00100000:3.0:1788838146.624055:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2565 00000100:00100000:3.0:1788838146.624062:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116420992:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838146.624088:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116420992:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838146.624094:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2565 00000100:00100000:2.0:1788838146.624296:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116420864 00000100:00100000:2.0:1788838146.624302:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116420864 00000100:00100000:2.0:1788838146.624348:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1251 00000100:00100000:2.0:1788838146.624355:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116420864:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838146.624392:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116420864:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838146.624398:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1251 00000100:00100000:2.0:1788838146.624409:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116420736 00000100:00100000:2.0:1788838146.624412:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116420736 00000100:00100000:2.0:1788838146.624432:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1252 00000100:00100000:2.0:1788838146.624437:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+21:2406:x1875729116420736:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000080:2.0:1788838146.624452:0:75504:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505ac7b80 x1875729116420736/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:47/0 lens 224/224 e 0 to 0 dl 1788838157 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838146.624478:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+21:2406:x1875729116420736:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838146.624498:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1252 00000100:00080000:2.0:1788838146.625258:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838146.625713:0:89046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116420608 00000100:00100000:1.0:1788838146.625723:0:89046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116420608 00000100:00100000:1.0:1788838146.625786:0:89046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1788838146.625795:0:89046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116420608:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838146.625875:0:89046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116420608:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 82us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838146.625881:0:89046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00010000:00010000:3.0:1788838147.133960:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788838147.969335:0:90407:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788838147.969397:0:90407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.969413:0:90407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.969421:0:90407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.969429:0:90407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.969451:0:90407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788838147.969456:0:90407:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788838147.969496:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788838147.969501:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788838147.969525:0:90407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788838147.969553:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff50a580000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788838147.970773:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838147.970787:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.970814:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff505bb0e00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838147.970819:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.970843:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838147.970849:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135058304:0@lo:39:umount.0 10000000:00010000:1.0:1788838147.970851:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838147.970857:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838147.970859:0:6534:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:2.0:1788838147.970922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838147.971058:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135058304 00000100:00100000:0.0:1788838147.971067:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135058304 00000100:00100000:0.0:1788838147.971123:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1788838147.971132:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729135058304:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788838147.971160:0:76060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8ac4 00000100:00080000:0.0:1788838147.971178:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff632fef800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1788838147.971209:0:76060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff639541500 x1875729135058304/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:48/0 lens 224/224 e 0 to 0 dl 1788838158 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838147.971259:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1875729135058304:12345-0@lo:39:umount.0 Request processed in 128us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838147.971267:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000020:00000080:0.0:1788838147.971281:0:76060:0:(genops.c:885:class_export_put()) final put ffff8ff632fe8000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788838147.971398:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff50a580000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788838147.971417:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135058304:0@lo:39:umount.0 00000100:00080000:0.0:1788838147.971472:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788838147.971476:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788838147.971480:0:90407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788838147.972517:0:90407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972535:0:90407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972543:0:90407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972551:0:90407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972586:0:90407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838147.972592:0:90407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972598:0:90407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972603:0:90407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972609:0:90407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972620:0:90407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838147.972626:0:90407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972632:0:90407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972638:0:90407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972644:0:90407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972651:0:90407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788838147.972656:0:90407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972670:0:90407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972676:0:90407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972683:0:90407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838147.972690:0:90407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788838147.972694:0:90407:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788838147.972727:0:90407:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788838147.972732:0:90407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1788838147.972737:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788838147.972743:0:90407:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 10000000:01000000:1.0:1788838147.974208:0:6534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788838147.974270:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974283:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838147.974325:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974334:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0e00/0x88da08396ccc89a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc89ac expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974354:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788838147.974360:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974367:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297b600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838147.974371:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974380:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838147.974406:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838147.974412:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838147.974415:0:6534:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788838147.974417:0:6534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1788838147.974432:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974438:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838147.974453:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974460:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff63297b600/0x88da08396ccc88be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc88d3 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974470:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838147.974474:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974480:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838147.974483:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974491:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838147.974497:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838147.974514:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838147.974517:0:6534:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788838147.974519:0:6534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788838147.974532:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974539:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838147.974545:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974552:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc89cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc89d6 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974560:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838147.974564:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974569:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297aa00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838147.974572:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974579:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838147.974586:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838147.974591:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788838147.974593:0:6534:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788838147.974595:0:6534:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788838147.974613:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974619:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838147.974625:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974631:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff63297aa00/0x88da08396ccc8997 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc899e expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974641:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838147.974644:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974649:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63297a400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838147.974651:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974658:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838147.974663:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838147.974668:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838147.974670:0:6534:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788838147.974672:0:6534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000004:00000080:0.0:1788838147.974672:0:90407:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:1.0:1788838147.974683:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974687:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838147.974691:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974715:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff63297a400/0x88da08396ccc88b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc88b7 expref: -99 pid: 89040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.974724:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838147.974726:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838147.974728:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838147.974755:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135058816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838147.974870:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838147.974938:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788838147.974944:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135058432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838147.974968:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838147.974983:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135058944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838147.975017:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838147.975046:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135058560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838147.975073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838147.975090:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838147.975096:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135058688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838147.975117:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788838147.975126:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838147.975151:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135058816 00000100:00100000:1.0:1788838147.975160:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135058816 00000100:00100000:1.0:1788838147.975210:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135058432 00000100:00100000:1.0:1788838147.975212:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135058432 00000100:00100000:1.0:1788838147.975222:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135058944 00000100:00100000:1.0:1788838147.975224:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135058944 00000100:00100000:1.0:1788838147.975234:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135058560 00000100:00100000:1.0:1788838147.975236:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135058560 00000100:00100000:1.0:1788838147.975246:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135058688 00000100:00100000:1.0:1788838147.975255:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135058688 00000100:00100000:1.0:1788838147.975274:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1788838147.975283:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+28:3643:x1875729135058816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838147.975297:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838147.975316:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50718e600/0x88da08396ccc899e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8997 expref: 28 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.975331:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838147.975369:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+27:3643:x1875729135058816:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838147.975376:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1788838147.975426:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1788838147.975433:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+26:3643:x1875729135058432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838147.975439:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838147.975448:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5e200/0x88da08396ccc89ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc89a5 expref: 26 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.975456:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838147.975477:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+25:3643:x1875729135058432:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838147.975483:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1788838147.975495:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1788838147.975500:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135058944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838147.975507:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838147.975514:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50718ea00/0x88da08396ccc88b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc88b0 expref: 24 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.975522:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838147.975549:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3643:x1875729135058944:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838147.975555:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1788838147.975567:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1788838147.975572:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3645:x1875729135058560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838147.975579:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838147.975586:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50718f200/0x88da08396ccc88d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc88be expref: 22 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.975593:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838147.975629:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3645:x1875729135058560:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838147.975634:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1788838147.975645:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1788838147.975651:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3645:x1875729135058688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838147.975657:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838147.975665:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5e600/0x88da08396ccc89d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc89cf expref: 20 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838147.975672:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838147.975691:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:3645:x1875729135058688:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838147.975696:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1788838147.975734:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135058432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838147.975743:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135058944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838147.975750:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135058816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838147.976429:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135058688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838147.976439:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135058560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838147.976628:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788838147.976641:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632fe8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788838147.976703:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff632fef800 for lustre-MDT0000 00010000:00010000:3.0:1788838147.976715:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788838147.977059:0:89041:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149712 is committed 00010000:00010000:2.0:1788838147.977142:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.977153:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.977159:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.977166:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148fe00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838147.977171:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.977179:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.977197:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:2.0:1788838147.977200:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838147.977217:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.977224:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccc8df7 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788838147.977592:0:90407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1788838147.977602:0:90407:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff6104df000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838147.977609:0:90407:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff6104de800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838147.977616:0:90407:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff6048e0000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838147.977621:0:90407:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff609257000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838147.977629:0:90407:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff609253000 fdcf066d-ff07-4b2e-96ab-52415ed6bf72 192.168.203.30@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 111669149712 stale:0 00000020:00080000:0.0:1788838147.977635:0:90407:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8ff608220000) has exports, disconnecting them 00000020:00080000:0.0:1788838147.977641:0:90407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff6104df000), last request at 1788838115 00000020:00000080:0.0:1788838147.977649:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8abd 00000100:00080000:0.0:1788838147.977659:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff6104d9800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838147.977702:0:90407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff6104df000): rc 0 00000020:00000080:0.0:1788838147.977705:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff6104df000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788838147.977720:0:90407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff6104de800), last request at 1788838145 00000020:00000080:0.0:1788838147.977723:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8ab6 00000100:00080000:0.0:1788838147.977728:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff6104df800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838147.977737:0:90407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff6104de800): rc 0 00000020:00000080:0.0:1788838147.977740:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff6104de800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788838147.977744:0:90407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff6048e0000), last request at 1788838145 00000020:00000080:0.0:1788838147.977748:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8aaf 00000100:00080000:0.0:1788838147.977751:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff6048e2800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838147.977758:0:90407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff6048e0000): rc 0 00000020:00000080:0.0:1788838147.977761:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff6048e0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788838147.977764:0:90407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff609257000), last request at 1788838109 00000020:00000080:0.0:1788838147.977777:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8919 00000100:00080000:0.0:1788838147.977788:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff5031c0800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838147.977857:0:90407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff609257000): rc 0 00000020:00000080:0.0:1788838147.977859:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff609257000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1788838147.977864:0:90407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.30@tcp (ffff8ff609253000), last request at 1788838146 00000020:00000080:0.0:1788838147.977868:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8912 00000020:00010000:0.0:1788838147.977874:0:90407:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff609253000: total 4 00000100:00080000:0.0:1788838147.977878:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff50a9bc800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838147.977885:0:90407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff609253000): rc 0 00000004:00000080:0.0:1788838147.977891:0:90407:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f51879e3ae0 00000100:00080000:0.0:1788838147.977911:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788838147.977915:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:2.0:1788838147.978818:0:6535:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff609253000: total 4 00010000:00010000:2.0:1788838147.978828:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838147.978900:0:6535:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff609253000, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1788838147.978939:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccc8cfb lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccc9 expref: 8 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.978961:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc8e2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd39 expref: 7 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.978983:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718e200/0x88da08396ccc8e75 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd47 expref: 6 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.978995:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396ccc8cf4 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccc2 expref: 5 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.979018:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccc8d02 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccd0 expref: 4 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.979035:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccc8e0c lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd1d expref: 3 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.979046:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccc8df0 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd0f expref: 2 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838147.979078:0:6535:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff609253000, canceled 7 locks, left on hash table 0. 00000020:00000080:1.0:1788838147.980373:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104df000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788838147.980425:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104de800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788838147.980444:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6048e0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788838147.980467:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff609257000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788838147.980490:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6104d9800 for lustre-MDT0000 00000020:00000080:1.0:1788838147.980496:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6104df800 for lustre-MDT0000 00000020:00000080:1.0:1788838147.980499:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6048e2800 for lustre-MDT0000 00000020:00000080:1.0:1788838147.980502:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5031c0800 for lustre-MDT0000 00010000:00010000:1.0:1788838147.981310:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838147.981602:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838147.981609:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838147.982169:0:90407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788838147.982205:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff503193800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788838147.982268:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135059072:0@lo:39:umount.0 00000100:00100000:3.0:1788838147.982348:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838147.982434:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135059072 00000100:00100000:1.0:1788838147.982443:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135059072 00000100:00100000:1.0:1788838147.982504:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4112 00000100:00100000:1.0:1788838147.982513:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135059072:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788838147.982546:0:8471:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8958 00000100:00080000:1.0:1788838147.982556:0:8471:0:(import.c:65:import_set_state_nolock()) ffff8ff509c75000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788838147.982578:0:8471:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411436 00010000:00010000:0.0:1788838147.984580:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838147.988601:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3642:x1875729135059072:12345-0@lo:39:umount.0 Request processed in 6078us (6241us total) trans 77309411437 rc 0/0 00000100:00100000:1.0:1788838147.988618:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4112 00000100:00080000:0.0:1788838147.988933:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788838147.988939:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:0.0:1788838147.988956:0:90407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788838147.989031:0:90407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788838147.989069:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff509c71000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788838147.989084:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788838147.989086:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:0.0:1788838147.989102:0:90407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788838147.989169:0:90407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788838147.989180:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff61d4bb800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788838147.989228:0:90407:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff608220000) has no exports 00000020:00080000:0.0:1788838147.989895:0:90407:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff608220000) has no exports 00000100:00080000:3.0:1788838147.996081:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff503193800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788838147.996103:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135059072:0@lo:39:umount.0 00000100:00100000:3.0:1788838147.996134:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135059200:0@lo:9:umount.0 00000100:00100000:3.0:1788838147.996221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838147.996272:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135059328:0@lo:9:umount.0 00000100:00100000:3.0:1788838147.996294:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838147.996352:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135059200 00000100:00100000:3.0:1788838147.996360:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135059200 00000100:00100000:1.0:1788838147.996481:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135059328 00000100:00100000:1.0:1788838147.996486:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135059328 00000100:00100000:1.0:1788838147.996532:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5951 00000100:00100000:1.0:1788838147.996543:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135059328:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788838147.996575:0:20253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8982 00000100:00080000:1.0:1788838147.996585:0:20253:0:(import.c:65:import_set_state_nolock()) ffff8ff61d4bb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788838147.996630:0:20253:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:1.0:1788838147.996772:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729135059328:12345-0@lo:9:umount.0 Request processed in 231us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838147.996795:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5951 00000100:00100000:3.0:1788838147.997105:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5952 00000100:00100000:3.0:1788838147.997114:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135059200:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788838147.997131:0:26216:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8966 00000100:00080000:3.0:1788838147.997137:0:26216:0:(import.c:65:import_set_state_nolock()) ffff8ff632f50000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788838147.997170:0:26216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:3.0:1788838147.997261:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729135059200:12345-0@lo:9:umount.0 Request processed in 149us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838147.997268:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5952 00010000:00010000:3.0:1788838147.997293:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838147.997313:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838147.997347:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff509c71000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788838147.997361:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788838147.997363:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788838147.997368:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135059200:0@lo:9:umount.0 00000100:00080000:3.0:1788838147.997381:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff61d4bb800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788838147.997388:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788838147.997390:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788838147.997392:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135059328:0@lo:9:umount.0 00000100:00080000:3.0:1788838147.997885:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838147.997892:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788838148.014690:0:6535:0:(genops.c:885:class_export_put()) final put ffff8ff609253000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00010000:00010000:1.0:1788838148.014821:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838148.014825:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838148.014827:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788838148.017323:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff609253000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-MDT0000 00000020:00000080:2.0:1788838148.017546:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50a9bc800 for lustre-MDT0000 00000020:00000080:0.0:1788838148.057071:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc892e 00000020:00000080:0.0:1788838148.057088:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff62ceaa800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788838148.057111:0:90407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788838148.057547:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceaa800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788838148.058304:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838148.058331:0:90407:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788838148.058336:0:90407:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ff608224d28) has no exports 00000020:00000080:1.0:1788838148.059750:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8927 00000020:00000080:1.0:1788838148.059762:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff63f7cf800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788838148.059825:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff63f7cf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788838148.059848:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838148.059860:0:90407:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788838148.059863:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff509c66000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788838148.059865:0:90407:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c66000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788838148.059873:0:90407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788838148.059998:0:90407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff610de8780 - data 0000000000000000/ffff8ff50a226800 00000020:01000000:1.0:1788838148.060025:0:90407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff640e74e40 - data ffff8ff633f93438/ffff8ff60891e400 00000020:01000000:1.0:1788838148.060163:0:90407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff50579f7e0 - data ffff8ff633dc4798/ffff8ff50489d000 00000100:00080000:3.0:1788838148.107606:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788838148.107618:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788838148.107637:0:90407:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ff640735f80 x1875729135059072/t77309411437(77309411437) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838157 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838148.107672:0:90407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788838148.109543:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788838148.109551:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:3.0:1788838148.109903:0:90407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788838148.109907:0:90407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788838148.110161:0:89059:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788838148.110166:0:89059:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:1.0:1788838148.110176:0:89059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:3.0:1788838148.110769:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788838148.110774:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:3.0:1788838148.110819:0:90407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788838148.110822:0:90407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788838148.111074:0:89061:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788838148.111079:0:89061:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:0.0:1788838148.111090:0:89061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:3.0:1788838148.111864:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc88e8 00000020:00000080:3.0:1788838148.111877:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff6271d6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788838148.112496:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc88fd 00000020:00000080:3.0:1788838148.112504:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff609254800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788838148.112511:0:90407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788838148.112515:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788838148.112540:0:90407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788838148.112545:0:90407:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8ff6082219b8) has no exports 00000004:01000000:3.0:1788838148.112709:0:90407:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788838148.112718:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc897b 00000020:00000080:3.0:1788838148.112722:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff505bfe800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788838148.112726:0:90407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788838148.112730:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788838148.112737:0:90407:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788838148.112740:0:90407:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8ff6271ccd28) has no exports 00000020:00000080:3.0:1788838148.112744:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8974 00000020:00000080:3.0:1788838148.112747:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff5021a1000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788838148.113115:0:90407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788838148.113120:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788838148.113124:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:3.0:1788838148.113128:0:90407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788838148.113130:0:90407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788838148.113159:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788838148.113167:0:90407:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788838148.113171:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc895f 00000020:00000080:3.0:1788838148.113177:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff50711b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788838148.113180:0:90407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788838148.113183:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788838148.113188:0:90407:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788838148.113190:0:90407:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8ff503ca19b8) has no exports 00000020:00000080:3.0:1788838148.113194:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8951 00000020:00000080:3.0:1788838148.113197:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff509c76000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788838148.113501:0:90407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788838148.113505:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788838148.113507:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:3.0:1788838148.113510:0:90407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788838148.113512:0:90407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788838148.113535:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788838148.113548:0:90407:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788838148.113557:0:90407:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788838148.113562:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8943 00000020:00000080:3.0:1788838148.113566:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff50711b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788838148.113570:0:90407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788838148.113573:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788838148.113577:0:90407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788838148.113579:0:90407:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8ff6395619b8) has no exports 00000020:00000080:3.0:1788838148.113583:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc893c 00000020:00000080:3.0:1788838148.113586:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff6271d7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788838148.114380:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6271d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788838148.114391:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff609254800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788838148.114395:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff505bfe800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788838148.114400:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5021a1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788838148.114405:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff61d4bb800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788838148.114411:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff50711a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838148.114414:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50711a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788838148.114419:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838148.114503:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50711b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788838148.114509:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c76000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788838148.114513:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff509c71000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788838148.114528:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff50711f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838148.114530:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50711f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788838148.114534:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838148.114569:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50711b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788838148.114574:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6271d7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788838148.119895:0:90407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788838148.119905:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788838148.119911:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788838148.119919:0:90407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788838148.119989:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838148.120017:0:90407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838148.120062:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838148.120067:0:90407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838148.120073:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff50345a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838148.120079:0:90407:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50345a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788838148.120089:0:90407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838148.120220:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8904 00000020:00000080:0.0:1788838148.120228:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff609251000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788838148.120234:0:90407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788838148.120238:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838148.120244:0:90407:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788838148.120248:0:90407:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ff608223370) has no exports 00000020:00000080:0.0:1788838148.120271:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838148.120276:0:90407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788838148.120280:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc890b 00000020:00000080:0.0:1788838148.120285:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff609250800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788838148.120294:0:90407:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff627d1b000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788838148.120296:0:90407:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff627d1b000 3 00000020:01000004:0.0:1788838148.120299:0:90407:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff627d1b000 from lustre-MDT0000 00000020:00000080:0.0:1788838148.120317:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838148.120335:0:90407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788838148.120338:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff6271d3000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788838148.120340:0:90407:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6271d3000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788838148.120347:0:90407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788838148.120379:0:90407:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788838148.120383:0:90407:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788838148.120386:0:90407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788838148.120388:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838148.120391:0:90407:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788838148.120399:0:90407:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff50a9bf800 4043f878-3455-4729-a2a8-e06e8394cc00 192.168.203.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838148.120406:0:90407:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff639652800 57943c9a-ca27-46d8-8845-5d2bce640e45 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838148.120410:0:90407:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8ff6102419b8) has exports, disconnecting them 00000020:00080000:0.0:1788838148.120415:0:90407:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.30@tcp (ffff8ff50a9bf800), last request at 1788838110 00000020:00000080:0.0:1788838148.120440:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc89c8 00000020:00010000:0.0:1788838148.120445:0:90407:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff50a9bf800: total 2 00000100:00080000:0.0:1788838148.120448:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff50a9b9800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838148.120459:0:90407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff50a9bf800): rc 0 00000020:00080000:0.0:1788838148.120462:0:90407:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ff639652800), last request at 1788838109 00000020:00010000:0.0:1788838148.120509:0:6534:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff50a9bf800: total 2 00010000:00010000:0.0:1788838148.120535:0:6534:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff50a9bf800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788838148.120571:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff63297a600/0x88da08396ccc8a93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc98 expref: 5 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.120592:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5fc00/0x88da08396ccc8aa1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cca6 expref: 4 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.120605:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5e400/0x88da08396ccc8a9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cc9f expref: 3 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.120618:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5ec00/0x88da08396ccc8aa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ccad expref: 2 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.120637:0:6534:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff50a9bf800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788838148.120659:0:6534:0:(genops.c:885:class_export_put()) final put ffff8ff50a9bf800/4043f878-3455-4729-a2a8-e06e8394cc00 00010000:00010000:0.0:1788838148.120666:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838148.120668:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838148.120670:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788838148.120686:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc88a2 00000020:00010000:0.0:1788838148.120690:0:90407:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff639652800: total 3 00000100:00080000:0.0:1788838148.120692:0:90407:0:(import.c:65:import_set_state_nolock()) ffff8ff639653000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838148.120707:0:90407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff639652800): rc 0 00000020:00080000:0.0:1788838148.120711:0:90407:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ff6102419b8) has no exports 00000100:00100000:0.0:1788838148.120769:0:89048:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ff63a290e00:89048] 2 exiting: rc = 0 00000100:00100000:1.0:1788838148.120992:0:89046:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ff63980c400:89046] 0 exiting: rc = 1 00000020:00000080:1.0:1788838148.121047:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff503193800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788838148.121056:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff509c76800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788838148.121059:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c76800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788838148.121063:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838148.121120:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff609251000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788838148.121124:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff50345e000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788838148.121126:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50345e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788838148.121130:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788838148.121170:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff609250800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788838148.121176:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50a9bf800/4043f878-3455-4729-a2a8-e06e8394cc00 for MGS 00000020:00000080:1.0:1788838148.121209:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50a9b9800 for MGS 00000100:00100000:2.0:1788838148.122682:0:89047:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ff505674600:89047] 1 exiting: rc = 0 00000100:00100000:0.0:1788838148.122904:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122913:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122919:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122925:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122932:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122938:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122943:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122948:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122954:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122959:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122965:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122970:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122976:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122983:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122988:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.122994:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123000:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123017:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123024:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123029:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123049:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123054:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123060:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123066:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123072:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123079:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123085:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123090:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123095:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123101:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123107:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123112:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123117:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123123:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123128:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123134:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123139:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123144:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123149:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123154:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123160:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123165:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123172:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123176:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123181:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123186:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123192:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123197:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123203:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123207:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123213:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123218:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123224:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123229:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123235:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123249:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123254:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123259:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123264:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123269:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123273:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123279:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123285:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838148.123291:0:90407:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1788838148.124191:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff61de5f200/0x88da08396ccc8a7e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc8a77 expref: 14 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124215:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f200/0x88da08396ccc8a7e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc8a77 expref: 14 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124233:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff61de5f000/0x88da08396ccc89e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc89dd expref: 13 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124242:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f000/0x88da08396ccc89e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc89dd expref: 13 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124250:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff61de5fe00/0x88da08396ccc8a00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc89f9 expref: 12 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124257:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5fe00/0x88da08396ccc8a00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc89f9 expref: 12 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124264:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff505bb0400/0x88da08396ccc8a2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc8a23 expref: 11 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124274:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff505bb0400/0x88da08396ccc8a2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc8a23 expref: 11 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124297:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff505bb1200/0x88da08396ccc8a38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc8a31 expref: 10 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124306:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff505bb1200/0x88da08396ccc8a38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc8a31 expref: 10 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124313:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff505bb1e00/0x88da08396ccc8a54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc8a4d expref: 9 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124321:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff505bb1e00/0x88da08396ccc8a54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc8a4d expref: 9 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124329:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff505bb1800/0x88da08396ccc8a62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc8a5b expref: 8 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124335:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff505bb1800/0x88da08396ccc8a62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc8a5b expref: 8 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124343:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc8a8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc8a85 expref: 7 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124350:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff61de5f600/0x88da08396ccc8a8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc8a85 expref: 7 pid: 89047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124362:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff50718f800/0x88da08396ccc89f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc89eb expref: 6 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124370:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50718f800/0x88da08396ccc89f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc89eb expref: 6 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124391:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff50718e000/0x88da08396ccc8a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc8a07 expref: 5 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124400:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50718e000/0x88da08396ccc8a0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc8a07 expref: 5 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124410:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff505bb0000/0x88da08396ccc8a1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc8a15 expref: 4 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124418:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff505bb0000/0x88da08396ccc8a1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc8a15 expref: 4 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124426:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff505bb1400/0x88da08396ccc8a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc8a3f expref: 3 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124434:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff505bb1400/0x88da08396ccc8a46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc8a3f expref: 3 pid: 89048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124441:0:90407:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8ff505bb0200/0x88da08396ccc8a70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x88da08396ccc8a69 expref: 2 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838148.124448:0:90407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff505bb0200/0x88da08396ccc8a70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x88da08396ccc8a69 expref: 2 pid: 89046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1788838148.139420:0:15289:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff639652800: total 0 00010000:00010000:3.0:1788838148.139495:0:15289:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff639652800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788838148.139513:0:15289:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff639652800, canceled 0 locks, left on hash table 0. 00000020:00000080:3.0:1788838148.139524:0:15289:0:(genops.c:885:class_export_put()) final put ffff8ff639652800/57943c9a-ca27-46d8-8845-5d2bce640e45 00010000:00010000:3.0:1788838148.139584:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838148.139587:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838148.139589:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838148.139959:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff639652800/57943c9a-ca27-46d8-8845-5d2bce640e45 for MGS 00000020:00000080:1.0:1788838148.140367:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff639653000 for MGS 00010000:00010000:3.0:1788838148.162764:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838149.185607:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838149.501103:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838149.501131:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135059456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838149.501215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838149.501404:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135059456 00000100:00100000:0.0:1788838149.501414:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135059456 00000100:00100000:0.0:1788838149.501501:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:0.0:1788838149.501512:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135059456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838149.501554:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838149.501628:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135059456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838149.501635:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:0.0:1788838149.501704:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135059456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838149.502228:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135059584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838149.502273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838149.502383:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135059584 00000100:00100000:0.0:1788838149.502388:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135059584 00000100:00100000:0.0:1788838149.502429:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:0.0:1788838149.502438:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135059584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838149.502461:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838149.502513:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135059584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838149.502654:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135059584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838149.503372:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00080000:3.0:1788838149.503654:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838149.503660:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:0.0:1788838150.140905:0:90407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff50579fa80 - data ffff8ff63fd68510/ffff8ff627fe3400 00000020:01000000:0.0:1788838150.141071:0:90407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff610f24d80 - data ffff8ff501c9ae58/ffff8ff503eec800 00000020:00000080:0.0:1788838150.141498:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc889b 00000020:00000080:0.0:1788838150.141506:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff503546000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788838150.141531:0:90407:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff627d1b000 from MGS, refs=2 00000020:01000004:0.0:1788838150.141535:0:90407:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff627d1b000 2 00000020:01000004:0.0:1788838150.141538:0:90407:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff627d1b000 from MGS 00000020:00000080:0.0:1788838150.141559:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838150.141566:0:90407:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788838150.141569:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff503544000/MGS 00000020:00000080:0.0:1788838150.141571:0:90407:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503544000/MGS for MGS 00000020:01000000:0.0:1788838150.141578:0:90407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788838150.141656:0:90407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788838150.141660:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838150.141670:0:90407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788838150.141677:0:90407:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ff6048e5000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838150.141683:0:90407:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8ff503ca3370) has exports, disconnecting them 00000020:00080000:0.0:1788838150.141955:0:90407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ff6048e5000), last request at 1788838109 00000020:00000080:0.0:1788838150.141959:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc89ba 00000020:00080000:0.0:1788838150.141969:0:90407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff6048e5000): rc 0 00000020:00000080:0.0:1788838150.141973:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff6048e5000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788838150.143024:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503546000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788838150.143044:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6048e5000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788838150.143072:0:90407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788838150.143076:0:90407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788838150.143081:0:90407:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788838150.143086:0:90407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788838150.143238:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838150.143250:0:90407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788838150.143255:0:90407:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff627d1b000 1 00000020:00000080:1.0:1788838150.143260:0:90407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc888d 00000020:00000080:1.0:1788838150.143267:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff627d1a000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788838150.143271:0:90407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788838150.143275:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838150.143278:0:90407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788838150.143281:0:90407:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ff610240000) has no exports 00000020:00000080:3.0:1788838150.145928:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50a580000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788838150.145944:0:86008:0:(genops.c:885:class_export_put()) final put ffff8ff602d1e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788838150.145947:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff602d1e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788838150.145957:0:86008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788838150.146052:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d1a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788838150.175937:0:90407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838150.175951:0:90407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788838150.175956:0:90407:0:(genops.c:885:class_export_put()) final put ffff8ff627d1f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788838150.175960:0:90407:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d1f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788838150.175971:0:90407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788838150.176103:0:90407:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ff627d1c000 00000020:02000400:2.0:1788838150.176165:0:90407:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788838150.216251:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838151.038271:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135059712:0@lo:400:kworker.0 00000100:00100000:3.0:1788838151.038302:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135059840:0@lo:400:kworker.0 00000100:00100000:3.0:1788838151.039009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838151.039141:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135059840 00000100:00100000:3.0:1788838151.039153:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135059840 00000100:00100000:3.0:1788838151.039212:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000400:00000100:1.0:1788838151.039218:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135059712 offset 0 length 224: 4 00000100:00100000:3.0:1788838151.039221:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875729135059840:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838151.039230:0:75504:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838151.039282:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875729135059840:12345-0@lo:400:kworker.0 Request processed in 59us (275us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838151.039289:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00080000:3.0:1788838151.039337:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838151.039343:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838151.039348:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788838151.039354:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838151.039359:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3509 00000100:00080000:3.0:1788838151.039367:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838151.039408:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bc94380 x1875729135060096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838151.039439:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135059840:0@lo:400:kworker.0 00000100:00100000:2.0:1788838151.039503:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135060096:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788838151.039543:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838151.039673:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135060096 00000100:00100000:1.0:1788838151.039678:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135060096 00000100:00100000:1.0:1788838151.039714:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1788838151.039720:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135060096:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788838151.039755:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838151.039792:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135060096:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 71us (249us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838151.039821:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00080000:1.0:1788838151.039855:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838151.039860:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838151.039863:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135060096:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788838151.040930:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135059968:0@lo:400:kworker.0 00000100:00100000:0.0:1788838151.041009:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838151.041057:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135060608:0@lo:400:kworker.0 00000100:00100000:0.0:1788838151.041086:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838151.041110:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788838151.041115:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135060224:0@lo:400:kworker.0 00000100:00100000:0.0:1788838151.041138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838151.041155:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135060736:0@lo:400:kworker.0 00000100:00100000:0.0:1788838151.041173:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838151.041205:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135059968 00000100:00100000:0.0:1788838151.041211:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135059968 00000100:00100000:0.0:1788838151.041267:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135060224 00000100:00100000:0.0:1788838151.041269:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135060224 00000100:00100000:0.0:1788838151.041289:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1788838151.041298:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135059968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838151.041390:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135060352:0@lo:400:kworker.0 00000100:00100000:1.0:1788838151.041426:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838151.041448:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135060864:0@lo:400:kworker.0 00000100:00100000:1.0:1788838151.041471:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838151.041495:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838151.041500:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135060480:0@lo:400:kworker.0 00000100:00100000:1.0:1788838151.041528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838151.041559:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135060352 00000100:00100000:1.0:1788838151.041563:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135060352 00000100:00100000:1.0:1788838151.041589:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135060864 00000100:00100000:1.0:1788838151.041592:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135060864 00000100:00100000:1.0:1788838151.041617:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1788838151.041624:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135060352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838151.041693:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135060352:12345-0@lo:400:kworker.0 Request processed in 68us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838151.041701:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1788838151.041720:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1788838151.041725:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875729135060224:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788838151.041754:0:66253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838151.041836:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135060352:0@lo:400:kworker.0 00000100:00080000:3.0:1788838151.042998:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838151.043030:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135060608 00000100:00100000:3.0:1788838151.043178:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135060608 00000100:00080000:2.0:1788838151.043221:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788838151.043236:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788838151.043247:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788838151.043257:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838151.043265:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3509 00000100:00080000:2.0:1788838151.043281:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838151.043288:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135060736 00000100:00100000:3.0:1788838151.043296:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135060736 00000100:00100000:3.0:1788838151.043338:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:3.0:1788838151.043355:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135060608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838151.043359:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bc98700 x1875729135060992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838151.043545:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135060224:0@lo:400:kworker.0 00000100:00100000:0.0:1788838151.043922:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135059968:12345-0@lo:400:kworker.0 Request processed in 2621us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838151.043937:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1788838151.043973:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:0.0:1788838151.043979:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875729135060864:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788838151.043998:0:76060:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788838151.044259:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3643:x1875729135060864:12345-0@lo:400:kworker.0 Request processed in 278us (2786us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788838151.044281:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1788838151.044282:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875729135060224:12345-0@lo:400:kworker.0 Request processed in 2554us (3141us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788838151.044290:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1788838151.044313:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135060480 00000100:00100000:0.0:1788838151.044319:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135060480 00000100:00100000:1.0:1788838151.044321:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135060992:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788838151.044353:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4113 00000100:00100000:0.0:1788838151.044358:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875729135060480:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788838151.044364:0:37907:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788838151.044371:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838151.044391:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875729135060480:12345-0@lo:400:kworker.0 Request processed in 32us (2863us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788838151.044397:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4113 00000100:00100000:1.0:1788838151.044416:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135060992 00000100:00100000:1.0:1788838151.044420:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135060992 00000100:00100000:1.0:1788838151.044443:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1788838151.044448:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135060992:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788838151.044471:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838151.044515:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135060992:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 66us (143us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838151.044523:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00080000:1.0:1788838151.044553:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838151.044559:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838151.044563:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135060992:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788838151.044590:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788838151.044595:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788838151.044598:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788838151.044605:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838151.044610:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3509 00000100:00080000:0.0:1788838151.044617:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838151.044647:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6244b6d80 x1875729135061120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838151.044672:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135060480:0@lo:400:kworker.0 00000100:00080000:0.0:1788838151.044686:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788838151.044690:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788838151.044693:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788838151.044697:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838151.044701:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3509 00000100:00080000:0.0:1788838151.044705:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838151.044727:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135061120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788838151.044728:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6244b6a00 x1875729135061248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838151.044739:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135060864:0@lo:400:kworker.0 00000100:00100000:1.0:1788838151.044768:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838151.044789:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135061248:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788838151.044832:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838151.044916:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135061120 00000100:00100000:0.0:1788838151.044920:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135061120 00000100:00100000:0.0:1788838151.044952:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4114 00000100:00100000:0.0:1788838151.044958:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135061120:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788838151.044970:0:8472:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838151.045018:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135061120:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 59us (249us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838151.045024:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4114 00000100:00100000:0.0:1788838151.045113:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135061248 00000100:00100000:0.0:1788838151.045118:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135061248 00000100:00100000:0.0:1788838151.045142:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:0.0:1788838151.045146:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135061248:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788838151.045157:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838151.045186:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135061248:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 39us (354us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838151.045193:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00080000:0.0:1788838151.045220:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838151.045224:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838151.045228:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135061248:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788838151.045237:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838151.045241:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838151.045244:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135061120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788838151.045363:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135059968:0@lo:400:kworker.0 00000100:00100000:2.0:1788838151.046042:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1788838151.046175:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135060736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838151.046274:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135060736:12345-0@lo:400:kworker.0 Request processed in 110us (5100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838151.046283:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1788838151.046312:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135060736:0@lo:400:kworker.0 00000100:00080000:1.0:1788838151.046606:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838151.046613:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838151.046662:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135060608:12345-0@lo:400:kworker.0 Request processed in 3314us (5572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838151.046686:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1788838151.046791:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135060608:0@lo:400:kworker.0 00010000:00010000:3.0:1788838151.234472:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838151.741470:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838151.741530:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:3.0:1788838151.741553:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116421248 offset 0 length 224: 4 00000100:00100000:3.0:1788838151.741575:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838151.741614:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838151.741619:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116421376 00000100:00100000:1.0:1788838151.741635:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116421376 00000100:00100000:3.0:1788838151.741642:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116421632 00000100:00100000:3.0:1788838151.741644:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116421632 00000100:00100000:1.0:1788838151.741693:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116421504 00000100:00100000:1.0:1788838151.741697:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116421504 00000100:00100000:1.0:1788838151.741755:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1255 00000100:00100000:1.0:1788838151.741775:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116421504:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838151.741822:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1242 00000100:00100000:2.0:1788838151.741830:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1875729116421376:12345-192.168.203.30@tcp:400:kworker.0 00000020:00080000:2.0:1788838151.741836:0:67312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.30@tcp 00000100:00100000:3.0:1788838151.741935:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116421760 00000100:00100000:3.0:1788838151.741939:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116421760 00000100:00100000:3.0:1788838151.741965:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2568 00000100:00100000:3.0:1788838151.741973:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116421632:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838151.747506:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1875729116421376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 5651us (6031us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788838151.747526:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1242 00000100:00080000:0.0:1788838151.749071:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838151.749086:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838151.749091:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838151.749852:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2569 00000100:00100000:2.0:1788838151.749878:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116421760:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838151.750013:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116421760:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 147us (8397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838151.750023:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2569 00000100:00100000:1.0:1788838151.751037:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116421504:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 9255us (9449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838151.751054:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1255 00000100:00100000:3.0:1788838151.753118:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116421632:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 11130us (11571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838151.753136:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2568 00000100:00100000:3.0:1788838151.778594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838151.778757:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116421888 00000100:00100000:2.0:1788838151.778772:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116421888 00000100:00100000:2.0:1788838151.778881:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1243 00000100:00100000:2.0:1788838151.778892:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116421888:12345-192.168.203.30@tcp:38:ptlrpcd_01_00.0 00010000:00020000:2.0:1788838151.778925:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838151.779037:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116421888:12345-192.168.203.30@tcp:38:ptlrpcd_01_00.0 Request processed in 146us (460us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838151.779046:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1243 00000001:00100000:1.0:1788838152.068475:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788838152.068486:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff5021a6000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788838152.068520:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969452 is committed 00000020:00000080:2.0:1788838152.068585:0:86008:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5021a6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788838152.068667:0:86008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff61d4bb000 for lustre-OST0001 00000001:00100000:3.0:1788838152.073111:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788838152.073122:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff632f52800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788838152.073530:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969453 is committed 00000020:00000080:0.0:1788838152.074937:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632f52800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788838152.075023:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff632f50000 for lustre-OST0000 00010000:00010000:3.0:1788838152.257618:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838153.277368:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788838154.111894:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788838154.111910:0:75678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411437 is committed 00000020:00000080:2.0:1788838154.111916:0:75678:0:(genops.c:885:class_export_put()) final put ffff8ff509c73000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838154.113081:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c73000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788838154.113195:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff509c75000 for lustre-MDT0001 00010000:00010000:0.0:1788838154.300982:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838154.621937:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838154.621968:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135061376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838154.622043:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838154.622126:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135061504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838154.622161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838154.622291:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135061376 00000100:00100000:0.0:1788838154.622299:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135061376 00000100:00100000:2.0:1788838154.622343:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135061504 00000100:00100000:2.0:1788838154.622348:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135061504 00000100:00100000:0.0:1788838154.622367:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00080000:1.0:1788838154.622402:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838154.622406:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838154.622562:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135061376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838154.622595:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838154.622654:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135061376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 277us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838154.622739:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135061376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838154.627663:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1788838154.627695:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135061504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838154.627740:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838154.627894:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135061504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 214us (5731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838154.627902:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:0.0:1788838154.627989:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:3.0:1788838154.628108:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135061504:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788838155.325726:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838156.157021:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838156.157030:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838156.157035:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838156.157045:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3545 00000100:00080000:0.0:1788838156.157051:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838156.157057:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838156.157071:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838156.157085:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6244b6d80 x1875729135061760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838156.157093:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135061632:0@lo:400:kworker.0 00000100:00080000:0.0:1788838156.157117:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838156.157120:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838156.157122:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000400:00000100:3.0:1788838156.157149:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135061632 offset 0 length 224: 4 00000100:00080000:0.0:1788838156.157160:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3545 00000100:00080000:0.0:1788838156.157163:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838156.157167:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838156.157181:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a89180 x1875729135062016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838156.157198:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838156.157201:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838156.157203:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788838156.157204:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135062144:0@lo:400:kworker.0 00000100:00080000:0.0:1788838156.157206:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3545 00000100:00080000:0.0:1788838156.157208:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838156.157212:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838156.157226:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff624ebca80 x1875729135062272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838156.157239:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788838156.157250:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838156.157254:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838156.157255:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788838156.157260:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838156.157265:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135061888:0@lo:400:kworker.0 00000100:00080000:0.0:1788838156.157269:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3545 00000100:00080000:0.0:1788838156.157272:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838156.157276:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838156.157286:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838156.157287:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639c5e680 x1875729135062656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838156.157315:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135062144 00000100:00100000:3.0:1788838156.157324:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135062144 00000100:00100000:2.0:1788838156.157429:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135061760:0@lo:38:kworker.0 00000100:00100000:2.0:1788838156.157461:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838156.157508:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135062528:0@lo:400:kworker.0 00000100:00100000:1.0:1788838156.157541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838156.157564:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838156.157570:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135062400:0@lo:400:kworker.0 00000100:00100000:1.0:1788838156.157591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838156.157616:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135062528 00000100:00100000:1.0:1788838156.157620:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135062528 00000100:00100000:1.0:1788838156.159249:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135062400 00000100:00100000:1.0:1788838156.159264:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135062400 00000100:00100000:1.0:1788838156.159330:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:1.0:1788838156.159341:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135062528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838156.159449:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135062528:12345-0@lo:400:kworker.0 Request processed in 110us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838156.159456:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:1.0:1788838156.159472:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1788838156.159477:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135062400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838156.159506:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135062400:12345-0@lo:400:kworker.0 Request processed in 28us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838156.159512:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00080000:1.0:1788838156.159542:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838156.159547:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838156.159550:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838156.159709:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135062400:0@lo:400:kworker.0 00000100:00100000:1.0:1788838156.159726:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135062528:0@lo:400:kworker.0 00000100:00100000:2.0:1788838156.159893:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135062016:0@lo:38:kworker.0 00000100:00100000:2.0:1788838156.159935:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838156.160041:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135061888 00000100:00100000:0.0:1788838156.160042:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135061760 00000100:00100000:3.0:1788838156.160048:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135061888 00000100:00100000:0.0:1788838156.160050:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135061760 00000100:00100000:3.0:1788838156.160106:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788838156.160115:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135062144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838156.160161:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135062144:12345-0@lo:400:kworker.0 Request processed in 49us (2922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838156.160168:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788838156.160182:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1788838156.160187:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135061888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838156.160213:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135061888:12345-0@lo:400:kworker.0 Request processed in 27us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838156.160218:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1788838156.160229:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1788838156.160234:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135061760:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838156.160254:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788838156.160286:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838156.160287:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135061760:12345-0@lo:38:kworker.0 Request processed in 50us (2823us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838156.160295:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1788838156.160496:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135061888:0@lo:400:kworker.0 00000100:00100000:3.0:1788838156.160525:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135062144:0@lo:400:kworker.0 00000100:00100000:2.0:1788838156.160676:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135062272:0@lo:38:kworker.0 00000100:00100000:2.0:1788838156.160714:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838156.160792:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135062656:0@lo:38:kworker.0 00000100:00100000:2.0:1788838156.160842:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788838156.160879:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838156.160885:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838156.160888:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135061760:0@lo:38:kworker.0 00000100:00100000:0.0:1788838156.160967:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135062016 00000100:00100000:0.0:1788838156.160979:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135062016 00000100:00100000:0.0:1788838156.161008:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135062656 00000100:00100000:0.0:1788838156.161011:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135062656 00000100:00100000:0.0:1788838156.161029:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1788838156.161035:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135062016:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838156.161047:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838156.161082:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135062016:12345-0@lo:38:kworker.0 Request processed in 47us (1146us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838156.161088:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1788838156.161101:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1788838156.161105:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135062656:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838156.161114:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838156.161135:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135062656:12345-0@lo:38:kworker.0 Request processed in 29us (294us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838156.161141:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00080000:2.0:1788838156.161217:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838156.161222:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838156.161225:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135062016:0@lo:38:kworker.0 00000100:00080000:2.0:1788838156.161233:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838156.161237:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838156.161240:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135062656:0@lo:38:kworker.0 00000100:00100000:3.0:1788838156.161409:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135062272 00000100:00100000:3.0:1788838156.161414:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135062272 00000100:00100000:3.0:1788838156.161541:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4115 00000100:00100000:3.0:1788838156.161546:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135062272:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838156.161567:0:37907:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838156.161693:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135062272:12345-0@lo:38:kworker.0 Request processed in 145us (979us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838156.161701:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4115 00000100:00080000:2.0:1788838156.161828:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838156.161832:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838156.161835:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135062272:0@lo:38:kworker.0 00010000:00010000:3.0:1788838156.349680:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838156.864659:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838156.864757:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116422144 00000100:00100000:0.0:1788838156.864768:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116422144 00000100:00100000:0.0:1788838156.864853:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1247 00000100:00100000:0.0:1788838156.864862:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116422144:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:0.0:1788838156.864888:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838156.864966:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116422144:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 103us (318us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838156.864972:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1247 00000400:00000100:2.0:1788838156.869281:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116422016 offset 0 length 224: 4 00000100:00100000:2.0:1788838156.869325:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838156.869358:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838156.870642:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116422400 00000100:00100000:3.0:1788838156.870655:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116422400 00000100:00100000:3.0:1788838156.870737:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2572 00000100:00100000:3.0:1788838156.870747:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116422400:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838156.870863:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116422400:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 118us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838156.870871:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2572 00000100:00080000:0.0:1788838156.871059:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838156.871240:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838156.871757:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116422528 00000100:00100000:3.0:1788838156.871765:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116422528 00000100:00100000:3.0:1788838156.871850:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2573 00000100:00100000:3.0:1788838156.871859:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116422528:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838156.871905:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116422528:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 47us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838156.871913:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2573 00000100:00080000:0.0:1788838156.872125:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838156.874652:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116422272 00000100:00100000:1.0:1788838156.874668:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116422272 00000100:00100000:1.0:1788838156.874849:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1258 00000100:00100000:1.0:1788838156.874861:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116422272:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838156.874973:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116422272:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 113us (5612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838156.874981:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1258 00000100:00080000:0.0:1788838156.875211:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788838157.373090:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838158.396986:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838159.421073:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838159.741246:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135062784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838159.741341:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838159.741588:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135062912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838159.741646:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838159.741924:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135062784 00000100:00100000:0.0:1788838159.741941:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135062784 00000100:00100000:0.0:1788838159.742008:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135062912 00000100:00100000:0.0:1788838159.742012:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135062912 00000100:00100000:0.0:1788838159.742029:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1788838159.742039:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135062784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838159.742067:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838159.742116:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135062784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838159.742125:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00080000:3.0:1788838159.742127:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838159.742133:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838159.742146:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:0.0:1788838159.742153:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135062912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838159.742171:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838159.742210:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135062912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838159.742217:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:2.0:1788838159.742318:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135062784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838159.742397:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135062912:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788838160.448856:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838161.277684:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838161.277691:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838161.277694:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838161.277702:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3550 00000100:00080000:3.0:1788838161.277707:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788838161.277714:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838161.277736:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637d56a00 x1875729135063168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838161.277771:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838161.277775:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838161.277776:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838161.277779:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3550 00000100:00080000:3.0:1788838161.277782:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788838161.277786:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838161.277835:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135063296:0@lo:400:kworker.0 00000100:00100000:3.0:1788838161.277838:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50719d880 x1875729135063424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838161.277864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838161.277868:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838161.277870:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838161.277887:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3550 00000100:00080000:3.0:1788838161.277889:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788838161.277893:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838161.277907:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff64066ad80 x1875729135063680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838161.278131:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838161.278178:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838161.278185:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135063040:0@lo:400:kworker.0 00000400:00000100:1.0:1788838161.278208:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135063040 offset 0 length 224: 4 00000100:00100000:2.0:1788838161.278223:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135063168:0@lo:38:kworker.0 00000100:00100000:1.0:1788838161.278270:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135063296 00000100:00100000:2.0:1788838161.278271:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838161.278280:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135063296 00000100:00100000:2.0:1788838161.278299:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135063424:0@lo:38:kworker.0 00000100:00100000:2.0:1788838161.278320:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838161.278338:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135063680:0@lo:38:kworker.0 00000100:00100000:2.0:1788838161.278405:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838161.278439:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135063168 00000100:00100000:2.0:1788838161.278443:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135063168 00000100:00100000:2.0:1788838161.278468:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135063424 00000100:00100000:2.0:1788838161.278471:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135063424 00000100:00100000:2.0:1788838161.278490:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1788838161.278498:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135063168:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838161.278519:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838161.278519:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1788838161.278533:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135063296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838161.278568:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135063168:12345-0@lo:38:kworker.0 Request processed in 70us (297us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838161.278577:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1788838161.278594:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135063296:12345-0@lo:400:kworker.0 Request processed in 64us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838161.278596:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1788838161.278605:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135063424:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788838161.278609:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00010000:00020000:2.0:1788838161.278619:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838161.278643:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135063552:0@lo:400:kworker.0 00000100:00100000:2.0:1788838161.278651:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135063424:12345-0@lo:38:kworker.0 Request processed in 44us (328us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838161.278659:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1788838161.278675:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838161.278684:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135063680 00000100:00100000:2.0:1788838161.278689:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135063680 00000100:00100000:1.0:1788838161.278700:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838161.278707:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135063808:0@lo:400:kworker.0 00000100:00100000:2.0:1788838161.278716:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4116 00000100:00100000:2.0:1788838161.278721:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135063680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838161.278730:0:8471:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838161.278765:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135063680:12345-0@lo:38:kworker.0 Request processed in 43us (359us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838161.278771:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4116 00000100:00100000:2.0:1788838161.278789:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135063552 00000100:00100000:2.0:1788838161.278792:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135063552 00000100:00100000:2.0:1788838161.278847:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1788838161.278853:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135063552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838161.278886:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135063552:12345-0@lo:400:kworker.0 Request processed in 33us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838161.278892:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00080000:2.0:1788838161.278949:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838161.278955:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838161.278958:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135063168:0@lo:38:kworker.0 00000100:00080000:2.0:1788838161.278966:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838161.278970:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838161.278973:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135063424:0@lo:38:kworker.0 00000100:00080000:2.0:1788838161.278980:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838161.278983:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838161.278985:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135063680:0@lo:38:kworker.0 00000100:00080000:2.0:1788838161.279028:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838161.279102:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838161.279139:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135063552:0@lo:400:kworker.0 00000100:00100000:1.0:1788838161.279168:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135063296:0@lo:400:kworker.0 00000100:00100000:2.0:1788838161.279235:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135063808 00000100:00100000:2.0:1788838161.279240:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135063808 00000100:00100000:2.0:1788838161.279282:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:2.0:1788838161.279290:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135063808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838161.279330:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135063808:12345-0@lo:400:kworker.0 Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838161.279344:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00080000:3.0:1788838161.279490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838161.279494:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838161.279497:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838161.279502:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3550 00000100:00080000:3.0:1788838161.279506:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788838161.279510:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838161.279530:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff64066ad80 x1875729135064064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838161.279574:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135064064:0@lo:38:kworker.0 00000100:00100000:3.0:1788838161.279609:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838161.279640:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135064064 00000100:00100000:3.0:1788838161.279644:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135064064 00000100:00100000:3.0:1788838161.279663:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1788838161.279669:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135064064:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838161.279682:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838161.279713:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135064064:12345-0@lo:38:kworker.0 Request processed in 44us (103us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838161.279720:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00080000:3.0:1788838161.279747:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838161.279751:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838161.279760:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135064064:0@lo:38:kworker.0 00000100:00100000:0.0:1788838161.279865:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135063936:0@lo:400:kworker.0 00000100:00100000:0.0:1788838161.279897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788838161.282374:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838161.283057:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135063808:0@lo:400:kworker.0 00000100:00100000:2.0:1788838161.283736:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135063936 00000100:00100000:2.0:1788838161.283912:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135063936 00000100:00100000:2.0:1788838161.284067:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:2.0:1788838161.284078:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135063936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838161.284203:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135063936:12345-0@lo:400:kworker.0 Request processed in 128us (4304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838161.284210:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:3.0:1788838161.284405:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135063936:0@lo:400:kworker.0 00000100:00080000:1.0:1788838161.284935:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788838161.469701:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838161.980735:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838161.980787:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:2.0:1788838161.980851:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116422656 offset 0 length 224: 4 00000100:00100000:2.0:1788838161.980877:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838161.980886:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116423168 00000100:00100000:0.0:1788838161.980896:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116423168 00000100:00100000:0.0:1788838161.980972:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116423040 00000100:00100000:0.0:1788838161.980976:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116423040 00000100:00100000:0.0:1788838161.981001:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2576 00000100:00080000:1.0:1788838161.981005:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838161.981010:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838161.981010:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116423168:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838161.981094:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116423168:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838161.981102:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2576 00000100:00100000:0.0:1788838161.981134:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2577 00000100:00100000:0.0:1788838161.981139:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116423040:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838161.981166:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116423040:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838161.981171:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2577 00000100:00100000:3.0:1788838161.981271:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116422912 00000100:00100000:3.0:1788838161.981276:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116422912 00000100:00100000:3.0:1788838161.981333:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1261 00000100:00100000:3.0:1788838161.981341:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116422912:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838161.981386:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116422912:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 47us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838161.981393:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1261 00000100:00080000:1.0:1788838161.981483:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838161.982496:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838161.982653:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116422784 00000100:00100000:1.0:1788838161.982661:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116422784 00000100:00100000:1.0:1788838161.982728:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1251 00000100:00100000:1.0:1788838161.982734:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116422784:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:1.0:1788838161.982759:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838161.982852:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116422784:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 115us (360us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838161.982858:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1251 00010000:00010000:0.0:1788838162.492983:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838163.517426:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838164.545906:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838164.861353:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135064192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838164.861447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838164.861527:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135064192 00000100:00100000:1.0:1788838164.861534:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135064192 00000100:00100000:1.0:1788838164.861593:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:1.0:1788838164.861603:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135064192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838164.861636:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838164.861684:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135064192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838164.861691:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00080000:1.0:1788838164.861714:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838164.861755:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135064192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838164.862222:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135064320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838164.862269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838164.862364:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135064320 00000100:00100000:0.0:1788838164.862379:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135064320 00000100:00100000:0.0:1788838164.862424:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1788838164.862433:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135064320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838164.862452:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00080000:1.0:1788838164.862506:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838164.867971:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135064320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5529us (5691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838164.867987:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:2.0:1788838164.868520:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135064320:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788838165.564989:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838166.397215:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838166.397222:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838166.397225:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838166.397234:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3555 00000100:00080000:3.0:1788838166.397239:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788838166.397245:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838166.397269:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640668380 x1875729135064576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838166.397303:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838166.397307:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838166.397308:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838166.397312:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3555 00000100:00080000:3.0:1788838166.397314:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788838166.397318:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838166.397347:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff64066ad80 x1875729135064832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838166.397378:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838166.397382:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838166.397383:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838166.397387:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3555 00000100:00080000:3.0:1788838166.397389:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788838166.397393:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838166.397405:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639542680 x1875729135065088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838166.397426:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838166.397429:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838166.397430:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838166.397433:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3555 00000100:00080000:3.0:1788838166.397436:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788838166.397439:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838166.397449:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff632e67480 x1875729135065472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838166.397479:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135065216:0@lo:400:kworker.0 00000100:00100000:3.0:1788838166.397546:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838166.397588:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788838166.397595:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135064448:0@lo:400:kworker.0 00000400:00000100:3.0:1788838166.397615:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135064448 offset 0 length 224: 4 00000100:00100000:3.0:1788838166.397637:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135065344:0@lo:400:kworker.0 00000100:00100000:3.0:1788838166.398449:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838166.398502:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135064576:0@lo:38:kworker.0 00000100:00100000:3.0:1788838166.398543:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838166.398563:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135064832:0@lo:38:kworker.0 00000100:00100000:3.0:1788838166.398587:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838166.398606:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135065088:0@lo:38:kworker.0 00000100:00100000:3.0:1788838166.398629:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838166.398644:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135065472:0@lo:38:kworker.0 00000100:00100000:3.0:1788838166.398664:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838166.398773:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135065216 00000100:00100000:1.0:1788838166.398780:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135065216 00000100:00100000:1.0:1788838166.398845:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135065344 00000100:00100000:1.0:1788838166.398849:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135065344 00000100:00100000:1.0:1788838166.398872:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1788838166.398892:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135065216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838166.398953:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135065216:12345-0@lo:400:kworker.0 Request processed in 72us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838166.398969:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1788838166.398986:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1788838166.398991:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135065344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838166.399020:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135065344:12345-0@lo:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838166.399026:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00080000:1.0:1788838166.399041:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838166.399045:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838166.399082:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135065344:0@lo:400:kworker.0 00000100:00100000:1.0:1788838166.399094:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135065216:0@lo:400:kworker.0 00000100:00100000:3.0:1788838166.399241:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135064704:0@lo:400:kworker.0 00000100:00100000:3.0:1788838166.399269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838166.399289:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838166.399294:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135064960:0@lo:400:kworker.0 00000100:00100000:3.0:1788838166.399315:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838166.399351:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135064576 00000100:00100000:3.0:1788838166.399355:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135064576 00000100:00100000:3.0:1788838166.399375:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135064832 00000100:00100000:3.0:1788838166.399378:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135064832 00000100:00100000:3.0:1788838166.399385:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135065472 00000100:00100000:3.0:1788838166.399387:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135065472 00000100:00100000:3.0:1788838166.399393:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135064704 00000100:00100000:3.0:1788838166.399396:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135064704 00000100:00100000:3.0:1788838166.399415:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135064960 00000100:00100000:3.0:1788838166.399417:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135064960 00000100:00100000:3.0:1788838166.399432:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1788838166.399438:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135064704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838166.399475:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135064704:12345-0@lo:400:kworker.0 Request processed in 37us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838166.399488:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1788838166.399504:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1788838166.399510:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135064960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838166.399540:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135064960:12345-0@lo:400:kworker.0 Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838166.399546:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1788838166.399559:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:3.0:1788838166.399563:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135064576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838166.399580:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838166.399612:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135064576:12345-0@lo:38:kworker.0 Request processed in 46us (1067us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838166.399618:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:3.0:1788838166.399629:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1788838166.399633:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135064832:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838166.399642:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838166.399661:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135064832:12345-0@lo:38:kworker.0 Request processed in 27us (1074us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838166.404957:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1788838166.405002:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1788838166.405012:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135065472:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838166.405035:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838166.405110:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135065472:12345-0@lo:38:kworker.0 Request processed in 98us (6444us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838166.405117:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1788838166.405158:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135065088 00000100:00100000:3.0:1788838166.405165:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135065088 00000100:00100000:3.0:1788838166.405200:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4117 00000100:00100000:3.0:1788838166.405204:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135065088:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838166.405215:0:37907:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838166.405243:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135065088:12345-0@lo:38:kworker.0 Request processed in 37us (6613us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838166.405249:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4117 00000100:00100000:3.0:1788838166.405301:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135064960:0@lo:400:kworker.0 00000100:00100000:3.0:1788838166.405315:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135064704:0@lo:400:kworker.0 00000100:00080000:3.0:1788838166.405352:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838166.405358:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838166.405362:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135064576:0@lo:38:kworker.0 00000100:00080000:3.0:1788838166.405374:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838166.405378:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838166.405381:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135064832:0@lo:38:kworker.0 00000100:00080000:3.0:1788838166.405389:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838166.405392:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838166.405395:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135065088:0@lo:38:kworker.0 00000100:00080000:3.0:1788838166.405403:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838166.405406:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838166.405409:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135065472:0@lo:38:kworker.0 00000100:00080000:1.0:1788838166.405533:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788838166.593453:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838167.107195:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838167.107243:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:1.0:1788838167.107263:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116423296 offset 0 length 224: 4 00000100:00100000:1.0:1788838167.107281:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838167.107316:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838167.107352:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116423808 00000100:00100000:1.0:1788838167.107362:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116423808 00000100:00100000:1.0:1788838167.107420:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116423680 00000100:00100000:1.0:1788838167.107423:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116423680 00000100:00100000:1.0:1788838167.107447:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2580 00000100:00100000:1.0:1788838167.107457:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116423808:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838167.107537:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116423808:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838167.107545:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2580 00000100:00100000:1.0:1788838167.107570:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2581 00000100:00100000:1.0:1788838167.107576:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116423680:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838167.107603:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116423680:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838167.107609:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2581 00000100:00100000:1.0:1788838167.107633:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116423552 00000100:00100000:1.0:1788838167.107637:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116423552 00000100:00100000:1.0:1788838167.107662:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116423424 00000100:00100000:1.0:1788838167.107665:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116423424 00000100:00100000:1.0:1788838167.107681:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1264 00000100:00100000:1.0:1788838167.107688:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116423552:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838167.107717:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2404:x1875729116423552:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838167.107723:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1264 00000100:00100000:1.0:1788838167.107735:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1255 00000100:00100000:1.0:1788838167.107739:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116423424:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:1.0:1788838167.107759:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838167.107780:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116423424:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 40us (464us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838167.107786:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1255 00000100:00080000:1.0:1788838167.107819:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838167.107824:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838167.107826:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00000400:1.0:1788838167.420960:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838151/real 1788838151] req@ffff8ff637d56300 x1875729135059712/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838167 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838167.421010:0:3643:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8ff637d56300 x1875729135059712/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838167 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838167.421020:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788838167.421023:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788838167.421027:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788838167.421029:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788838167.421033:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff637d56300 x1875729135059712/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838167 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838167.421042:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff6244b6a00 x1875729135061632/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838172 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838167.421063:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff637d55180 x1875729135063040/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838177 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838167.421085:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff609dd6d80 x1875729135064448/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838182 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788838167.421094:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788838167.421097:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788838167.421099:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788838167.421101:0:3643:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1788838167.421128:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135064448:0@lo:400:kworker.0 00000100:00100000:1.0:1788838167.421134:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135059712:0@lo:400:kworker.0 00000100:00080000:1.0:1788838167.421168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838167.421174:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788838167.421177:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838167.421181:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3503 00000100:00080000:1.0:1788838167.421189:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838167.421226:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637d56300 x1875729135065600/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838167.421246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838167.421249:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838167.421251:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838167.421254:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3560 00000100:00080000:1.0:1788838167.421257:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838167.421260:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838167.421275:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff609dd6d80 x1875729135065728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838167.421293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838167.421296:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838167.421298:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838167.421301:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3560 00000100:00080000:1.0:1788838167.421303:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838167.421306:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838167.421316:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504c05880 x1875729135065984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838167.421329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838167.421333:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838167.421334:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838167.421337:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3560 00000100:00080000:1.0:1788838167.421339:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838167.421342:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838167.421362:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63f746680 x1875729135066240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838167.421388:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838167.421392:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838167.421394:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838167.421397:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3560 00000100:00080000:1.0:1788838167.421399:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838167.421402:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838167.421413:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff626a8a300 x1875729135066624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838167.421437:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135065600:0@lo:250:kworker.0 00000400:00000100:1.0:1788838167.421482:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135065600 offset 0 length 520: 4 00000100:00100000:1.0:1788838167.421517:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135065728:0@lo:38:kworker.0 00000100:00100000:1.0:1788838167.421552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838167.421586:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135065984:0@lo:38:kworker.0 00000100:00100000:1.0:1788838167.421608:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838167.421622:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135066240:0@lo:38:kworker.0 00000100:00100000:1.0:1788838167.421643:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838167.421656:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135066624:0@lo:38:kworker.0 00000100:00100000:1.0:1788838167.421675:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838167.421701:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135066496:0@lo:400:kworker.0 00000100:00100000:3.0:1788838167.421833:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135065856:0@lo:400:kworker.0 00000100:00100000:2.0:1788838167.421843:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135066112:0@lo:400:kworker.0 00000100:00100000:2.0:1788838167.421870:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838167.421914:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135063040:0@lo:400:kworker.0 00000100:00100000:2.0:1788838167.421948:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135066240 00000100:00100000:2.0:1788838167.421955:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135066240 00000100:00100000:1.0:1788838167.421987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838167.421994:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4118 00000100:00100000:2.0:1788838167.422000:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135066240:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788838167.422011:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838167.422016:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135066368:0@lo:400:kworker.0 00010000:00020000:2.0:1788838167.422026:0:8471:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838167.422044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838167.422120:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135065728 00000100:00100000:1.0:1788838167.422124:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135065728 00000100:00100000:1.0:1788838167.422182:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135065984 00000100:00100000:1.0:1788838167.422186:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135065984 00000100:00100000:2.0:1788838167.422244:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135066240:12345-0@lo:38:kworker.0 Request processed in 241us (598us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838167.422253:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4118 00000100:00100000:3.0:1788838167.424063:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135066624 00000100:00100000:3.0:1788838167.424078:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135066624 00000100:00100000:3.0:1788838167.424115:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135066112 00000100:00100000:3.0:1788838167.424119:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135066112 00000100:00100000:3.0:1788838167.424148:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1788838167.424157:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135066112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838167.424247:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135066112:12345-0@lo:400:kworker.0 Request processed in 91us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838167.424254:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1788838167.424272:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788838167.424277:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135065728:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838167.424298:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838167.424325:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135065728:12345-0@lo:38:kworker.0 Request processed in 46us (2772us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838167.424330:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788838167.424342:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1788838167.424346:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135065984:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838167.424354:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838167.424373:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135065984:12345-0@lo:38:kworker.0 Request processed in 26us (2765us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838167.424379:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1788838167.424387:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1788838167.424391:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135066624:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838167.424399:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838167.424422:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135066624:12345-0@lo:38:kworker.0 Request processed in 29us (2746us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838167.424433:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1788838167.424539:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135066496 00000100:00100000:1.0:1788838167.424545:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135066496 00000100:00100000:1.0:1788838167.424871:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135066368 00000100:00100000:1.0:1788838167.424887:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135066368 00000100:00100000:1.0:1788838167.424916:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:1.0:1788838167.424924:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135066496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838167.424978:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135066496:12345-0@lo:400:kworker.0 Request processed in 55us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838167.424985:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:1.0:1788838167.424998:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1788838167.425004:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135066368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838167.425031:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135066368:12345-0@lo:400:kworker.0 Request processed in 28us (2987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838167.425037:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1788838167.425089:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135066368:0@lo:400:kworker.0 00000100:00100000:1.0:1788838167.425103:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135066496:0@lo:400:kworker.0 00000100:00100000:1.0:1788838167.429073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838167.429165:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135061632:0@lo:400:kworker.0 00000100:00080000:1.0:1788838167.429247:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838167.429253:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838167.429257:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135065728:0@lo:38:kworker.0 00000100:00080000:1.0:1788838167.429283:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838167.429286:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838167.429289:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135065984:0@lo:38:kworker.0 00000100:00080000:1.0:1788838167.429301:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838167.429304:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838167.429306:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135066240:0@lo:38:kworker.0 00000100:00080000:1.0:1788838167.429317:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838167.429320:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838167.429322:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135066624:0@lo:38:kworker.0 00000100:00100000:3.0:1788838167.429397:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135065856 00000100:00100000:3.0:1788838167.429405:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135065856 00000100:00100000:3.0:1788838167.429464:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1788838167.429474:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135065856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838167.429515:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135066112:0@lo:400:kworker.0 00000100:00100000:3.0:1788838167.429576:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135065856:12345-0@lo:400:kworker.0 Request processed in 90us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838167.429577:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135065856:0@lo:400:kworker.0 00000100:00100000:3.0:1788838167.429585:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00010000:00010000:2.0:1788838167.617444:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838168.129003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838168.129064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838168.129101:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:1.0:1788838168.129128:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116423936 offset 0 length 520: 4 00000100:00100000:1.0:1788838168.129167:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838168.129208:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116424192 00000100:00100000:1.0:1788838168.129223:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116424192 00000100:00100000:1.0:1788838168.129284:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116424064 00000100:00100000:1.0:1788838168.129289:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116424064 00000100:00100000:1.0:1788838168.129326:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1267 00000100:00100000:1.0:1788838168.129338:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116424192:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838168.129857:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116424192:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 520us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838168.129867:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1267 00000100:00100000:1.0:1788838168.129898:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1259 00000100:00100000:1.0:1788838168.129904:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116424064:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:1.0:1788838168.129944:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838168.129973:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116424064:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 67us (808us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838168.129981:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1259 00000100:00100000:1.0:1788838168.130004:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116424320 00000100:00100000:1.0:1788838168.130009:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116424320 00000100:00100000:1.0:1788838168.130037:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116424448 00000100:00100000:1.0:1788838168.130040:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116424448 00000100:00100000:1.0:1788838168.130061:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2584 00000100:00100000:1.0:1788838168.130068:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116424320:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838168.130099:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116424320:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838168.130105:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2584 00000100:00100000:1.0:1788838168.130118:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2585 00000100:00100000:1.0:1788838168.130124:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116424448:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838168.130150:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116424448:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838168.130156:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2585 00010000:00010000:2.0:1788838168.637906:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838169.664840:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838169.981061:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135066752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838169.981142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838169.981204:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135066752 00000100:00100000:1.0:1788838169.981212:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135066752 00000100:00100000:1.0:1788838169.981278:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1788838169.981287:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135066752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838169.981316:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838169.981372:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135066752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838169.981380:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00080000:1.0:1788838169.981402:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838169.981437:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135066752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838169.982718:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135066880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838169.982781:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838169.982852:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135066880 00000100:00100000:1.0:1788838169.982867:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135066880 00000100:00100000:1.0:1788838169.982914:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:1.0:1788838169.982922:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135066880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838169.982952:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838169.982997:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135066880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838169.983003:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00080000:1.0:1788838169.983024:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838169.983060:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135066880:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788838170.696111:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838171.709041:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838172.544900:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838172.544910:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838172.544914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838172.544919:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838172.544925:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838172.544934:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3561 00000100:00080000:3.0:1788838172.544939:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838172.544949:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838172.544995:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff610ad1c00 x1875729135067008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838172.545040:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838172.545043:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838172.545045:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838172.545049:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3561 00000100:00080000:3.0:1788838172.545051:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838172.545055:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838172.545152:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff64066ad80 x1875729135067264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838172.545171:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838172.545175:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838172.545177:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838172.545180:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3561 00000100:00080000:3.0:1788838172.545182:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838172.545187:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838172.545198:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640668e00 x1875729135067520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838172.545236:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838172.545239:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838172.545241:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838172.545244:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3561 00000100:00080000:3.0:1788838172.545246:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838172.545249:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838172.545259:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504d7bb80 x1875729135067904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838172.545294:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135067136:0@lo:400:kworker.0 00000100:00100000:3.0:1788838172.545450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838172.545493:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838172.545498:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135067392:0@lo:400:kworker.0 00000100:00100000:3.0:1788838172.545532:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838172.545561:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135067648:0@lo:400:kworker.0 00000100:00100000:3.0:1788838172.545599:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838172.545620:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838172.545624:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135067776:0@lo:400:kworker.0 00000100:00100000:3.0:1788838172.545644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838172.545675:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135067136 00000100:00100000:3.0:1788838172.545682:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135067136 00000100:00100000:3.0:1788838172.545731:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135067392 00000100:00100000:3.0:1788838172.545734:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135067392 00000100:00100000:3.0:1788838172.545758:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1788838172.545766:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135067136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838172.545851:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135067136:12345-0@lo:400:kworker.0 Request processed in 74us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838172.545859:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1788838172.545877:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1788838172.545884:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135067392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838172.545913:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135067392:12345-0@lo:400:kworker.0 Request processed in 30us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838172.545919:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1788838172.545942:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135067648 00000100:00100000:3.0:1788838172.545946:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135067648 00000100:00100000:3.0:1788838172.545975:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135067776 00000100:00100000:3.0:1788838172.545978:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135067776 00000100:00100000:3.0:1788838172.545997:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:3.0:1788838172.546003:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135067648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838172.546038:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135067648:12345-0@lo:400:kworker.0 Request processed in 35us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838172.546044:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:3.0:1788838172.546064:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:3.0:1788838172.546250:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135067776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838172.546283:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135067776:12345-0@lo:400:kworker.0 Request processed in 213us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838172.546290:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00080000:3.0:1788838172.546309:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838172.546313:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838172.546316:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838172.546457:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135067008:0@lo:38:kworker.0 00000100:00100000:3.0:1788838172.546487:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838172.546550:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135067264:0@lo:38:kworker.0 00000100:00100000:3.0:1788838172.546570:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838172.549210:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135067392:0@lo:400:kworker.0 00000100:00100000:2.0:1788838172.549230:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135067136:0@lo:400:kworker.0 00000100:00100000:0.0:1788838172.549919:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135067008 00000100:00100000:0.0:1788838172.549929:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135067008 00000100:00100000:0.0:1788838172.549972:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135067264 00000100:00100000:0.0:1788838172.549974:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135067264 00000100:00100000:0.0:1788838172.549993:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1788838172.550001:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135067008:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838172.550026:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838172.550095:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135067008:12345-0@lo:38:kworker.0 Request processed in 94us (3607us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838172.550102:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1788838172.550119:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1788838172.550123:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135067264:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838172.550146:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838172.550186:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135067264:12345-0@lo:38:kworker.0 Request processed in 62us (3615us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838172.550192:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00080000:3.0:1788838172.550600:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838172.550608:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838172.550613:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135067264:0@lo:38:kworker.0 00000100:00100000:3.0:1788838172.550623:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135067520:0@lo:38:kworker.0 00000100:00100000:3.0:1788838172.550665:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838172.550691:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135067904:0@lo:38:kworker.0 00000100:00100000:3.0:1788838172.550858:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838172.550900:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838172.550905:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838172.550909:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135067008:0@lo:38:kworker.0 00000100:00100000:0.0:1788838172.551066:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135067520 00000100:00100000:0.0:1788838172.551073:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135067520 00000100:00100000:0.0:1788838172.551103:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4119 00000100:00100000:0.0:1788838172.551108:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135067520:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838172.551124:0:37907:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838172.551196:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135067904 00000100:00100000:2.0:1788838172.551201:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135067904 00000100:00100000:2.0:1788838172.551227:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1788838172.551232:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135067904:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838172.551241:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838172.551273:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135067904:12345-0@lo:38:kworker.0 Request processed in 39us (414us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838172.551279:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1788838172.551425:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135067776:0@lo:400:kworker.0 00000100:00100000:3.0:1788838172.551442:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135067648:0@lo:400:kworker.0 00000100:00080000:3.0:1788838172.551781:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838172.551787:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838172.551791:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135067520:0@lo:38:kworker.0 00000100:00080000:3.0:1788838172.551823:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838172.551827:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838172.551831:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135067904:0@lo:38:kworker.0 00000100:00100000:0.0:1788838172.552166:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135067520:12345-0@lo:38:kworker.0 Request processed in 1054us (1499us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838172.552175:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4119 00010000:00010000:3.0:1788838172.733124:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838173.246447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838173.246485:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838173.246506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838173.246570:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838173.246600:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116424704 00000100:00100000:1.0:1788838173.246608:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116424704 00000100:00100000:1.0:1788838173.246662:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116424576 00000100:00100000:1.0:1788838173.246665:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116424576 00000100:00100000:1.0:1788838173.246684:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1270 00000100:00100000:1.0:1788838173.246703:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116424704:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838173.246779:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116424704:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 78us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838173.246787:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1270 00000100:00100000:1.0:1788838173.246829:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1263 00000100:00100000:1.0:1788838173.246834:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116424576:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:1.0:1788838173.246866:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838173.246894:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116424576:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 59us (325us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838173.246901:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1263 00000100:00100000:1.0:1788838173.246923:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116424960 00000100:00100000:1.0:1788838173.246927:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116424960 00000100:00100000:1.0:1788838173.246951:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116424832 00000100:00100000:1.0:1788838173.246954:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116424832 00000100:00100000:1.0:1788838173.246974:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2588 00000100:00100000:1.0:1788838173.246981:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116424960:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838173.247008:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116424960:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838173.247014:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2588 00000100:00100000:1.0:1788838173.247026:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2589 00000100:00100000:1.0:1788838173.247032:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116424832:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838173.247055:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116424832:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838173.247060:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2589 00000100:00080000:3.0:1788838173.247257:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838173.247262:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838173.247264:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:3.0:1788838173.274544:0:91026:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788838173.274550:0:91026:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788838173.274552:0:91026:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788838173.274670:0:91026:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ff640eee800 00000020:01000004:3.0:1788838173.274686:0:91026:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788838173.274700:0:91026:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788838173.274715:0:91026:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ff6271cb370) 00000020:00000080:3.0:1788838173.274733:0:91026:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788838173.390850:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788838173.394508:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.395641:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788838173.396278:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788838173.396623:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788838173.397016:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788838173.397249:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788838173.397502:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788838173.397758:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788838173.398092:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788838173.398288:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788838173.398978:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788838173.399229:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788838173.399495:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788838173.412102:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788838173.413160:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.413446:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.413676:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.414147:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.414795:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.415529:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.416121:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.416592:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.418113:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.419133:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.420441:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.421476:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.421880:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.423225:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.423699:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.424093:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.424305:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.425201:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.425507:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.426012:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.426593:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.426906:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.427120:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.427415:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.427628:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.434284:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.435237:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.435829:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.438253:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.439504:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788838173.442189:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.443885:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788838173.447495:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788838173.450941:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788838173.451450:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788838173.452440:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788838173.455059:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788838173.455629:0:91026:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788838173.456276:0:91026:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788838173.456583:0:91026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788838173.456592:0:91026:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788838173.456603:0:91026:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8e9f 00000020:01000004:2.0:1788838173.456610:0:91026:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788838173.456622:0:91026:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788838173.456628:0:91026:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff640eee800 from MGS 00000020:01000004:2.0:1788838173.456631:0:91026:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788838173.456641:0:91026:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ff610240000) 00000020:00000080:2.0:1788838173.456653:0:91026:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1788838173.456719:0:91026:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff640eee800 from MGS, refs=2 00080000:01000000:2.0:1788838173.456725:0:91026:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788838173.456730:0:91026:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8ead 00010000:00010000:2.0:1788838173.456913:0:91026:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788838173.467236:0:91026:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788838173.470152:0:91030:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788838173.470223:0:91026:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788838173.470295:0:91026:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788838173.478946:0:91026:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788838173.479210:0:91026:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788838173.479409:0:91026:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788838173.479415:0:91026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788838173.482426:0:91026:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788838173.482439:0:91026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788838173.490525:0:91026:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788838173.490551:0:91026:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788838173.491780:0:91026:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788838173.491863:0:91026:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788838173.491865:0:91026:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788838173.491870:0:91026:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788838173.491876:0:91026:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 61, was 0): CONNECTING 00000100:00100000:1.0:1788838173.491883:0:91026:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:2.0:1788838173.757182:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838174.782857:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838175.104658:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838175.104692:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135068032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838175.104772:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838175.105032:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135068032 00000100:00100000:1.0:1788838175.105041:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135068032 00000100:00100000:1.0:1788838175.105107:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:1.0:1788838175.105117:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135068032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838175.105146:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838175.105192:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135068032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838175.105199:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00080000:0.0:1788838175.105337:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838175.105351:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135068160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838175.105378:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838175.105426:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135068032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838175.105494:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135068160 00000100:00100000:1.0:1788838175.105499:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135068160 00000100:00100000:1.0:1788838175.105544:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:1.0:1788838175.105551:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135068160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838175.105568:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838175.105600:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135068160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838175.105606:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00080000:0.0:1788838175.105878:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838175.105904:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135068160:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788838175.805330:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838176.829006:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838177.341213:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838177.341258:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838177.341291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838177.341321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838177.341344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838177.341397:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116425344 00000100:00100000:3.0:1788838177.341459:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116425344 00000100:00100000:1.0:1788838177.341646:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116425472 00000100:00100000:1.0:1788838177.341651:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116425472 00000100:00100000:1.0:1788838177.341699:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116425600 00000100:00100000:1.0:1788838177.341702:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116425600 00000100:00100000:1.0:1788838177.341765:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2590 00000100:00100000:1.0:1788838177.341776:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116425472:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838177.341921:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116425472:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 145us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.341930:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2590 00000100:00100000:1.0:1788838177.341952:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2591 00000100:00100000:1.0:1788838177.341959:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116425600:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838177.341988:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116425600:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.341995:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2591 00000100:00100000:1.0:1788838177.342015:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116425216 00000100:00100000:1.0:1788838177.342019:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116425216 00000100:00100000:1.0:1788838177.342043:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1271 00000100:00100000:1.0:1788838177.342050:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116425344:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838177.342084:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116425344:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 34us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.342091:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1271 00000100:00100000:1.0:1788838177.342107:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1264 00000100:00100000:1.0:1788838177.342112:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116425216:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:1.0:1788838177.342144:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838177.342174:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116425216:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 60us (829us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838177.342180:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1264 00000100:00100000:1.0:1788838177.342387:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116425088 00000100:00100000:1.0:1788838177.342400:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116425088 00000100:00100000:1.0:1788838177.342429:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1788838177.342435:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1875729116425088:12345-192.168.203.30@tcp:250:kworker.0 00010000:00080000:1.0:1788838177.342458:0:91032:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4043f878-3455-4729-a2a8-e06e8394cc00@192.168.203.30@tcp t0 exp 0000000000000000 cur 3571 last 0 00000020:00000080:1.0:1788838177.342493:0:91032:0:(genops.c:1385:class_connect()) connect: client 4043f878-3455-4729-a2a8-e06e8394cc00, cookie 0x88da08396ccc8eb4 00000100:00080000:1.0:1788838177.342717:0:91032:0:(import.c:65:import_set_state_nolock()) ffff8ff503f8e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838177.342763:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+5:2403:x1875729116425088:12345-192.168.203.30@tcp:250:kworker.0 Request processed in 326us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.342770:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00080000:0.0:1788838177.343307:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838177.343314:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838177.343317:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838177.661029:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838167/real 1788838167] req@ffff8ff637d56300 x1875729135065600/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838177 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838177.661089:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ff637d56300 x1875729135065600/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838177 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838177.661117:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838177.661127:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788838177.661144:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135065600:0@lo:250:kworker.0 00000100:00080000:1.0:1788838177.661291:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838177.661298:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788838177.661302:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838177.661307:0:63434:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3561 00000100:00080000:1.0:1788838177.661313:0:63434:0:(import.c:589:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788838177.661320:0:63434:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.661359:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63f745c00 x1875729135068288/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838177.661386:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838177.661390:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838177.661392:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838177.661395:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3566 00000100:00080000:1.0:1788838177.661397:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838177.661401:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.661422:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63f745500 x1875729135068416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838177.661479:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838177.661482:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838177.661484:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838177.661488:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3566 00000100:00080000:1.0:1788838177.661491:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838177.661495:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.661509:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef3100 x1875729135068672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838177.661525:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838177.661528:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838177.661530:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838177.661534:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3566 00000100:00080000:1.0:1788838177.661536:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838177.661541:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.661554:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50475f480 x1875729135068928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838177.661584:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838177.661587:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838177.661589:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838177.661592:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3566 00000100:00080000:1.0:1788838177.661595:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838177.661598:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.661610:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61d27f480 x1875729135069312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838177.661864:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135068800:0@lo:400:kworker.0 00000100:00100000:3.0:1788838177.661961:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.662016:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838177.662023:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135068544:0@lo:400:kworker.0 00000100:00100000:3.0:1788838177.662059:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.662092:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135069056:0@lo:400:kworker.0 00000100:00100000:3.0:1788838177.662124:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.662149:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838177.662154:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135069184:0@lo:400:kworker.0 00000100:00100000:3.0:1788838177.662178:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.662212:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135069056 00000100:00100000:3.0:1788838177.662221:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135069056 00000100:00100000:3.0:1788838177.662277:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135069184 00000100:00100000:3.0:1788838177.662280:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135069184 00000100:00100000:3.0:1788838177.662305:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1788838177.662314:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135069056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838177.662372:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135069056:12345-0@lo:400:kworker.0 Request processed in 58us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.662380:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1788838177.662399:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1788838177.662405:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135069184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838177.662431:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135069184:12345-0@lo:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.662437:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1788838177.662480:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135069184:0@lo:400:kworker.0 00000100:00100000:3.0:1788838177.662492:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135069056:0@lo:400:kworker.0 00000100:00020000:3.0:1788838177.662534:0:3642:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8ff63f745c00 x1875729135068288/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838177.663396:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135068800 00000100:00100000:1.0:1788838177.663407:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135068800 00000100:00100000:1.0:1788838177.663466:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135068544 00000100:00100000:1.0:1788838177.663469:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135068544 00000100:00100000:1.0:1788838177.663495:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1788838177.663504:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135068800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838177.663585:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135068800:12345-0@lo:400:kworker.0 Request processed in 83us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.663592:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1788838177.663607:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1788838177.663614:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135068544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838177.663643:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135068544:12345-0@lo:400:kworker.0 Request processed in 30us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.663649:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1788838177.663735:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135068544:0@lo:400:kworker.0 00000100:00100000:1.0:1788838177.663749:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135068800:0@lo:400:kworker.0 10000000:01000000:2.0:1788838177.664008:0:91026:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788838177.664032:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1a00/0x88da08396ccc8a77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a7e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664044:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1a00/0x88da08396ccc8a77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a7e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664062:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788838177.664077:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664089:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1a00/0x88da08396ccc8a77 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a7e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664132:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0800/0x88da08396ccc89dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc89e4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664138:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0800/0x88da08396ccc89dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc89e4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664144:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838177.664148:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664152:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0800/0x88da08396ccc89dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc89e4 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664161:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff63297ae00/0x88da08396ccc89f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a00 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664167:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297ae00/0x88da08396ccc89f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a00 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664172:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838177.664176:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664179:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff63297ae00/0x88da08396ccc89f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a00 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664188:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ea00/0x88da08396ccc8a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a2a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664193:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ea00/0x88da08396ccc8a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a2a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664198:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838177.664208:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664212:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5ea00/0x88da08396ccc8a23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a2a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664222:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff63297ac00/0x88da08396ccc8a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a38 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664228:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297ac00/0x88da08396ccc8a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a38 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664234:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838177.664237:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664240:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff63297ac00/0x88da08396ccc8a31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a38 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664249:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e800/0x88da08396ccc8a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a54 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664256:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e800/0x88da08396ccc8a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a54 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664261:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838177.664265:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664268:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff61de5e800/0x88da08396ccc8a4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a54 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664277:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff63297b000/0x88da08396ccc8a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a62 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664284:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297b000/0x88da08396ccc8a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a62 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664300:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838177.664304:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664309:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff63297b000/0x88da08396ccc8a5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a62 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664319:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0a00/0x88da08396ccc8a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a8c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664325:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0a00/0x88da08396ccc8a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a8c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664331:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838177.664334:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664337:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff505bb0a00/0x88da08396ccc8a85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a8c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664350:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1600/0x88da08396ccc89eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc89f2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664357:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1600/0x88da08396ccc89eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc89f2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664362:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838177.664365:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664368:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1600/0x88da08396ccc89eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc89f2 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664379:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1c00/0x88da08396ccc8a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a0e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664395:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1c00/0x88da08396ccc8a07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a0e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664400:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838177.664403:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664408:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1c00/0x88da08396ccc8a07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a0e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664421:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1000/0x88da08396ccc8a15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a1c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664427:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1000/0x88da08396ccc8a15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a1c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664432:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788838177.664436:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664440:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff505bb1000/0x88da08396ccc8a15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a1c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664448:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff63297a800/0x88da08396ccc8a3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a46 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664454:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff63297a800/0x88da08396ccc8a3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a46 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664459:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788838177.664463:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664466:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff63297a800/0x88da08396ccc8a3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a46 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.664486:0:91026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8a69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8a70 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838177.664493:0:91026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8a69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8a70 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.664498:0:91026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788838177.664501:0:91026:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788838177.664506:0:91026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8a69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8a70 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788838177.664709:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838177.664716:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838177.664720:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838177.700436:0:91026:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 62, was 0): CONNECTING 00000100:00080000:2.0:1788838177.700452:0:91026:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:3.0:1788838177.700683:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838177.700789:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:3.0:1788838177.700837:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:0:1875729135068288:0@lo:250:kworker.0 00000100:00100000:3.0:1788838177.700854:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135068416:0@lo:38:kworker.0 00000100:00080000:1.0:1788838177.700867:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838177.700874:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788838177.700878:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838177.700884:0:63434:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3571 00000100:00080000:1.0:1788838177.700890:0:63434:0:(import.c:589:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788838177.700900:0:63434:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.700943:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61d27fb80 x1875729135069440/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838177.701433:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.701526:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135068672:0@lo:38:kworker.0 00000100:00100000:3.0:1788838177.701555:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.701722:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135068928:0@lo:38:kworker.0 00000100:00100000:3.0:1788838177.701754:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.701780:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135069312:0@lo:38:kworker.0 00000100:00100000:3.0:1788838177.701837:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.701988:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135068416 00000100:00100000:0.0:1788838177.701999:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135068416 00000100:00100000:0.0:1788838177.702046:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135068672 00000100:00100000:0.0:1788838177.702049:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135068672 00000100:00100000:0.0:1788838177.702068:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1788838177.702076:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135068416:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838177.702102:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838177.702153:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135068416:12345-0@lo:38:kworker.0 Request processed in 77us (722us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838177.702161:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1788838177.702181:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1788838177.702408:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135069440:0@lo:250:kworker.0 00000100:00100000:3.0:1788838177.702443:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838177.702476:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135068928 00000100:00100000:2.0:1788838177.702481:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135068928 00000100:00080000:3.0:1788838177.702491:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838177.702497:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838177.702501:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135068416:0@lo:38:kworker.0 00000100:00100000:2.0:1788838177.702505:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4120 00000100:00100000:2.0:1788838177.702511:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135068928:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838177.702523:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838177.702553:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135069440 00000100:00100000:3.0:1788838177.702558:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135069440 00000100:00100000:2.0:1788838177.702571:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135068928:12345-0@lo:38:kworker.0 Request processed in 60us (816us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788838177.702573:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838177.702577:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838177.702578:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4120 00000100:00100000:3.0:1788838177.702580:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135068928:0@lo:38:kworker.0 00000100:00100000:2.0:1788838177.702614:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135069312 00000100:00100000:2.0:1788838177.702618:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135069312 00000100:00100000:0.0:1788838177.702687:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135068672:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838177.702697:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838177.702831:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135068672:12345-0@lo:38:kworker.0 Request processed in 144us (1275us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788838177.702916:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838177.702938:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838177.702942:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135068672:0@lo:38:kworker.0 00000100:00100000:3.0:1788838177.702966:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838177.702971:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3642:x1875729135069440:12345-0@lo:250:kworker.0 00010000:00080000:3.0:1788838177.702989:0:91034:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo t0 exp 0000000000000000 cur 3571 last 0 00000020:00000080:3.0:1788838177.703027:0:91034:0:(genops.c:1385:class_connect()) connect: client 57943c9a-ca27-46d8-8845-5d2bce640e45, cookie 0x88da08396ccc8ebb 00000100:00080000:3.0:1788838177.703216:0:91034:0:(import.c:65:import_set_state_nolock()) ffff8ff639656800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838177.703268:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+5:3642:x1875729135069440:12345-0@lo:250:kworker.0 Request processed in 295us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.703275:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788838177.703957:0:3642:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 27 00000100:00080000:3.0:1788838177.703969:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:3.0:1788838177.703979:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788838177.703985:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788838177.703988:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788838177.703991:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788838177.704019:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788838177.704031:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135069440:0@lo:250:kworker.0 00000100:00080000:3.0:1788838177.704107:0:91026:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1788838177.704120:0:91026:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788838177.704165:0:91026:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788838177.704172:0:91026:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788838177.704620:0:91026:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788838177.704673:0:91026:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788838177.704677:0:91026:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788838177.704679:0:91026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838177.704681:0:91026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838177.704682:0:91026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838177.704688:0:91026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838177.704689:0:91026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838177.704691:0:91026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838177.704692:0:91026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838177.704694:0:91026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838177.704695:0:91026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788838177.704698:0:91026:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788838177.704700:0:91026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788838177.704701:0:91026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838177.704702:0:91026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838177.704703:0:91026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838177.704704:0:91026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838177.704704:0:91026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838177.704777:0:91026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838177.704778:0:91026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838177.704779:0:91026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838177.704780:0:91026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788838177.704843:0:91026:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788838177.704864:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135069568:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788838177.704996:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.705034:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503e6a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788838177.705113:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135069568 00000100:00100000:3.0:1788838177.705121:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135069568 00000100:00100000:3.0:1788838177.705167:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788838177.705175:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:91026:x1875729135069568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788838177.705237:0:91032:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788838177.705240:0:91032:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788838177.705243:0:91032:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788838177.706125:0:91035:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:2.0:1788838177.706233:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:2.0:1788838177.706242:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135069312:12345-0@lo:38:kworker.0 20000000:01000000:3.0:1788838177.706260:0:91032:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 117 00010000:00020000:2.0:1788838177.706270:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838177.706572:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135069312:12345-0@lo:38:kworker.0 Request processed in 327us (4732us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838177.706581:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00080000:2.0:1788838177.706643:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838177.706650:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838177.706654:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135069312:0@lo:38:kworker.0 00000020:01000000:2.0:1788838177.706836:0:63434:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.130@tcp 10000000:01000000:2.0:1788838177.706857:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1788838177.706860:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788838177.706863:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788838177.706864:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838177.706866:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838177.706867:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838177.706868:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838177.706870:0:63434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838177.706871:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838177.706873:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788838177.706937:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788838177.706945:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1788838177.706947:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788838177.706948:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788838177.706949:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838177.706950:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838177.706951:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838177.706952:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838177.706953:0:63434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838177.706955:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838177.706956:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788838177.706971:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788838177.706975:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1788838177.706977:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788838177.706978:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788838177.706979:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838177.706980:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838177.706981:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838177.706987:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838177.706988:0:63434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838177.706990:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838177.706991:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788838177.707026:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788838177.707028:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135069952:0@lo:253:kworker.0 00000100:00100000:3.0:1788838177.707085:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.707131:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135069952 00000100:00100000:3.0:1788838177.707138:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135069952 00000100:00100000:3.0:1788838177.707179:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788838177.707303:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+6:3643:x1875729135069952:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788838177.707333:0:91034:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1788838177.707390:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1788838177.707964:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135069696:0@lo:253:kworker.0 00000100:00100000:1.0:1788838177.708017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838177.708045:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838177.708054:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135069824:0@lo:253:kworker.0 00000100:00100000:1.0:1788838177.708079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838177.708102:0:91033:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1788838177.708110:0:91033:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1788838177.708705:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135069696 00000100:00100000:2.0:1788838177.708714:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135069696 00000100:00100000:2.0:1788838177.708754:0:91033:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1788838177.708761:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135069824 00000100:00100000:2.0:1788838177.708764:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135069824 00000100:00100000:1.0:1788838177.709504:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788838177.709519:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3645:x1875729135069696:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788838177.710655:0:91036:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788838177.711970:0:91037:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788838177.711980:0:91037:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788838177.711984:0:91037:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788838177.711987:0:91037:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788838177.712217:0:91037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788838177.712442:0:91032:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788838177.712473:0:91032:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788838177.712777:0:91034:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788838177.714576:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:91026:x1875729135069568:12345-0@lo:253:mount.lustre.0 Request processed in 9384us (9562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838177.714592:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788838177.714653:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788838177.714665:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:3645:x1875729135069824:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788838177.714701:0:91032:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788838177.714999:0:91034:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788838177.715011:0:91034:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788838177.715038:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135069568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788838177.715076:0:91026:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788838177.715080:0:91026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788838177.715082:0:91026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788838177.715084:0:91026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838177.715085:0:91026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838177.715086:0:91026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838177.715088:0:91026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838177.715089:0:91026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838177.715091:0:91026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788838177.715093:0:91026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838177.715095:0:91026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788838177.715136:0:91026:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff640eee800 from lustre-MDT0000 20000000:01000000:1.0:1788838177.715172:0:91036:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 10000000:01000000:0.0:1788838177.715176:0:91026:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788838177.715179:0:91026:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788838177.715191:0:91026:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ff640eee800 10000000:01000000:0.0:1788838177.715196:0:91026:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788838177.715201:0:91026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ff640eee800 10000000:01000000:0.0:1788838177.715204:0:91026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788838177.715208:0:91026:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff640eee800 from 1 10000000:01000000:0.0:1788838177.715212:0:91026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788838177.715257:0:91026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.715270:0:91026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.715280:0:91026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838177.715305:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135070080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838177.715369:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.715414:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838177.715569:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+7:3643:x1875729135069952:12345-0@lo:253:kworker.0 Request processed in 8268us (8482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.715578:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788838177.715606:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135070080 00000100:00100000:3.0:1788838177.715612:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135070080 00000100:00100000:3.0:1788838177.715640:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788838177.715648:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+7:91026:x1875729135070080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838177.715658:0:91034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838177.715677:0:91034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e000/0x88da08396ccc8ec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8ec2 expref: -99 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.715716:0:91034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e000/0x88da08396ccc8ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8ec2 expref: 8 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.715730:0:91034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e000/0x88da08396ccc8ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8ec2 expref: 8 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.715742:0:91034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e000, rc 0) 00000100:00100000:3.0:1788838177.715769:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:91026:x1875729135070080:12345-0@lo:101:mount.lustre.0 Request processed in 122us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.715775:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 20000000:01000000:2.0:1788838177.716176:0:91035:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788838177.716183:0:91035:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788838177.716212:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.716224:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788838177.716234:0:91035:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000052375s 00010000:00010000:2.0:1788838177.716240:0:91035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.716247:0:91035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.716272:0:91035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.716279:0:91035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788838177.716292:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00010000:00010000:2.0:1788838177.716296:0:91035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838177.716301:0:91035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788838177.716301:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788838177.716302:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838177.716304:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838177.716306:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838177.716307:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838177.716308:0:3643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838177.716309:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:2.0:1788838177.716311:0:91035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788838177.716311:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788838177.716316:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135069952:0@lo:253:kworker.0 00010000:00010000:2.0:1788838177.716323:0:91035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.716331:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.716337:0:91035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc8ed0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838177.716363:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135070080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838177.716379:0:91026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.716388:0:91026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838177.716405:0:91026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788838177.716419:0:91026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.716427:0:91026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838177.716435:0:91026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788838177.716439:0:91026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788838177.716445:0:91026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ff640eee800 10000000:01000000:0.0:1788838177.716448:0:91026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788838177.716451:0:91026:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788838177.716454:0:91026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788838177.716477:0:91026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.716507:0:91026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.716516:0:91026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838177.716534:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135070208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838177.716576:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.716615:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838177.716976:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135070208 00000100:00100000:3.0:1788838177.716985:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135070208 00000100:00100000:3.0:1788838177.717035:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788838177.717044:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:91026:x1875729135070208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838177.717056:0:91034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838177.717070:0:91034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e400/0x88da08396ccc8ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8ed7 expref: -99 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.717089:0:91034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e400/0x88da08396ccc8ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8ed7 expref: 9 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.717099:0:91034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e400/0x88da08396ccc8ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8ed7 expref: 9 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.717107:0:91034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e400, rc 0) 00000100:00100000:3.0:1788838177.717152:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:91026:x1875729135070208:12345-0@lo:101:mount.lustre.0 Request processed in 109us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.717159:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788838177.717280:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135070208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838177.717292:0:91026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.717301:0:91026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838177.717384:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135070336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838177.717419:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.717448:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838177.717583:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135070336 00000100:00100000:3.0:1788838177.717587:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135070336 00000100:00100000:3.0:1788838177.717621:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788838177.717629:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:91026:x1875729135070336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838177.717837:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91026:x1875729135070336:12345-0@lo:501:mount.lustre.0 Request processed in 168us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.717846:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788838177.717960:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135070336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838177.717995:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135070464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838177.718048:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.718071:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838177.718123:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135070464 00000100:00100000:3.0:1788838177.718128:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135070464 00000100:00100000:3.0:1788838177.718147:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788838177.718154:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91026:x1875729135070464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838177.718913:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91026:x1875729135070464:12345-0@lo:503:mount.lustre.0 Request processed in 756us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.718929:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788838177.719118:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135070464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838177.720206:0:91038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91038:1875729135070592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838177.720299:0:91038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838177.720355:0:91038:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838177.720459:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135070592 00000100:00100000:3.0:1788838177.720466:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135070592 00000100:00100000:3.0:1788838177.720523:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788838177.720531:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91038:x1875729135070592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838177.721472:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91038:x1875729135070592:12345-0@lo:502:llog_process_th.0 Request processed in 937us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.721483:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788838177.721706:0:91038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91038:1875729135070592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838177.721755:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838177.721772:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838177.721781:0:91038:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788838177.721788:0:91038:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788838177.721791:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788838177.721846:0:91038:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ff6102419b8) 00000020:00000080:2.0:1788838177.721877:0:91038:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1788838177.721883:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788838177.721993:0:91038:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788838177.722003:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8eec 00000020:00000080:2.0:1788838177.722301:0:91038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788838177.722306:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838177.722310:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838177.722311:0:91038:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788838177.722314:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838177.722318:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838177.722320:0:91038:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788838177.722323:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788838177.722333:0:91038:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ff61d0e0000) 00000020:00000080:2.0:1788838177.722348:0:91038:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1788838177.722352:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788838177.722354:0:91038:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788838177.722358:0:91038:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788838177.722376:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788838177.722438:0:91038:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff640eee800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788838177.722455:0:91038:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ff61d0e4d28) 00000020:00000080:2.0:1788838177.722467:0:91038:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1788838177.722713:0:91038:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788838177.722722:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8f01 00000020:00000080:2.0:1788838177.723162:0:91038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788838177.723173:0:91038:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788838177.723180:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88da08396ccc8f08 00080000:01000000:2.0:1788838177.723188:0:91038:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788838177.723193:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8f0f 20000000:01000000:1.0:1788838177.731682:0:91036:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788838177.731716:0:91036:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788838177.731821:0:91035:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788838177.731837:0:91035:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788838177.731878:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.731899:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788838177.731911:0:91035:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000075536s 00010000:00010000:2.0:1788838177.731917:0:91035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.731926:0:91035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.731934:0:91035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.731942:0:91035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.731950:0:91035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838177.731955:0:91035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.731964:0:91035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.731979:0:91035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.731987:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.732005:0:91035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8800/0x88da08396ccc8f16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788838177.732163:0:91032:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788838177.732224:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+9:3645:x1875729135069696:12345-0@lo:253:kworker.0 Request processed in 22704us (24199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.732235:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1788838177.732484:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788838177.732488:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838177.732489:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838177.732491:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838177.732492:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838177.732494:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838177.732496:0:3645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838177.732498:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838177.732500:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788838177.732504:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135069696:0@lo:253:kworker.0 20000000:01000000:2.0:1788838177.737737:0:91032:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788838177.737763:0:91032:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788838177.738090:0:91035:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788838177.738097:0:91035:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788838177.738127:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.738148:0:91035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788838177.738159:0:91035:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000075536s 00010000:00010000:3.0:1788838177.738164:0:91035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.738172:0:91035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.738180:0:91035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.738188:0:91035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.738217:0:91035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148f800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838177.738223:0:91035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.738243:0:91035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.738259:0:91035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.738278:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838177.738285:0:91035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8f1d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838177.738409:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3645:x1875729135069824:12345-0@lo:253:kworker.0 Request processed in 23741us (30322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838177.738422:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:1.0:1788838177.741485:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788838177.741496:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788838177.741497:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838177.741499:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838177.741535:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838177.741538:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838177.741539:0:3645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838177.741541:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838177.741543:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788838177.741552:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135069824:0@lo:253:kworker.0 00010000:00010000:2.0:1788838177.853395:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838177.861774:0:91038:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788838177.865629:0:91038:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: fdcf066d-ff07-4b2e-96ab-52415ed6bf72 idx: 0 lr: 107374182411 srv lr: 111669149696 lx: 0 gen 23 00000001:00080000:2.0:1788838177.865699:0:91038:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149696 lx: 0 gen 22 00000001:00000004:2.0:1788838177.865730:0:91038:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149696 00000001:00080000:2.0:1788838177.865905:0:91038:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788838177.865969:0:91038:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff503ede540: xid 1875729116414720, transno 111669149703, client gen 23, slot idx 0 00000001:00080000:2.0:1788838177.865981:0:91038:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff503edee40: xid 1875729116414464, transno 111669149702, client gen 23, slot idx 1 00000020:00000080:2.0:1788838177.866649:0:91038:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ff61d0e3370) 00000020:00000080:2.0:1788838177.866679:0:91038:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788838177.866785:0:91038:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788838177.866793:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8f39 00000020:00000080:0.0:1788838177.867644:0:91038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788838177.885209:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88da08396ccc8f40 00000020:00000080:0.0:1788838177.886511:0:91038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788838177.886531:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838177.886540:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838177.886542:0:91038:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788838177.886545:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838177.886549:0:91038:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788838177.886551:0:91038:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838177.886552:0:91038:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838177.886554:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838177.886556:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838177.886558:0:91038:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838177.886560:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838177.886566:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838177.886568:0:91038:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788838177.886573:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788838177.886636:0:91038:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788838177.886657:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838177.886660:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838177.886662:0:91038:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788838177.886664:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838177.886667:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838177.886669:0:91038:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788838177.886671:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838177.886678:0:91038:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:0.0:1788838177.886712:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838177.886734:0:91038:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ff503ca19b8) 00000020:00000080:0.0:1788838177.886759:0:91038:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788838177.886766:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838177.886864:0:91038:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788838177.886871:0:91038:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788838177.886878:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8f4e 00010000:00080000:0.0:1788838177.886919:0:91038:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff6104d8000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788838177.892431:0:91038:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1788838177.896991:0:91038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838177.897016:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788838177.897075:0:91038:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788838177.897112:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8f55 00000100:00080000:1.0:1788838177.897127:0:91038:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788838177.897135:0:91038:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ff6104d8000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.897183:0:91038:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61d27f480 x1875729135070720/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838177.897205:0:91038:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788838177.897282:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838177.897287:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838177.897290:0:91038:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788838177.897293:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788838177.897296:0:91038:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788838177.897297:0:91038:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788838177.897299:0:91038:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788838177.897301:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788838177.897303:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838177.897305:0:91038:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788838177.897307:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788838177.897313:0:91038:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788838177.897329:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838177.897331:0:91038:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788838177.897335:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788838177.897339:0:91038:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:1.0:1788838177.897372:0:91038:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788838177.897387:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838177.897404:0:91038:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ff6395619b8) 00000020:00000080:1.0:1788838177.897423:0:91038:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788838177.897430:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788838177.897518:0:91038:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788838177.897526:0:91038:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788838177.897531:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8f63 00010000:00080000:1.0:1788838177.897570:0:91038:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff6104df800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788838177.897860:0:91038:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:1.0:1788838177.898727:0:91038:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788838177.898761:0:91038:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788838177.899024:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135070720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788838177.899143:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.899301:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135070720 00000100:00100000:3.0:1788838177.899312:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135070720 00000100:00100000:3.0:1788838177.899364:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4121 00000100:00100000:3.0:1788838177.899374:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135070720:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788838177.899409:0:8472:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3571 last 0 00000020:00000080:3.0:1788838177.899452:0:8472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8f6a 00000004:00100000:3.0:1788838177.899474:0:8472:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838177.899615:0:8472:0:(import.c:65:import_set_state_nolock()) ffff8ff632f51000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838177.899698:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135070720:12345-0@lo:38:llog_process_th.0 Request processed in 324us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.899707:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4121 00000100:00100000:2.0:1788838177.900438:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788838177.900452:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:2.0:1788838177.900462:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788838177.900470:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788838177.900490:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6104d8000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788838177.900509:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135070720:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788838177.900661:0:91038:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000100:00100000:0.0:1788838177.901058:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838177.901076:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135070848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838177.901168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.902699:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135070848 00000100:00100000:3.0:1788838177.902730:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135070848 00000100:00100000:3.0:1788838177.902846:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4122 00000100:00100000:3.0:1788838177.902858:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135070848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838177.902905:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838177.902993:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135070848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.903000:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4122 00000100:00100000:0.0:1788838177.903152:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135070848:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788838177.907284:0:91038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838177.909982:0:91038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:1.0:1788838177.910259:0:91038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:1.0:1788838177.911246:0:91044:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:1.0:1788838177.911254:0:91044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788838177.911490:0:91044:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:1.0:1788838177.911514:0:91044:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788838177.911669:0:91044:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:1.0:1788838177.911673:0:91044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788838177.912702:0:91038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838177.912719:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788838177.912774:0:91038:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788838177.912846:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8f71 00000100:00080000:1.0:1788838177.912861:0:91038:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788838177.912868:0:91038:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff6104df800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.912915:0:91038:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61d27fb80 x1875729135070976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838177.912999:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135070976:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788838177.913166:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788838177.913248:0:91038:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788838177.913351:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838177.913356:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838177.913358:0:91038:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788838177.913361:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788838177.913364:0:91038:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788838177.913366:0:91038:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788838177.913367:0:91038:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788838177.913369:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788838177.913371:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838177.913372:0:91038:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788838177.913375:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788838177.913379:0:91038:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788838177.913383:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838177.913384:0:91038:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788838177.913387:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788838177.913392:0:91038:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:1.0:1788838177.913418:0:91038:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788838177.913421:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838177.913436:0:91038:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ff639560000) 00000020:00000080:1.0:1788838177.913454:0:91038:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788838177.913459:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788838177.913538:0:91038:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788838177.913545:0:91038:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788838177.913553:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc8f7f 00010000:00080000:1.0:1788838177.913589:0:91038:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff62ceaf000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788838177.913848:0:91038:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1788838177.913935:0:91038:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788838177.913953:0:91038:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788838177.914267:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135070976 00000100:00100000:0.0:1788838177.914279:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135070976 00000100:00100000:0.0:1788838177.914334:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5953 00000100:00100000:0.0:1788838177.914344:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3642:x1875729135070976:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788838177.914377:0:26210:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3571 last 0 00000020:00000080:0.0:1788838177.914407:0:26210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8f86 00002000:00100000:0.0:1788838177.914426:0:26210:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ff604fe4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788838177.914431:0:26210:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788838177.914434:0:26210:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788838177.914524:0:26210:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788838177.914550:0:26210:0:(import.c:65:import_set_state_nolock()) ffff8ff604fe7800 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1788838177.914994:0:91038:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000100:00100000:0.0:1788838177.915717:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135070976:12345-0@lo:8:llog_process_th.0 Request processed in 1370us (2547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838177.915729:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5953 00000100:00100000:2.0:1788838177.915946:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788838177.915962:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788838177.915974:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788838177.915981:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788838177.915984:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6104df800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788838177.916038:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788838177.916047:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135070976:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788838177.916389:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838177.916405:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135071104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838177.916482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.916564:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135071104 00000100:00100000:0.0:1788838177.916572:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135071104 00000100:00100000:0.0:1788838177.916630:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:0.0:1788838177.916639:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135071104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838177.916669:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838177.916723:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135071104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838177.916745:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00080000:0.0:1788838177.916767:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838177.916875:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135071104:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788838177.918893:0:91044:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788838177.919042:0:91044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3571938244199ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788838177.919052:0:91044:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:2.0:1788838177.921035:0:91038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838177.921082:0:91038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:2.0:1788838177.921910:0:91038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000040:00080000:1.0:1788838177.922922:0:91046:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:1.0:1788838177.922931:0:91046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788838177.923158:0:91046:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000040:00080000:1.0:1788838177.923180:0:91046:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788838177.923952:0:91046:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:1.0:1788838177.923959:0:91046:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1788838177.926569:0:91027:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:3.0:1788838177.927525:0:91038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788838177.927546:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788838177.927613:0:91038:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788838177.927647:0:91038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8f8d 00000100:00080000:3.0:1788838177.928157:0:91038:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838177.928166:0:91038:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ff62ceaf000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838177.928217:0:91038:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50475f480 x1875729135071232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838177.928250:0:91038:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788838177.928379:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135071232:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788838177.928463:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838177.928470:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838177.928473:0:91038:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788838177.928478:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838177.928484:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838177.928485:0:91038:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788838177.928490:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000100:00100000:2.0:1788838177.928492:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788838177.928494:0:91038:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788838177.928520:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838177.928523:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838177.928526:0:91038:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788838177.928529:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838177.928533:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838177.928534:0:91038:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788838177.928540:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788838177.928582:0:91038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91038:1875729135071360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838177.928590:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135071232 00000100:00100000:2.0:1788838177.928600:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135071232 00000100:00100000:3.0:1788838177.928646:0:91038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838177.928646:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5954 00000100:00100000:2.0:1788838177.928658:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3642:x1875729135071232:12345-0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788838177.928684:0:91038:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505aecb40 going to sleep for 11 seconds 00010000:00080000:2.0:1788838177.928693:0:26207:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3571 last 0 00000020:00000080:2.0:1788838177.928727:0:26207:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc8f94 00002000:00100000:2.0:1788838177.928745:0:26207:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ff604587800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788838177.928751:0:26207:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788838177.928754:0:26207:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788838177.928902:0:26207:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788838177.928934:0:26207:0:(import.c:65:import_set_state_nolock()) ffff8ff604584000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838177.929005:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135071232:12345-0@lo:8:llog_process_th.0 Request processed in 347us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838177.929014:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5954 00000100:00100000:2.0:1788838177.929048:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135071360 00000100:00100000:2.0:1788838177.929052:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135071360 00000100:00100000:2.0:1788838177.929099:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788838177.929107:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:91038:x1875729135071360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838177.929233:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:91038:x1875729135071360:12345-0@lo:502:llog_process_th.0 Request processed in 127us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838177.929240:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788838177.929308:0:91038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91038:1875729135071360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838177.929342:0:91038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838177.929347:0:91038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838177.929350:0:91038:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788838177.929355:0:91038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1788838177.929380:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838177.929390:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788838177.929399:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788838177.929406:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788838177.929409:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62ceaf000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000020:01000000:2.0:1788838177.929553:0:91026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788838177.929592:0:91026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788838177.929652:0:91026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.929665:0:91026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838177.929674:0:91026:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff640eee800 from 1 10000000:01000000:2.0:1788838177.929677:0:91026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788838177.929711:0:91026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.929728:0:91026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838177.929739:0:91026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838177.929757:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135071488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838177.929793:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838177.929862:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b7fc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838177.931460:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135071488 00000100:00100000:1.0:1788838177.931478:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135071488 00000100:00100000:1.0:1788838177.931542:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838177.931553:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+8:91026:x1875729135071488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838177.931571:0:91036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838177.931599:0:91036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712d000/0x88da08396ccc8fa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8f9b expref: -99 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.931630:0:91036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712d000/0x88da08396ccc8fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8f9b expref: 9 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.931644:0:91036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712d000/0x88da08396ccc8fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8f9b expref: 9 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.931717:0:91036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d000, rc 0) 00000100:00100000:1.0:1788838177.931852:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+9:91026:x1875729135071488:12345-0@lo:101:mount.lustre.0 Request processed in 300us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.931861:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788838177.931947:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135071488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838177.931974:0:91026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.931986:0:91026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838177.932604:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135071616:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788838177.932674:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.932724:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838177.932760:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135071616 00000100:00100000:0.0:1788838177.932768:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135071616 00000100:00100000:1.0:1788838177.932789:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135071744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838177.932853:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788838177.932865:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff608228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:91026:x1875729135071616:12345-0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788838177.932876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:0.0:1788838177.932892:0:91034:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788838177.932928:0:91034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788838177.932932:0:91034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788838177.932935:0:91034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788838177.932937:0:91034:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 120 00000100:00100000:0.0:1788838177.933027:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff608228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:91026:x1875729135071616:12345-0@lo:256:mount.lustre.0 Request processed in 165us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838177.933036:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788838177.933084:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135071616:0@lo:256:mount.lustre.0 00000004:00080000:3.0:1788838177.933232:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788838177.933246:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135071232:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788838177.933376:0:91046:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788838177.933484:0:91046:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3571952685600ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788838177.933492:0:91046:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 10000000:01000000:0.0:1788838177.933721:0:91026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788838177.933756:0:91026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.933767:0:91026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838177.933777:0:91026:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff640eee800 from 1 10000000:01000000:0.0:1788838177.933780:0:91026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788838177.933850:0:91026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.933859:0:91026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.933870:0:91026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838177.933887:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135071872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838177.933932:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.933965:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838177.934142:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135071872 00000100:00100000:1.0:1788838177.934149:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135071872 00000100:00100000:1.0:1788838177.934197:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788838177.934206:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+9:91026:x1875729135071872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838177.934220:0:91036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838177.934241:0:91036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712d400/0x88da08396ccc8fb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8fa9 expref: -99 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.934268:0:91036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712d400/0x88da08396ccc8fb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8fa9 expref: 10 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.934281:0:91036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712d400/0x88da08396ccc8fb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8fa9 expref: 10 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.934298:0:91036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d400, rc 0) 00000100:00100000:1.0:1788838177.934361:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91026:x1875729135071872:12345-0@lo:101:mount.lustre.0 Request processed in 155us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.934368:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788838177.934597:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135071744 00000100:00100000:2.0:1788838177.934603:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135071744 00000100:00100000:2.0:1788838177.934649:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1788838177.934657:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135071744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838177.934683:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838177.934739:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135071744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838177.934746:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1788838177.934833:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135071744:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788838177.934862:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838177.935961:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135071872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838177.935995:0:91026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838177.936012:0:91026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838177.936143:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135072000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838177.936204:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.936264:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838177.936753:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135072000 00000100:00100000:1.0:1788838177.936762:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135072000 00000100:00100000:1.0:1788838177.936852:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788838177.936862:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff608228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91026:x1875729135072000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838177.937273:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff608228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91026:x1875729135072000:12345-0@lo:501:mount.lustre.0 Request processed in 412us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.937282:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788838177.938256:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135072000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838177.938336:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135072128:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838177.938416:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.938465:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838177.939170:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135072128 00000100:00100000:1.0:1788838177.939181:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135072128 00000100:00100000:1.0:1788838177.939245:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788838177.939255:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91026:x1875729135072128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838177.939429:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91026:x1875729135072128:12345-0@lo:503:mount.lustre.0 Request processed in 175us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.939438:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788838177.939457:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135072128:0@lo:503:mount.lustre.0 00000004:00080000:3.0:1788838177.939612:0:91027:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788838177.943770:0:91048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91048:1875729135072256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838177.944599:0:91048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.946847:0:91048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838177.947976:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135072256 00000100:00100000:1.0:1788838177.947995:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135072256 00000100:00100000:1.0:1788838177.948133:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788838177.948146:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a55ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91048:x1875729135072256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838177.952991:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a55ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91048:x1875729135072256:12345-0@lo:502:llog_process_th.0 Request processed in 4835us (8382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.953010:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788838177.953194:0:91048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91048:1875729135072256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838177.953247:0:91048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838177.953260:0:91048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838177.953263:0:91048:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788838177.953273:0:91048:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff640eee800 00000020:00000080:2.0:1788838177.953276:0:91048:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788838177.953297:0:91048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838177.953313:0:91048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838177.953315:0:91048:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788838177.953318:0:91048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838177.953320:0:91048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838177.953322:0:91048:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788838177.953325:0:91048:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff640eee800 00000020:00000080:2.0:1788838177.953328:0:91048:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788838177.953457:0:91048:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91048:1875729135072384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838177.953521:0:91048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.964662:0:91048:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b7fc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838177.964788:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135072384 00000100:00100000:0.0:1788838177.964829:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135072384 00000100:00100000:0.0:1788838177.964931:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788838177.964945:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91048:x1875729135072384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838177.965374:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91048:x1875729135072384:12345-0@lo:502:llog_process_th.0 Request processed in 431us (11851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838177.965385:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788838177.971009:0:91048:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91048:1875729135072384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788838177.971083:0:91048:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838177.971109:0:91048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838177.971112:0:91048:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788838177.971119:0:91048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788838177.971549:0:91026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788838177.971583:0:91026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788838177.971614:0:91026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.971628:0:91026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838177.971703:0:91026:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788838177.971707:0:91026:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ff640eee800 10000000:01000000:1.0:1788838177.971710:0:91026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ff640eee800 10000000:01000000:1.0:1788838177.971715:0:91026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788838177.971723:0:91026:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff640eee800 from 1 10000000:01000000:1.0:1788838177.971740:0:91026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838177.971792:0:91026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.971835:0:91026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.971846:0:91026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838177.971876:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135072512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788838177.971966:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838177.972014:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788838177.972040:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135072512 00000100:00100000:1.0:1788838177.972047:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135072512 00000100:00100000:1.0:1788838177.972097:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788838177.972107:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a55dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:91026:x1875729135072512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838177.972124:0:91033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838177.972139:0:91033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712d200/0x88da08396ccc8fbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8fb7 expref: -99 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.972166:0:91033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712d200/0x88da08396ccc8fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8fb7 expref: 11 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.972178:0:91033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712d200/0x88da08396ccc8fbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8fb7 expref: 11 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.972188:0:91033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d200, rc 0) 00000100:00100000:1.0:1788838177.972226:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a55dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91026:x1875729135072512:12345-0@lo:101:mount.lustre.0 Request processed in 120us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.972242:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788838177.972421:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135072512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838177.972437:0:91026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838177.972447:0:91026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838177.972508:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135072640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838177.972533:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838177.972556:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788838177.972599:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135072640 00000100:00100000:3.0:1788838177.972604:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135072640 00000100:00100000:3.0:1788838177.972638:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788838177.972645:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91026:x1875729135072640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838177.972792:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91026:x1875729135072640:12345-0@lo:501:mount.lustre.0 Request processed in 148us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.972837:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788838177.972877:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135072640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788838177.972911:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135072768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838177.972969:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.972985:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504857180 going to sleep for 11 seconds 00000100:00100000:3.0:1788838177.972998:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135072768 00000100:00100000:3.0:1788838177.973001:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135072768 00000100:00100000:3.0:1788838177.973016:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788838177.973021:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91026:x1875729135072768:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838177.973115:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91026:x1875729135072768:12345-0@lo:503:mount.lustre.0 Request processed in 92us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838177.973122:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788838177.973163:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135072768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838177.973918:0:91051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91051:1875729135072896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838177.973985:0:91051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.974030:0:91051:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504857600 going to sleep for 11 seconds 00000100:00100000:1.0:1788838177.974110:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135072896 00000100:00100000:1.0:1788838177.974117:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135072896 00000100:00100000:1.0:1788838177.974165:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788838177.974175:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91051:x1875729135072896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838177.974456:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91051:x1875729135072896:12345-0@lo:502:llog_process_th.0 Request processed in 280us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.974465:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788838177.974554:0:91051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91051:1875729135072896:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788838177.974638:0:91051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788838177.974662:0:91051:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ff6271ccd28) 00000020:00000080:3.0:1788838177.974701:0:91051:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788838177.974860:0:91051:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff640eee800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788838177.974865:0:91051:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff640eee800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788838177.974869:0:91051:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff640eee800 4 00010000:00080000:3.0:1788838177.974912:0:91051:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff610292800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788838177.979942:0:91051:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1788838177.980209:0:91051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788838177.980270:0:91051:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788838177.983903:0:91051:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88da08396ccc8fcc 00000100:00080000:3.0:1788838177.983933:0:91051:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838177.983950:0:91051:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff610292800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838177.983999:0:91051:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63f745c00 x1875729135073024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838177.984070:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135073024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788838177.984188:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838177.986880:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135073024 00000100:00100000:3.0:1788838177.986902:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135073024 00000100:00100000:3.0:1788838177.986968:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1788838177.986978:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135073024:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838177.988223:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135073024:12345-0@lo:38:llog_process_th.0 Request processed in 1239us (4028us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788838177.988238:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00080000:3.0:1788838177.988278:0:91051:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788838177.995856:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838177.995864:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838177.995869:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788838177.995876:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135073152:0@lo:400:kworker.0 00000100:00080000:1.0:1788838177.995878:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3571 00000100:00080000:1.0:1788838177.995885:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838177.995895:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.995925:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff632e67480 x1875729135073280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838177.995957:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838177.995961:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838177.995962:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838177.995967:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3571 00000100:00080000:1.0:1788838177.995969:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838177.995974:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.995985:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef3100 x1875729135073536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838177.996011:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838177.996015:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838177.996016:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838177.996020:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3571 00000100:00080000:1.0:1788838177.996022:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838177.996026:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.996037:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef1c00 x1875729135073792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838177.996062:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838177.996065:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838177.996067:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838177.996071:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3571 00000100:00080000:1.0:1788838177.996073:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838177.996075:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838177.996093:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6270bdc00 x1875729135074176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838177.996791:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.997106:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135074048:0@lo:400:kworker.0 00000100:00100000:0.0:1788838177.997161:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838177.997568:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788838177.997579:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff610292800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838177.997584:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788838177.997588:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135073024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788838177.997783:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135073408:0@lo:400:kworker.0 00000100:00100000:0.0:1788838177.997862:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135074048 00000100:00100000:2.0:1788838177.997871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.997873:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135074048 00000100:00100000:2.0:1788838177.997905:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135074304:0@lo:400:kworker.0 00000100:00100000:2.0:1788838177.997944:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.997945:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:0.0:1788838177.997969:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135074048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838177.997986:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135073664:0@lo:400:kworker.0 00000100:00100000:2.0:1788838177.998015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838177.998036:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135074432:0@lo:400:kworker.0 00000100:00100000:0.0:1788838177.998051:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135074048:12345-0@lo:400:kworker.0 Request processed in 95us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838177.998067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.998072:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:0.0:1788838177.998094:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135074432 00000100:00100000:0.0:1788838177.998098:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135074432 00000100:00100000:2.0:1788838177.998101:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788838177.998110:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135073920:0@lo:400:kworker.0 00000100:00100000:0.0:1788838177.998126:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:0.0:1788838177.998134:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135074432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838177.998139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838177.998176:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135074560:0@lo:400:kworker.0 00000100:00100000:2.0:1788838177.998199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838177.998266:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135074432:12345-0@lo:400:kworker.0 Request processed in 132us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838177.998292:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:1.0:1788838177.998296:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135073152 00000100:00100000:1.0:1788838177.998302:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135073152 00000100:00100000:0.0:1788838177.998307:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135073920 00000100:00100000:0.0:1788838177.998312:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135073920 00000100:00100000:0.0:1788838177.998345:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135074560 00000100:00100000:1.0:1788838177.998347:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788838177.998350:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135074560 00000100:00100000:1.0:1788838177.998359:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:3643:x1875729135073152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838177.998377:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:0.0:1788838177.998385:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135073920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838177.998406:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:3643:x1875729135073152:12345-0@lo:400:kworker.0 Request processed in 50us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.998415:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788838177.998429:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135073920:12345-0@lo:400:kworker.0 Request processed in 44us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838177.998436:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:0.0:1788838177.998454:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:0.0:1788838177.998462:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135074560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838177.998492:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135074560:12345-0@lo:400:kworker.0 Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838177.998498:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:0.0:1788838177.998538:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135074048:0@lo:400:kworker.0 00000100:00100000:0.0:1788838177.998548:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135073152:0@lo:400:kworker.0 00000100:00100000:1.0:1788838177.999200:0:91051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91051:1875729135074688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838177.999264:0:91051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838177.999573:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135074688 00000100:00100000:1.0:1788838177.999580:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135074688 00000100:00100000:1.0:1788838177.999625:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788838177.999632:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91051:x1875729135074688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838177.999761:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91051:x1875729135074688:12345-0@lo:502:llog_process_th.0 Request processed in 128us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838177.999768:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788838177.999850:0:91051:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838177.999871:0:91051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91051:1875729135074688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838177.999915:0:91051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91051:1875729135074816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838177.999948:0:91051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838177.999968:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135074816 00000100:00100000:1.0:1788838177.999972:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135074816 00000100:00100000:1.0:1788838177.999994:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788838178.000000:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91051:x1875729135074816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838178.000059:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91051:x1875729135074816:12345-0@lo:502:llog_process_th.0 Request processed in 58us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.000066:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788838178.000362:0:91051:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.000378:0:91051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:91051:1875729135074816:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788838178.000401:0:91051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:2.0:1788838178.000781:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135074432:0@lo:400:kworker.0 00000100:00100000:1.0:1788838178.000924:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135073408 00000100:00100000:1.0:1788838178.000930:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135073408 00000100:00100000:2.0:1788838178.001036:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135073920:0@lo:400:kworker.0 00000100:00100000:2.0:1788838178.001052:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135074560:0@lo:400:kworker.0 00000020:01000000:2.0:1788838178.001130:0:91026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788838178.001160:0:91026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838178.001180:0:91026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.001192:0:91026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788838178.001251:0:91026:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788838178.001253:0:91026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838178.001255:0:91026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838178.001256:0:91026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838178.001258:0:91026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838178.001259:0:91026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838178.001260:0:91026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838178.001262:0:91026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838178.001264:0:91026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838178.001266:0:91026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838178.001271:0:91026:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788838178.001273:0:91026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788838178.001274:0:91026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838178.001276:0:91026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838178.001277:0:91026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838178.001278:0:91026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838178.001279:0:91026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838178.001280:0:91026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838178.001281:0:91026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:1.0:1788838178.001607:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135073664 00000100:00100000:1.0:1788838178.001613:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135073664 00000020:01000004:2.0:1788838178.001645:0:91026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838178.001652:0:91026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838178.001677:0:91026:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788838178.001693:0:91026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135074944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788838178.001758:0:91026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.001829:0:91026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b7fc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.001857:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135074944 00000100:00100000:2.0:1788838178.001860:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135074944 00000100:00100000:2.0:1788838178.001888:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788838178.001897:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91026:x1875729135074944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788838178.001927:0:91034:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788838178.001943:0:91034:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788838178.002078:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135073280:0@lo:38:kworker.0 00000100:00100000:2.0:1788838178.002114:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.002756:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135073280 00000100:00100000:3.0:1788838178.002764:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135073280 00000100:00100000:3.0:1788838178.002825:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1788838178.002840:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135073408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838178.002910:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135073408:12345-0@lo:400:kworker.0 Request processed in 77us (5039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.002917:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1788838178.002936:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1788838178.002942:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135073664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838178.002975:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135073664:12345-0@lo:400:kworker.0 Request processed in 32us (4958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.002981:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1788838178.002995:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1788838178.003000:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135073280:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788838178.003049:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135073280:12345-0@lo:38:kworker.0 Request processed in 47us (934us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788838178.003068:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1788838178.003260:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135074304 00000100:00100000:1.0:1788838178.003266:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135074304 00000100:00100000:1.0:1788838178.003428:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4123 00000100:00100000:1.0:1788838178.003438:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135074304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838178.003491:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135074304:12345-0@lo:400:kworker.0 Request processed in 56us (5550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.003497:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4123 00000100:00100000:2.0:1788838178.003694:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135073408:0@lo:400:kworker.0 00000100:00100000:2.0:1788838178.003717:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135074304:0@lo:400:kworker.0 00000100:00100000:2.0:1788838178.003776:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135073664:0@lo:400:kworker.0 00000100:00080000:2.0:1788838178.003852:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838178.003858:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788838178.003863:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135073280:0@lo:38:kworker.0 00000100:00100000:2.0:1788838178.003872:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135073536:0@lo:38:kworker.0 00000100:00100000:2.0:1788838178.003914:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.003942:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135073792:0@lo:38:kworker.0 00000100:00100000:2.0:1788838178.003968:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.003985:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135074176:0@lo:38:kworker.0 00000100:00100000:2.0:1788838178.004009:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.004047:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135073536 00000100:00100000:2.0:1788838178.004052:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135073536 00000100:00100000:2.0:1788838178.004074:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135074176 00000100:00100000:2.0:1788838178.004077:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135074176 00000100:00100000:3.0:1788838178.004421:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135073792 00000100:00100000:3.0:1788838178.004427:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135073792 00000100:00100000:3.0:1788838178.004459:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4124 00000100:00100000:3.0:1788838178.004465:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135073792:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788838178.004518:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135073792:12345-0@lo:38:kworker.0 Request processed in 53us (549us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788838178.004525:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4124 00000100:00100000:2.0:1788838178.006635:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1788838178.006649:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135073536:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788838178.006764:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135073536:12345-0@lo:38:kworker.0 Request processed in 116us (2850us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788838178.006772:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1788838178.006824:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:2.0:1788838178.006832:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135074176:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788838178.006875:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135074176:12345-0@lo:38:kworker.0 Request processed in 42us (2865us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788838178.006882:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00080000:2.0:1788838178.006966:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838178.006973:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788838178.006977:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135074176:0@lo:38:kworker.0 00000100:00080000:2.0:1788838178.007024:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838178.007029:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788838178.007033:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135073536:0@lo:38:kworker.0 00000100:00080000:2.0:1788838178.007045:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838178.007048:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788838178.007050:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135073792:0@lo:38:kworker.0 20000000:01000000:2.0:1788838178.016964:0:91034:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788838178.016996:0:91034:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788838178.017189:0:91035:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788838178.017196:0:91035:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788838178.017226:0:91035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.017250:0:91035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50712d000/0x88da08396ccc8fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8f9b expref: 11 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.017260:0:91035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.017317:0:91035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50712d000/0x88da08396ccc8fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc8f9b expref: 11 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.017333:0:91035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50712d000/0x88da08396ccc8fa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc8f9b expref: 11 pid: 91036 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838178.017349:0:91035:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:91035:1875729135075072:0@lo:104: 00000100:00100000:3.0:1788838178.017442:0:91035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838178.017575:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135075072 00000100:00100000:1.0:1788838178.017587:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135075072 00000100:00100000:1.0:1788838178.017659:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788838178.017670:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:91035:x1875729135075072:12345-0@lo:104: 00010000:00010000:1.0:1788838178.017686:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838178.018847:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:91026:x1875729135074944:12345-0@lo:253:mount.lustre.0 Request processed in 16943us (17081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.018887:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788838178.018982:0:91026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:91026:1875729135074944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788838178.019000:0:91026:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788838178.019004:0:91026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788838178.019006:0:91026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838178.019008:0:91026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838178.019009:0:91026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838178.019011:0:91026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838178.019013:0:91026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838178.019014:0:91026:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838178.019016:0:91026:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838178.019018:0:91026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838178.019020:0:91026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788838178.019041:0:91026:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788838178.025004:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788838178.025027:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:91035:x1875729135075072:12345-0@lo:104: Request processed in 7351us (7577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.025065:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:0.0:1788838178.025166:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838178.025184:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.025197:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788838178.025202:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.025213:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838178.025221:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838178.025228:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838178.025335:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.025342:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838178.025368:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.025375:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc8f9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc8fa2 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.025396:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838178.025398:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838178.025400:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838178.025420:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135075200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838178.025486:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.026051:0:91035:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504d83180 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.026103:0:91035:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:91035:1875729135075072:0@lo:104: 00010000:00010000:3.0:1788838178.026140:0:91035:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838178.028031:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135075200 00000100:00100000:1.0:1788838178.028050:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135075200 00010000:00010000:1.0:1788838178.028114:0:10364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50712d000/0x88da08396ccc8fa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc8f9b expref: 11 pid: 91036 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838178.028166:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:1.0:1788838178.028178:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+11:3643:x1875729135075200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838178.028197:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838178.028204:0:10364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50712d000/0x88da08396ccc8fa2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc8f9b expref: 11 pid: 91036 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028219:0:10364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50712d000/0x88da08396ccc8fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc8f9b expref: 11 pid: 91036 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028241:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712d000/0x88da08396ccc8fa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc8f9b expref: 11 pid: 91036 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028262:0:10364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028272:0:10364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788838178.028294:0:10364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011098087s 00010000:00010000:1.0:1788838178.028300:0:10364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028307:0:10364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028348:0:10364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028355:0:10364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028361:0:10364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148f800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838178.028366:0:10364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028376:0:10364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028395:0:10364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.028410:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838178.028514:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+10:3643:x1875729135075200:12345-0@lo:103:ldlm_bl.0 Request processed in 338us (3028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.028524:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:1.0:1788838178.028587:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135075200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838178.029415:0:91035:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.029432:0:91035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.029440:0:91035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148f800/0x88da08396ccc8fd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788838178.042384:0:91026:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:2.0:1788838178.042900:0:91026:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788838178.042914:0:91056:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:0.0:1788838178.042919:0:91056:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:2.0:1788838178.043553:0:91057:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788838178.043742:0:91026:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788838178.044340:0:91057:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788838178.045330:0:91058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91058:1875729135075328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838178.045445:0:91058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.045487:0:91058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3b40 going to sleep for 11 seconds 00000040:01000000:1.0:1788838178.045978:0:91026:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788838178.046028:0:91026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788838178.046846:0:91026:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788838178.046860:0:91026:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788838178.046918:0:91026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838178.048788:0:91026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788838178.050603:0:91057:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1788838178.051238:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135075328 00000100:00100000:0.0:1788838178.051253:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135075328 00000100:00100000:0.0:1788838178.051354:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4125 00000100:00100000:0.0:1788838178.051368:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91058:x1875729135075328:12345-0@lo:1000:lod0000_rec0001.0 00000004:00080000:2.0:1788838178.051451:0:91057:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788838178.051552:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91058:x1875729135075328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 187us (6107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838178.051562:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4125 00000100:00100000:0.0:1788838178.051630:0:91058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91058:1875729135075328:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788838178.051681:0:91058:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788838178.051740:0:91058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91058:1875729135075456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838178.051790:0:91058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.051850:0:91058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff604d1f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.051896:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135075456 00000100:00100000:2.0:1788838178.051903:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135075456 00000100:00100000:2.0:1788838178.051991:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4126 00000100:00100000:2.0:1788838178.052001:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91058:x1875729135075456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838178.052170:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91058:x1875729135075456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 170us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.052178:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4126 00000040:00080000:1.0:1788838178.053863:0:91026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788838178.053914:0:91026:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788838178.054089:0:91026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788838178.054870:0:91026:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00000100:00100000:2.0:1788838178.057499:0:91058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91058:1875729135075456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788838178.058457:0:91058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91058:1875729135075584:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788838178.058557:0:91058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.058605:0:91058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504d83780 going to sleep for 11 seconds 00000100:00100000:0.0:1788838178.058688:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135075584 00000100:00100000:0.0:1788838178.058698:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135075584 00000100:00100000:0.0:1788838178.058777:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4127 00000100:00100000:0.0:1788838178.058790:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91058:x1875729135075584:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788838178.058935:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91058:x1875729135075584:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 149us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838178.058944:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4127 00010000:00080000:1.0:1788838178.059027:0:91026:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149703 00000100:00100000:3.0:1788838178.059144:0:91058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91058:1875729135075584:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788838178.059221:0:91058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838178.062223:0:91058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788838178.062363:0:91058:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788838178.062370:0:91058:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1788838178.063560:0:91059:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 91059 00010000:02000000:1.0:1788838178.063630:0:91059:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788838178.063635:0:91059:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788838178.063640:0:91059:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788838178.064214:0:91026:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788838178.064239:0:91026:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788838178.064268:0:91026:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788838178.064490:0:91026:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788838178.065736:0:91026:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838178.066105:0:91026:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788838178.750253:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788838178.750264:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff640eee800 from 121 10000000:01000000:2.0:1788838178.750271:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788838178.750343:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.750356:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.750370:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838178.751422:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135075712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.751527:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.751593:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a3169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.752660:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135075712 00000100:00100000:1.0:1788838178.752676:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135075712 00000100:00100000:1.0:1788838178.752755:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788838178.752767:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:6544:x1875729135075712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838178.752788:0:91032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838178.752841:0:91032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712c200/0x88da08396ccc8fe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8fda expref: -99 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.752885:0:91032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712c200/0x88da08396ccc8fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8fda expref: 11 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.752900:0:91032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712c200/0x88da08396ccc8fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8fda expref: 11 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.752912:0:91032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c200, rc 0) 00000100:00100000:1.0:1788838178.752992:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135075712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.753022:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788838178.753500:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135075712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838178.753527:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.753540:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838178.753625:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135075840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.753673:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.753755:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff507149300 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.756692:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135075840 00000100:00100000:2.0:1788838178.756714:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135075840 00000100:00100000:2.0:1788838178.756899:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788838178.756911:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135075840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788838178.756948:0:91033:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788838178.756969:0:91033:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788838178.756973:0:91033:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 121 00000100:00100000:2.0:1788838178.757158:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135075840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 250us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.757176:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788838178.757205:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135075840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788838178.757295:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788838178.757310:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.757323:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838178.757336:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788838178.757340:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff503592800 from 52 10000000:01000000:1.0:1788838178.757343:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838178.757387:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c600/0x88da08396ccc8fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.757395:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712c600/0x88da08396ccc8fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.757406:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712c600/0x88da08396ccc8fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838178.757430:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135075968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.757471:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838178.760143:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff627125a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.763246:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135075968 00000100:00100000:3.0:1788838178.763264:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135075968 00000100:00100000:3.0:1788838178.763634:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788838178.763647:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135075968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838178.763672:0:91034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838178.763705:0:91034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e800/0x88da08396ccc8fef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8fe8 expref: -99 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.763742:0:91034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e800/0x88da08396ccc8fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8fe8 expref: 12 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.763757:0:91034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e800/0x88da08396ccc8fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8fe8 expref: 12 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.763768:0:91034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e800, rc 0) 00000100:00100000:3.0:1788838178.764255:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135075968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 607us (6779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.764265:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788838178.764721:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135075968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838178.764747:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712c600/0x88da08396ccc8fe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fef expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.764762:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712c600/0x88da08396ccc8fe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8fef expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838178.765419:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.765485:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.765529:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff507149a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.765555:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135076096 00000100:00100000:3.0:1788838178.765561:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135076096 00000100:00100000:3.0:1788838178.765603:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788838178.765612:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135076096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.765771:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135076096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.765786:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788838178.766980:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.767060:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.767135:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.767171:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff507149a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.767392:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135076224 00000100:00100000:2.0:1788838178.767401:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135076224 00000100:00100000:2.0:1788838178.767451:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788838178.767461:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135076224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.767591:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135076224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.767598:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788838178.767699:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838178.770415:0:91092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788838178.777053:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788838178.777108:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838178.777124:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c600/0x88da08396ccc8fe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fef expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.777154:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712c600/0x88da08396ccc8fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fef expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838178.777166:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788838178.777170:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff503592800 from 118 10000000:01000000:1.0:1788838178.777174:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788838178.777227:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc8ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.777236:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc8ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.777250:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc8ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838178.777284:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.777374:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838178.777440:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff627125840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.777978:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135076352 00000100:00100000:2.0:1788838178.777991:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135076352 00000100:00100000:2.0:1788838178.778064:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788838178.778076:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135076352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838178.778094:0:91033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838178.778113:0:91033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9000/0x88da08396ccc8ffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc8ff6 expref: -99 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.778146:0:91033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9000/0x88da08396ccc8ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc8ff6 expref: 13 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.778160:0:91033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9000/0x88da08396ccc8ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc8ff6 expref: 13 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.778171:0:91033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9000, rc 0) 00000100:00100000:2.0:1788838178.778242:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135076352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.778250:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788838178.778404:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838178.778424:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc8ff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ffd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.778435:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc8ff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8ffd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838178.778499:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.778540:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838178.778583:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff627125840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.778600:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135076480 00000100:00100000:1.0:1788838178.778604:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135076480 00000100:00100000:1.0:1788838178.778645:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788838178.778652:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135076480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788838178.779910:0:91036:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788838178.779954:0:91036:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788838178.779959:0:91036:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788838178.779962:0:91036:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788838178.779964:0:91036:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788838178.779967:0:91036:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 121 00000100:00100000:1.0:1788838178.780119:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135076480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1464us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.780130:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788838178.780868:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788838178.780997:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788838178.781011:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc8ff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ffd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.781025:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc8ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ffd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838178.781037:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788838178.781040:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1788838178.781044:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788838178.781089:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9c00/0x88da08396ccc9004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.781097:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9c00/0x88da08396ccc9004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.781123:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9c00/0x88da08396ccc9004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838178.781149:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.781201:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.781252:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a3169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.781495:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135076608 00000100:00100000:1.0:1788838178.781503:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135076608 00000100:00100000:1.0:1788838178.781557:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788838178.781567:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135076608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838178.781583:0:91033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838178.781598:0:91033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712cc00/0x88da08396ccc900b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9004 expref: -99 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.781625:0:91033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712cc00/0x88da08396ccc900b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9004 expref: 14 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.781636:0:91033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712cc00/0x88da08396ccc900b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9004 expref: 14 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.781646:0:91033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712cc00, rc 0) 00000100:00100000:1.0:1788838178.784006:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135076608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2426us (2790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.784029:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788838178.784338:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838178.784370:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9c00/0x88da08396ccc9004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc900b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.784386:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9c00/0x88da08396ccc9004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc900b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838178.784506:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.784556:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.784604:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a3169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.784898:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135076736 00000100:00100000:1.0:1788838178.784907:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135076736 00000100:00100000:1.0:1788838178.784959:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788838178.784970:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135076736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.785167:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135076736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.785175:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788838178.785905:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.785961:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.786018:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.786049:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a3169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.786069:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135076864 00000100:00100000:2.0:1788838178.786074:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135076864 00000100:00100000:2.0:1788838178.786109:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788838178.786117:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135076864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.787992:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135076864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1865us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.788006:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788838178.788271:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838178.798445:0:91094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788838178.798934:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788838178.798971:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788838178.798988:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9c00/0x88da08396ccc9004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc900b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.799001:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9c00/0x88da08396ccc9004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc900b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838178.799012:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788838178.799015:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff503592800 from 1 10000000:01000000:3.0:1788838178.799017:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788838178.799066:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.799075:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.799087:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838178.799119:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.799221:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.799278:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff507149a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.799906:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135076992 00000100:00100000:1.0:1788838178.799918:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135076992 00000100:00100000:1.0:1788838178.799989:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788838178.800000:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135076992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838178.800019:0:91036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838178.800039:0:91036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712c400/0x88da08396ccc9019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9012 expref: -99 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.800068:0:91036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712c400/0x88da08396ccc9019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9012 expref: 15 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.800079:0:91036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712c400/0x88da08396ccc9019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9012 expref: 15 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.800089:0:91036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c400, rc 0) 00000100:00100000:1.0:1788838178.800147:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135076992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.800165:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788838178.800240:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135076992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838178.800260:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9019 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.800271:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9019 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838178.800296:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788838178.800301:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9019 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.800308:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9019 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838178.800316:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788838178.800319:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff503592800 from 7 10000000:01000000:3.0:1788838178.800321:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838178.800342:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148fc00/0x88da08396ccc9020 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.800349:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148fc00/0x88da08396ccc9020 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.800357:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148fc00/0x88da08396ccc9020 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838178.800372:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.800414:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.800449:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff507149a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.800558:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135077120 00000100:00100000:1.0:1788838178.800563:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135077120 00000100:00100000:1.0:1788838178.800604:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788838178.800612:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135077120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838178.800621:0:91033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838178.800630:0:91033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712c000/0x88da08396ccc9027 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9020 expref: -99 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.800645:0:91033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712c000/0x88da08396ccc9027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9020 expref: 16 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.800653:0:91033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712c000/0x88da08396ccc9027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9020 expref: 16 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.800660:0:91033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c000, rc 0) 00000100:00100000:1.0:1788838178.802330:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135077120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1706us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.802344:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788838178.802919:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838178.802950:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148fc00/0x88da08396ccc9020 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9027 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.802964:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148fc00/0x88da08396ccc9020 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9027 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838178.803073:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.803135:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.803180:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036de540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.803917:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135077248 00000100:00100000:1.0:1788838178.803930:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135077248 00000100:00100000:1.0:1788838178.804003:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788838178.804013:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135077248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.804210:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135077248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.804219:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788838178.804282:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.804348:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.804398:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838178.807160:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d276c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838178.808231:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135077376 00000100:00100000:0.0:1788838178.808247:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135077376 00000100:00100000:2.0:1788838178.809994:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788838178.810016:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135077376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.810250:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135077376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (5851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.810259:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788838178.811683:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838178.812545:0:91098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788838178.812610:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788838178.812642:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788838178.812654:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148fc00/0x88da08396ccc9020 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9027 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.812667:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148fc00/0x88da08396ccc9020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9027 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838178.813099:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788838178.813102:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff63f7ce800 from 52 10000000:01000000:1.0:1788838178.813106:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838178.813153:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d800/0x88da08396ccc902e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.813162:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712d800/0x88da08396ccc902e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.813174:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712d800/0x88da08396ccc902e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838178.813205:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.813288:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838178.813373:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d27300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.813492:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135077504 00000100:00100000:3.0:1788838178.813502:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135077504 00000100:00100000:3.0:1788838178.813590:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788838178.813602:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135077504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838178.813619:0:91034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838178.813636:0:91034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148fe00/0x88da08396ccc9035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc902e expref: -99 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.813665:0:91034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148fe00/0x88da08396ccc9035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc902e expref: 17 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.814033:0:91034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148fe00/0x88da08396ccc9035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc902e expref: 17 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.814044:0:91034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148fe00, rc 0) 00000100:00100000:3.0:1788838178.814108:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135077504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 508us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.814116:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788838178.814202:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838178.814222:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712d800/0x88da08396ccc902e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9035 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.814232:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712d800/0x88da08396ccc902e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9035 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838178.814312:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.814345:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.814381:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6057570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.814427:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135077632 00000100:00100000:3.0:1788838178.814432:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135077632 00000100:00100000:3.0:1788838178.814470:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788838178.814478:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135077632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.814602:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135077632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.814609:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788838178.814878:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.814915:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.814960:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.814979:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6057570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.815221:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135077760 00000100:00100000:3.0:1788838178.815231:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135077760 00000100:00100000:3.0:1788838178.815272:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788838178.815280:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135077760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.815381:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135077760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.815389:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788838178.815491:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788838178.817241:0:91099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788838178.817559:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788838178.817594:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838178.817609:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d800/0x88da08396ccc902e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9035 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.817622:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712d800/0x88da08396ccc902e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9035 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838178.817632:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788838178.817635:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788838178.817638:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788838178.820010:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e000/0x88da08396ccc903c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.820033:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718e000/0x88da08396ccc903c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.820048:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718e000/0x88da08396ccc903c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838178.820083:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.820179:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.820257:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff605757900 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.820456:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135077888 00000100:00100000:1.0:1788838178.820469:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135077888 00000100:00100000:1.0:1788838178.820541:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788838178.820552:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135077888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838178.820570:0:91033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838178.820588:0:91033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712d000/0x88da08396ccc9043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc903c expref: -99 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.820617:0:91033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712d000/0x88da08396ccc9043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc903c expref: 18 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.820629:0:91033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712d000/0x88da08396ccc9043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc903c expref: 18 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.820639:0:91033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d000, rc 0) 00000100:00100000:1.0:1788838178.820701:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135077888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.820848:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788838178.821014:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135077888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838178.821035:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50718e000/0x88da08396ccc903c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9043 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.821047:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50718e000/0x88da08396ccc903c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9043 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838178.821146:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.821179:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.821210:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff605757900 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.821326:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135078016 00000100:00100000:1.0:1788838178.821332:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135078016 00000100:00100000:1.0:1788838178.821397:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788838178.821405:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135078016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.821586:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135078016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.821595:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788838178.821653:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.823393:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.823492:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.823542:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff507149000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.823584:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135078144 00000100:00100000:2.0:1788838178.823593:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135078144 00000100:00100000:2.0:1788838178.823656:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788838178.823667:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135078144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.825566:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135078144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1872us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.825581:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788838178.825989:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838178.828477:0:91101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788838178.829150:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788838178.829187:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788838178.829203:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e000/0x88da08396ccc903c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9043 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.829217:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50718e000/0x88da08396ccc903c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9043 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838178.829228:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788838178.829231:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff63f7ce800 from 7 10000000:01000000:3.0:1788838178.829235:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838178.829282:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc904a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.829290:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc904a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.829317:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc904a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838178.829347:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.829436:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.829487:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff507149b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.829557:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135078272 00000100:00100000:1.0:1788838178.829567:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135078272 00000100:00100000:1.0:1788838178.829634:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788838178.829644:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135078272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838178.829662:0:91034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838178.829690:0:91034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712d600/0x88da08396ccc9051 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc904a expref: -99 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.829725:0:91034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712d600/0x88da08396ccc9051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc904a expref: 19 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.829736:0:91034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712d600/0x88da08396ccc9051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc904a expref: 19 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.829746:0:91034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d600, rc 0) 00000100:00100000:1.0:1788838178.829829:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135078272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838178.829836:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788838178.834116:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838178.834156:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc904a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9051 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.834173:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc904a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9051 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838178.834294:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.834374:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.834449:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.834725:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135078400 00000100:00100000:3.0:1788838178.834734:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135078400 00000100:00100000:3.0:1788838178.834853:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788838178.834864:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135078400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.835050:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135078400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.835058:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788838178.835229:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.835272:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.835328:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.835361:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838178.835370:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135078528 00000100:00100000:0.0:1788838178.835375:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135078528 00000100:00100000:0.0:1788838178.835425:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788838178.835433:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135078528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.835535:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503eea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135078528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838178.835543:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788838178.835601:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838178.837565:0:91103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788838178.838198:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788838178.838232:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788838178.838247:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc904a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9051 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.838261:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc904a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9051 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838178.838273:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788838178.838276:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627f9a800 from 52 10000000:01000000:3.0:1788838178.838280:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788838178.838328:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148e600/0x88da08396ccc9058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.838336:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148e600/0x88da08396ccc9058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.838356:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148e600/0x88da08396ccc9058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838178.838383:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.838467:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.838521:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff507149f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.838604:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135078656 00000100:00100000:2.0:1788838178.838613:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135078656 00000100:00100000:2.0:1788838178.838676:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788838178.838686:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503eeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135078656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838178.838702:0:91033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838178.838718:0:91033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8c00/0x88da08396ccc905f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9058 expref: -99 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.838745:0:91033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8c00/0x88da08396ccc905f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9058 expref: 20 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.838756:0:91033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8c00/0x88da08396ccc905f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9058 expref: 20 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.838766:0:91033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8c00, rc 0) 00000100:00100000:2.0:1788838178.838871:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503eeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135078656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.838879:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788838178.838927:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838178.838942:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148e600/0x88da08396ccc9058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc905f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.838953:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148e600/0x88da08396ccc9058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc905f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838178.839027:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.839053:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.839072:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.842515:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135078784 00000100:00100000:3.0:1788838178.842536:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135078784 00000100:00100000:3.0:1788838178.842630:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788838178.842644:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135078784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.842937:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503ee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135078784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (3881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.842946:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788838178.843525:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.843596:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.843656:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838178.843707:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.847860:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135078912 00000100:00100000:3.0:1788838178.847884:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135078912 00000100:00100000:3.0:1788838178.847964:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788838178.847977:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50594b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135078912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.848212:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50594b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135078912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (4554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.848222:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788838178.848411:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135078912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838178.851270:0:91104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788838178.851476:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788838178.851528:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838178.851543:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148e600/0x88da08396ccc9058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc905f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.851557:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148e600/0x88da08396ccc9058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc905f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838178.851569:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788838178.851573:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788838178.851576:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788838178.851626:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396ccc9066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.851634:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396ccc9066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.851648:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396ccc9066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838178.851681:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.851769:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.851852:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135079040 00000100:00100000:3.0:1788838178.851862:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135079040 00000100:00100000:3.0:1788838178.851921:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788838178.851931:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135079040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838178.851948:0:91036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838178.851972:0:91036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4a00/0x88da08396ccc906d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9066 expref: -99 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.852018:0:91036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4a00/0x88da08396ccc906d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9066 expref: 21 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.852031:0:91036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4a00/0x88da08396ccc906d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9066 expref: 21 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.852042:0:91036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4a00, rc 0) 00000100:00100000:3.0:1788838178.852082:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505949050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135079040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.852089:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788838178.852449:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503e6a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788838178.852478:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838178.852497:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396ccc9066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc906d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838178.852506:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396ccc9066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc906d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838178.852596:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.852626:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838178.852654:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503e6a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.852934:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135079168 00000100:00100000:3.0:1788838178.852941:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135079168 00000100:00100000:3.0:1788838178.852979:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788838178.852998:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50594bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135079168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.853173:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50594bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135079168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.853180:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788838178.853633:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.853680:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838178.853733:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838178.853767:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503e6a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.854646:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135079296 00000100:00100000:3.0:1788838178.854658:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135079296 00000100:00100000:3.0:1788838178.854735:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788838178.854746:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50594b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135079296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.858896:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50594b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135079296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4136us (5146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.858917:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788838178.859503:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838178.861080:0:91106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788838178.861303:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788838178.861341:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788838178.861357:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396ccc9066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc906d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.861371:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396ccc9066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc906d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838178.861382:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788838178.861385:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff627f9a800 from 7 10000000:01000000:0.0:1788838178.861397:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788838178.861446:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f800/0x88da08396ccc9074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.861455:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718f800/0x88da08396ccc9074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.861468:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718f800/0x88da08396ccc9074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838178.861499:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.861582:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.861647:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6057570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.861853:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135079424 00000100:00100000:2.0:1788838178.861873:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135079424 00000100:00100000:2.0:1788838178.861946:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788838178.861958:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135079424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838178.861977:0:91033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838178.861995:0:91033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc907b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9074 expref: -99 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.862026:0:91033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc907b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9074 expref: 22 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.862038:0:91033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc907b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9074 expref: 22 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838178.862049:0:91033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8a00, rc 0) 00000100:00100000:2.0:1788838178.862120:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135079424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.862127:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788838178.862198:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838178.862216:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50718f800/0x88da08396ccc9074 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc907b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.862227:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50718f800/0x88da08396ccc9074 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc907b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838178.862300:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.862335:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.862365:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6057570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.863042:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135079552 00000100:00100000:2.0:1788838178.863050:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135079552 00000100:00100000:2.0:1788838178.863096:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788838178.863105:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135079552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.863272:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505948450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135079552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.863280:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788838178.864164:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.864247:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.864325:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.864383:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6057570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838178.864541:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135079680 00000100:00100000:2.0:1788838178.864549:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135079680 00000100:00100000:2.0:1788838178.864602:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788838178.864611:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135079680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838178.864730:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505948850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135079680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838178.864739:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788838178.865018:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838178.866731:0:91107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788838178.866877:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788838178.866909:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838178.866926:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f800/0x88da08396ccc9074 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc907b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.866940:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50718f800/0x88da08396ccc9074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc907b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838178.866951:0:6544:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788838178.866954:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ff610244d28 from 1 10000000:01000000:0.0:1788838178.866957:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788838178.867010:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e800/0x88da08396ccc9082 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.867018:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718e800/0x88da08396ccc9082 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.867029:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718e800/0x88da08396ccc9082 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838178.867056:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.867141:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.867180:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6057570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.867253:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135079808 00000100:00100000:3.0:1788838178.867273:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135079808 00000100:00100000:3.0:1788838178.867335:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788838178.867345:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50594ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135079808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838178.867361:0:91036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838178.867379:0:91036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9089 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9082 expref: -99 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.867406:0:91036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9089 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9082 expref: 23 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.867419:0:91036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9089 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9082 expref: 23 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.867430:0:91036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4000, rc 0) 00000100:00100000:3.0:1788838178.867472:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50594ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135079808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.867478:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788838178.867603:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838178.867619:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50718e800/0x88da08396ccc9082 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9089 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.867630:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50718e800/0x88da08396ccc9082 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9089 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838178.868039:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788838178.868045:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e800/0x88da08396ccc9082 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9089 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.868052:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50718e800/0x88da08396ccc9082 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9089 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838178.868059:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788838178.868061:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ff610244d28 from 1 10000000:01000000:0.0:1788838178.868063:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788838178.868084:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f000/0x88da08396ccc9090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.868090:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718f000/0x88da08396ccc9090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838178.868098:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718f000/0x88da08396ccc9090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838178.868112:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838178.868147:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838178.868241:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6057570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.874156:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135079936 00000100:00100000:3.0:1788838178.874177:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135079936 00000100:00100000:3.0:1788838178.874249:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788838178.874262:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135079936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838178.874285:0:91032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838178.874311:0:91032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc9097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9090 expref: -99 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.874347:0:91032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc9097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9090 expref: 24 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.874361:0:91032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc9097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9090 expref: 24 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.874379:0:91032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4400, rc 0) 00000100:00100000:3.0:1788838178.874481:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135079936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (6332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838178.874489:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788838178.874567:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135079936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838178.874590:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50718f000/0x88da08396ccc9090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9097 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.874601:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50718f000/0x88da08396ccc9090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9097 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838178.876951:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135080064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.877126:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838178.877185:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50379bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838178.877243:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135080064 00000100:00100000:3.0:1788838178.877251:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135080064 00000100:00100000:3.0:1788838178.877309:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788838178.877319:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62cb8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135080064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838178.877435:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62cb8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135080064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (309us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788838178.877444:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788838178.877500:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135080064:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788838178.877555:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788838178.877568:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f000/0x88da08396ccc9090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9097 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.877587:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50718f000/0x88da08396ccc9090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9097 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838178.878285:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838179.068419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838179.070898:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116425728 00000100:00100000:2.0:1788838179.070918:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116425728 00000100:00100000:2.0:1788838179.071787:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:2.0:1788838179.071864:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6049b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+5:42411:x1875729116425728:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838179.071891:0:91032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838179.071915:0:91032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9600/0x88da08396ccc909e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd4e expref: -99 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838179.071954:0:91032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9600/0x88da08396ccc909e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd4e expref: 6 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838179.071977:0:91032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9600/0x88da08396ccc909e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd4e expref: 6 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838179.071989:0:91032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9600, rc 0) 00000100:00100000:2.0:1788838179.072073:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6049b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116425728:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 274us (3671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838179.072081:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:1.0:1788838179.083487:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838179.083559:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116425856 00000100:00100000:3.0:1788838179.083572:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116425856 00000100:00100000:3.0:1788838179.086924:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1788838179.086954:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116425856:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788838179.086993:0:91036:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788838179.087016:0:91036:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788838179.087021:0:91036:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788838179.087024:0:91036:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788838179.087028:0:91036:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788838179.087030:0:91036:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 121 00000100:00100000:3.0:1788838179.093770:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116425856:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 Request processed in 6812us (10277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838179.093789:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1788838179.102535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838179.102584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838179.105077:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116425984 00000100:00100000:1.0:1788838179.105096:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116425984 00000100:00100000:1.0:1788838179.105160:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1272 00000100:00100000:1.0:1788838179.105169:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116425984:12345-192.168.203.30@tcp:38:ll_cfg_requeue.0 00010000:00080000:1.0:1788838179.105211:0:75504:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'fdcf066d-ff07-4b2e-96ab-52415ed6bf72' at ffff8ff6048e2000, cookie 0x88da08396ccc8f24 00010000:00080000:1.0:1788838179.105217:0:75504:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp recovering/t111669149704 exp ffff8ff6048e2000 cur 3573 last 1788838177 00010000:02000400:1.0:1788838179.105227:0:75504:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:3.0:1788838179.108201:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116426112 00000100:00100000:3.0:1788838179.108220:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116426112 00000100:00100000:3.0:1788838179.108298:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1788838179.108309:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+6:42411:x1875729116426112:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838179.108331:0:91033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838179.108354:0:91033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc90a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd55 expref: -99 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838179.108389:0:91033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc90a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd55 expref: 7 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838179.108416:0:91033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc90a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd55 expref: 7 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838179.108427:0:91033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4e00, rc 0) 00000100:00100000:3.0:1788838179.108511:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+7:42411:x1875729116426112:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 204us (5991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838179.108519:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00010000:00080000:1.0:1788838179.125480:0:75504:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1788838179.125736:0:75504:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788838179.125970:0:75504:0:(import.c:65:import_set_state_nolock()) ffff8ff632f54000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838179.126073:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116425984:12345-192.168.203.30@tcp:38:ll_cfg_requeue.0 Request processed in 20902us (23487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838179.126086:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1272 00000100:00100000:1.0:1788838179.130961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838179.131120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838179.131168:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116426240 00000100:00100000:1.0:1788838179.131181:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116426240 00000100:00100000:1.0:1788838179.131246:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:1.0:1788838179.131258:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+7:42411:x1875729116426240:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838179.131466:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116426240:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 210us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838179.131475:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:0.0:1788838179.134420:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116415616 00000100:00100000:0.0:1788838179.134441:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116415616 00000100:00100000:0.0:1788838179.134522:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1273 00000100:00100000:0.0:1788838179.134535:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116415616:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00080000:0.0:1788838179.134565:0:76060:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 111669149704, current: 111669149704, replaying 00000100:00100000:0.0:1788838179.137199:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116415616:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 2651us (6234us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838179.137230:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1273 00010000:00080000:1.0:1788838179.138514:0:91059:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1788838179.144159:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838179.144767:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116426368 00000100:00100000:3.0:1788838179.144782:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116426368 00000100:00100000:3.0:1788838179.144995:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:3.0:1788838179.145006:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116426368:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838179.145214:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116426368:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 208us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838179.145223:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:1.0:1788838179.154303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838179.154614:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116426496 00000100:00100000:2.0:1788838179.154629:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116426496 00000100:00100000:2.0:1788838179.154750:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:2.0:1788838179.154763:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+8:42411:x1875729116426496:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838179.154788:0:91034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838179.154848:0:91034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8000/0x88da08396ccc90ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd5c expref: -99 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838179.154890:0:91034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8000/0x88da08396ccc90ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd5c expref: 9 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838179.154904:0:91034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8000/0x88da08396ccc90ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd5c expref: 9 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838179.154916:0:91034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8000, rc 0) 00000100:00100000:2.0:1788838179.155009:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116426496:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 247us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838179.155038:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:1.0:1788838179.176319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838179.176495:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116426624 00000100:00100000:3.0:1788838179.176509:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116426624 00000100:00100000:3.0:1788838179.176585:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:3.0:1788838179.176599:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116426624:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838179.176991:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116426624:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 391us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838179.177001:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:3.0:1788838179.179030:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838179.179672:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116426752 00000100:00100000:1.0:1788838179.179686:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116426752 00000100:00100000:1.0:1788838179.179767:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:1.0:1788838179.179937:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116426752:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838179.180155:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116426752:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 224us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838179.184022:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:1.0:1788838179.195610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838179.195972:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116426880 00000100:00100000:2.0:1788838179.195987:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116426880 00000100:00100000:2.0:1788838179.196102:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:2.0:1788838179.196115:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+9:42411:x1875729116426880:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838179.196139:0:91032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838179.196164:0:91032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc90b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd63 expref: -99 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838179.196203:0:91032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc90b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd63 expref: 10 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838179.196217:0:91032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc90b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd63 expref: 10 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838179.196229:0:91032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8200, rc 0) 00000100:00100000:2.0:1788838179.196320:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116426880:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 207us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838179.196328:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:3.0:1788838179.198200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838179.198305:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116427008 00000100:00100000:2.0:1788838179.198318:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116427008 00000100:00100000:2.0:1788838179.198386:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:2.0:1788838179.198398:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116427008:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838179.198588:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4043f878-3455-4729-a2a8-e06e8394cc00+10:42411:x1875729116427008:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 191us (400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788838179.198598:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00010000:00010000:3.0:1788838179.901005:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838180.223539:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135080192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838180.223613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838180.223730:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135080320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838180.223760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838180.223833:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135080192 00000100:00100000:1.0:1788838180.223842:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135080192 00000100:00100000:1.0:1788838180.223895:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135080320 00000100:00100000:1.0:1788838180.223898:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135080320 00000100:00100000:1.0:1788838180.223917:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1788838180.223926:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135080192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838180.223965:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838180.225172:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1788838180.225189:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135080320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838180.225217:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838180.225278:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135080320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838180.225286:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00080000:2.0:1788838180.225310:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838180.225315:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838180.225788:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135080192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1862us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838180.225819:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1788838180.225873:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135080320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838180.226886:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135080192:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788838180.924959:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838181.952055:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788838182.177577:0:91310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788838182.461291:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838182.461348:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838182.461382:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838182.461409:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838182.461448:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116427520 00000100:00100000:1.0:1788838182.461457:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116427520 00000100:00100000:1.0:1788838182.461510:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116427392 00000100:00100000:1.0:1788838182.461514:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116427392 00000100:00100000:1.0:1788838182.461542:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2598 00000100:00100000:1.0:1788838182.461552:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116427520:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838182.461622:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116427520:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838182.461631:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2598 00000100:00100000:1.0:1788838182.461647:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2599 00000100:00100000:1.0:1788838182.461653:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116427392:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838182.461677:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116427392:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838182.461684:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2599 00000100:00080000:1.0:1788838182.461703:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838182.461714:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838182.462279:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116427264 00000100:00100000:2.0:1788838182.462286:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116427264 00000100:00100000:2.0:1788838182.462459:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1276 00000100:00100000:2.0:1788838182.462470:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116427264:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838182.462516:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116427264:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 49us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838182.462522:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1276 00000100:00080000:1.0:1788838182.462600:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838182.462957:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116427136 00000100:00100000:3.0:1788838182.462964:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116427136 00000100:00100000:3.0:1788838182.463013:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:3.0:1788838182.463023:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116427136:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838182.463065:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116427136:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 44us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838182.463073:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00010000:00010000:3.0:1788838182.973543:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788838183.099081:0:91362:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838183.099525:0:91362:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788838183.293074:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838183.293099:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135080448:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788838183.293152:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838183.293158:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838183.293162:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838183.293173:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838183.293174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838183.293202:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5059a9c00 x1875729135080704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838183.293232:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838183.293236:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838183.293237:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788838183.293241:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135080448 00000100:00080000:2.0:1788838183.293243:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838183.293261:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135080448 00000100:00100000:2.0:1788838183.293273:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6270bdc00 x1875729135080960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838183.293305:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838183.293309:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1788838183.293313:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4128 00000100:00080000:2.0:1788838183.293313:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838183.293322:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838183.293327:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135080448:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838183.293337:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff505932d80 x1875729135081216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00000024:3.0:1788838183.293361:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00080000:2.0:1788838183.293379:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838183.293384:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838183.293386:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838183.293392:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838183.293406:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135080448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838183.293407:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61fcd2d80 x1875729135081600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838183.293423:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4128 00000100:00100000:3.0:1788838183.293454:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135081088:0@lo:400:kworker.0 00000100:00080000:2.0:1788838183.293461:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788838183.293465:0:86008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838183.293466:0:86008:0:(import.c:65:import_set_state_nolock()) ffff8ff610292800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838183.293472:0:86008:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff610292800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838183.293488:0:86008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61fcd2a00 x1875729135081984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838183.293489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838183.293517:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135080704:0@lo:38:kworker.0 00000100:00100000:3.0:1788838183.293536:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135080448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838183.293551:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838183.293562:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135081856:0@lo:400:kworker.0 00000100:00100000:2.0:1788838183.293576:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135080960:0@lo:38:kworker.0 00000100:00100000:3.0:1788838183.293597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838183.293608:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838183.293622:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838183.293639:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135081344:0@lo:400:kworker.0 00000100:00100000:2.0:1788838183.293652:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135081216:0@lo:38:kworker.0 00000100:00100000:3.0:1788838183.293672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838183.293686:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838183.293705:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135081600:0@lo:38:kworker.0 00000100:00100000:3.0:1788838183.293719:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135081088 00000100:00100000:3.0:1788838183.293724:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135081088 00000100:00100000:2.0:1788838183.293736:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838183.293755:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135081984:0@lo:38:kworker.0 00000100:00100000:3.0:1788838183.293764:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135080704 00000100:00100000:3.0:1788838183.293777:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135080704 00000100:00100000:2.0:1788838183.293789:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838183.293820:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135080960 00000100:00100000:3.0:1788838183.293825:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135080960 00000100:00100000:3.0:1788838183.293838:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135081600 00000100:00100000:3.0:1788838183.293840:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135081600 00000100:00100000:3.0:1788838183.293847:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135081984 00000100:00100000:3.0:1788838183.293849:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135081984 00000100:00100000:3.0:1788838183.293859:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1788838183.293870:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135081088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.293979:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135080832:0@lo:400:kworker.0 00000100:00100000:2.0:1788838183.294005:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1788838183.294011:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135080704:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788838183.294020:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788838183.294037:0:67312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3577 last 0 00000100:00100000:0.0:1788838183.294039:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135081728:0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.294078:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788838183.294087:0:67312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88da08396ccc90ba 00000004:00100000:2.0:1788838183.294107:0:67312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788838183.294122:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788838183.294130:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135080576:0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.294164:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838183.294196:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135081472:0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.294224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838183.294268:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135081216 00000100:00100000:0.0:1788838183.294272:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135081216 00000100:00080000:2.0:1788838183.294281:0:67312:0:(import.c:65:import_set_state_nolock()) ffff8ff5052d1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838183.294296:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4129 00000100:00100000:0.0:1788838183.294302:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135081216:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788838183.294320:0:8472:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8ff6048e4800, cookie 0x88da08396ccc8f2b 00010000:00080000:0.0:1788838183.294326:0:8472:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378651 exp ffff8ff6048e4800 cur 3577 last 1788838177 00000100:00100000:2.0:1788838183.294332:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875729135080704:12345-0@lo:38:kworker.0 Request processed in 316us (778us total) trans 0 rc 0/0 00000004:00100000:0.0:1788838183.294340:0:8472:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788838183.294344:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1788838183.294363:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135080832 00000100:00080000:0.0:1788838183.294364:0:8472:0:(import.c:65:import_set_state_nolock()) ffff8ff627d19000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838183.294368:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135080832 00000100:00100000:2.0:1788838183.294396:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1788838183.294404:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135080832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.294412:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135081216:12345-0@lo:38:kworker.0 Request processed in 107us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.294428:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4129 00000100:00100000:2.0:1788838183.294450:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135080832:12345-0@lo:400:kworker.0 Request processed in 47us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.294456:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1788838183.294462:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135080960:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788838183.294476:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3577 last 0 00000020:00000080:0.0:1788838183.294499:0:76060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88da08396ccc90c1 00000004:00100000:0.0:1788838183.294508:0:76060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788838183.294526:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff627d1d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838183.294544:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1788838183.294563:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875729135080960:12345-0@lo:38:kworker.0 Request processed in 97us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838183.294567:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1788838183.294575:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135081600:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788838183.294578:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00010000:00080000:2.0:1788838183.294594:0:67312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3577 last 0 00000100:00100000:0.0:1788838183.294602:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:0.0:1788838183.294610:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135081984:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788838183.294627:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3577 last 0 00000020:00000080:2.0:1788838183.294648:0:67312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x88da08396ccc90c8 00000020:00000080:0.0:1788838183.294653:0:76060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88da08396ccc90cf 00000004:00100000:2.0:1788838183.294657:0:67312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00100000:0.0:1788838183.294663:0:76060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788838183.294677:0:67312:0:(import.c:65:import_set_state_nolock()) ffff8ff5052d7800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788838183.294685:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff627d1b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838183.294714:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875729135081600:12345-0@lo:38:kworker.0 Request processed in 137us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838183.294721:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1788838183.294742:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729135081984:12345-0@lo:38:kworker.0 Request processed in 129us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.294750:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00010000:00080000:2.0:1788838183.294762:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff5059a9c00 x1875729135080704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838183.294786:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00100000:0.0:1788838183.294789:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135081856 00000100:00100000:0.0:1788838183.294794:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135081856 00000100:00100000:0.0:1788838183.294844:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135081344 00000100:00100000:0.0:1788838183.294847:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135081344 00000100:00100000:0.0:1788838183.294867:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135081728 00000100:00100000:0.0:1788838183.294869:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135081728 00000100:00100000:0.0:1788838183.294887:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135081472 00000100:00100000:0.0:1788838183.294896:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135081472 00000100:00100000:0.0:1788838183.294923:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1788838183.294930:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135081856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.294970:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135081856:12345-0@lo:400:kworker.0 Request processed in 41us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.294976:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1788838183.294988:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1788838183.294994:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135081344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.295038:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135081344:12345-0@lo:400:kworker.0 Request processed in 44us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.295045:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:0.0:1788838183.295056:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:0.0:1788838183.295061:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135081728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.295085:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135081728:12345-0@lo:400:kworker.0 Request processed in 24us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.295089:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:0.0:1788838183.295099:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:0.0:1788838183.295105:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135081472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.295127:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135081472:12345-0@lo:400:kworker.0 Request processed in 23us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.295132:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:0.0:1788838183.295151:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135080576 00000100:00100000:0.0:1788838183.295155:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135080576 00000100:00100000:0.0:1788838183.295181:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788838183.295188:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135080576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.295218:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135080576:12345-0@lo:400:kworker.0 Request processed in 32us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.295230:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788838183.295274:0:91059:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788838183.295280:0:91059:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 111669149704 00000020:00080000:0.0:1788838183.295284:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838183.295287:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 111669149704, next_transno: 111669149704 00010000:00080000:0.0:1788838183.295290:0:91059:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (111669149704) 00000020:00080000:0.0:1788838183.295293:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838183.295301:0:91059:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116415616 t111669149704 from 192.168.203.30@tcp req@ffff8ff5071caa00 x1875729116415616/t0(111669149704) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:80/0 lens 528/0 e 0 to 0 dl 1788838190 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838183.295384:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135080576:0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.295397:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135081472:0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.295410:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135080832:0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.295420:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135081728:0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.295468:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135081344:0@lo:400:kworker.0 00000100:00100000:0.0:1788838183.295485:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135081856:0@lo:400:kworker.0 00000100:00100000:3.0:1788838183.295506:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135081088:12345-0@lo:400:kworker.0 Request processed in 1637us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.295506:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135081088:0@lo:400:kworker.0 00000100:00100000:3.0:1788838183.295521:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00080000:2.0:1788838183.295598:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8ff5059a9c00 x1875729135080704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838208 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838183.295606:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788838183.295611:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788838183.295614:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788838183.295619:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135080704:0@lo:38:kworker.0 00010000:00080000:2.0:1788838183.295635:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff6270bdc00 x1875729135080960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838183.295645:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00080000:2.0:1788838183.296456:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8ff6270bdc00 x1875729135080960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838208 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838183.296464:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788838183.296466:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788838183.296468:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788838183.296471:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135080960:0@lo:38:kworker.0 00000100:00080000:2.0:1788838183.296502:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:2.0:1788838183.296509:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788838183.296511:0:3642:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788838183.296513:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345921 gen 3 00000100:00080000:2.0:1788838183.296516:0:3642:0:(recover.c:53:ptlrpc_replay_next()) import ffff8ff6061da800 from lustre-MDT0000_UUID committed 85899345921 last 0 00000100:00080000:2.0:1788838183.296518:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00080000:1.0:1788838183.296909:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838183.296914:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838183.296917:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838183.297100:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135081216:0@lo:38:kworker.0 00010000:00080000:2.0:1788838183.297120:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff61fcd2d80 x1875729135081600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788838183.297127:0:91376:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1788838183.297130:0:91376:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00000100:00080000:2.0:1788838183.297132:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00010000:00010000:1.0:1788838183.297135:0:91376:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1788838183.297878:0:91376:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:2.0:1788838183.299046:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8ff61fcd2d80 x1875729135081600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838208 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838183.299058:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788838183.299064:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788838183.299069:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788838183.299075:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135081600:0@lo:38:kworker.0 00010000:00080000:2.0:1788838183.299108:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff61fcd2a00 x1875729135081984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838183.299123:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:2.0:1788838183.299131:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788838183.299136:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788838183.299138:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff610292800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788838183.299142:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135081984:0@lo:38:kworker.0 00000004:00080000:0.0:1788838183.301432:0:91059:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6086us 00000100:00100000:2.0:1788838183.302287:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135082112:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788838183.302361:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838183.305570:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135082112 00000100:00100000:0.0:1788838183.305585:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135082112 00000100:00100000:0.0:1788838183.305644:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4130 00000100:00100000:0.0:1788838183.305654:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135082112:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788838183.305674:0:37907:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff61fcd2a00 x1875729135082112/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:84/0 lens 224/0 e 0 to 0 dl 1788838194 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838183.305693:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135082112:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 41us (3332us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838183.305700:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4130 00010000:00010000:3.0:1788838183.318685:0:91059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.318709:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.318724:0:91059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.318736:0:91059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.318743:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.318763:0:91059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.319176:0:91059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.319185:0:91059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.319193:0:91059:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.319199:0:91059:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838183.319656:0:91059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.319666:0:91059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.319680:0:91059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2500) 00010000:00010000:3.0:1788838183.319682:0:91059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838183.319687:0:91059:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.319694:0:91059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838183.319721:0:91059:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3179f95 reply state 000000008edac288 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.319731:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.319745:0:91059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff6055e2300) 00010000:00010000:3.0:1788838183.319747:0:91059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838183.319750:0:91059:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788838183.319905:0:91059:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788838183.319930:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838183.319933:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000020:00080000:3.0:1788838183.319937:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838183.319939:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000100:00100000:0.0:1788838183.323008:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838183.324894:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116416128 00000001:00080000:0.0:1788838183.324905:0:91027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149704 is committed 00000100:00100000:2.0:1788838183.324908:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116416128 00010000:00010000:3.0:1788838183.325022:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325034:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325042:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325047:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838183.325052:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325060:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325076:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff6055e2300) 00010000:00010000:3.0:1788838183.325079:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838183.325084:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325090:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc90dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838183.325168:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1278 00000100:00100000:2.0:1788838183.325179:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116416128:12345-192.168.203.30@tcp:36:rm.0 00010000:00080000:2.0:1788838183.325198:0:67312:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 111669149705, current: 111669149705, replaying 00000100:00100000:2.0:1788838183.325255:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116416128:12345-192.168.203.30@tcp:36:rm.0 Request processed in 78us (2257us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838183.325262:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1278 00000020:00080000:3.0:1788838183.325342:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838183.325346:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149705, next_transno: 111669149705 00010000:00080000:3.0:1788838183.325351:0:91059:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (111669149705) 00000020:00080000:3.0:1788838183.325354:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838183.325363:0:91059:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116416128 t111669149705 from 192.168.203.30@tcp req@ffff8ff50f38f800 x1875729116416128/t0(111669149705) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:84/0 lens 512/0 e 0 to 0 dl 1788838194 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788838183.325443:0:91059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325458:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325469:0:91059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325479:0:91059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325486:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325492:0:91059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325579:0:91059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc90f2 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325587:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc90f2 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325604:0:91059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc90f2 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325857:0:91059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc90f2 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325865:0:91059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc90f2 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325870:0:91059:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc90f2 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325875:0:91059:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838183.325878:0:91059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc90f2 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325884:0:91059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc90f2 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325893:0:91059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff8ff6055e2c00) 00010000:00010000:3.0:1788838183.325895:0:91059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788838183.325899:0:91059:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc90f2 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325904:0:91059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc90f2 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325926:0:91059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325933:0:91059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90e4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325946:0:91059:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325951:0:91059:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838183.325953:0:91059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325960:0:91059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325968:0:91059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2500) 00010000:00010000:3.0:1788838183.325970:0:91059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838183.325973:0:91059:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90e4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.325979:0:91059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc90e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838183.325993:0:91059:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe4f3b74 reply state 000000000ea15f12 transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.326003:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.326009:0:91059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff6055e2600) 00010000:00010000:3.0:1788838183.326011:0:91059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838183.326014:0:91059:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788838183.326094:0:91059:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788838183.326109:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838183.326112:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000020:00080000:3.0:1788838183.326120:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838183.326122:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000100:00100000:2.0:1788838183.329083:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838183.329329:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116417536 00000100:00100000:3.0:1788838183.329340:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116417536 00000100:00100000:3.0:1788838183.329397:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1279 00000100:00100000:3.0:1788838183.330855:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2403:x1875729116417536:12345-192.168.203.30@tcp:36:dd.0 00010000:00080000:3.0:1788838183.330878:0:66254:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 111669149706, current: 111669149708, replaying 00000100:00100000:3.0:1788838183.330893:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2403:x1875729116417536:12345-192.168.203.30@tcp:36:dd.0 Request processed in 1487us (1817us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838183.330902:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1279 00000020:00080000:3.0:1788838183.330931:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838183.330934:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149708, next_transno: 111669149706 00010000:00080000:3.0:1788838183.330939:0:91059:0:(ldlm_lib.c:2284:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 111669149706, ql: 1, comp: 1, conn: 2, next: 111669149708, next_update 0 last_committed: 111669149704) 00000020:00080000:3.0:1788838183.330944:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838183.330953:0:91059:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116417536 t111669149708 from 192.168.203.30@tcp req@ffff8ff61fcd2d80 x1875729116417536/t0(111669149708) o36->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:84/0 lens 488/0 e 0 to 0 dl 1788838194 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788838183.331287:0:91059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.331304:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.331315:0:91059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788838183.331363:0:91059:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149708 00000004:00010000:3.0:1788838183.331384:0:91059:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b42bf3b6 reply state 00000000a22feb88 transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.331409:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.331417:0:91059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff6055e2400) 00010000:00010000:3.0:1788838183.331419:0:91059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838183.331423:0:91059:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788838183.331538:0:91059:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788838183.331545:0:91059:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:3.0:1788838183.331557:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838183.331560:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000020:00080000:3.0:1788838183.331563:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838183.331566:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000100:00100000:2.0:1788838183.336843:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838183.336997:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116417920 00000100:00100000:3.0:1788838183.337008:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116417920 00000100:00100000:3.0:1788838183.337071:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1280 00000100:00100000:3.0:1788838183.337081:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2403:x1875729116417920:12345-192.168.203.30@tcp:101:dd.0 00010000:00080000:3.0:1788838183.337103:0:75504:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 111669149709, current: 111669149709, replaying 00000100:00100000:3.0:1788838183.337125:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2403:x1875729116417920:12345-192.168.203.30@tcp:101:dd.0 Request processed in 46us (294us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838183.337132:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1280 00000020:00080000:2.0:1788838183.337138:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838183.337143:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149709, next_transno: 111669149709 00010000:00080000:2.0:1788838183.337148:0:91059:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (111669149709) 00000020:00080000:2.0:1788838183.337151:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838183.337161:0:91059:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116417920 t111669149709 from 192.168.203.30@tcp req@ffff8ff61fcd2300 x1875729116417920/t0(111669149709) o101->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:84/0 lens 640/0 e 0 to 0 dl 1788838194 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788838183.337184:0:91059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838183.337210:0:91059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9100 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd1d expref: -99 pid: 91059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.337273:0:91059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9107 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.337288:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9107 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.337300:0:91059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9107 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838183.337434:0:91059:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0xb1:0x0], count =625 00000004:00080000:2.0:1788838183.337439:0:91059:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0xb1:0x0]+625 in llog 00000004:00080000:2.0:1788838183.337475:0:91059:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x322:0x0], index 0: 0 00000004:00080000:2.0:1788838183.337482:0:91059:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x323:0x0], index 1: 0 00010000:00010000:2.0:1788838183.337566:0:91059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9107 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd1d expref: 14 pid: 91059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.337576:0:91059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff6055e2400) 00010000:00010000:2.0:1788838183.337579:0:91059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788838183.337592:0:91059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9100 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd1d expref: 14 pid: 91059 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.337606:0:91059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9107 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd1d expref: 13 pid: 91059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.337635:0:91059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff6055e2400) 00010000:00010000:2.0:1788838183.337638:0:91059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788838183.337640:0:91059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9a00, rc 0) 00010000:00080000:2.0:1788838183.337715:0:91059:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788838183.337731:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838183.337734:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000020:00080000:2.0:1788838183.337737:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838183.337739:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000100:00100000:3.0:1788838183.346187:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838183.346275:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116427648 00000100:00100000:0.0:1788838183.346286:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116427648 00000100:00100000:0.0:1788838183.346340:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1279 00000100:00100000:0.0:1788838183.346350:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:2403:x1875729116427648:12345-192.168.203.30@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788838183.346375:0:76060:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff504f4c700 x1875729116427648/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:84/0 lens 224/0 e 0 to 0 dl 1788838194 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838183.346398:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:2403:x1875729116427648:12345-192.168.203.30@tcp:400:ldlm_lock_repla.0 Request processed in 50us (220us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838183.346405:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1279 00000020:00080000:2.0:1788838183.346501:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838183.346506:0:91059:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149710 00010000:00080000:2.0:1788838183.346510:0:91059:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788838183.346520:0:91059:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788838183.346527:0:91059:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788838183.346529:0:91059:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1788838183.346647:0:91059:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000001:00100000:0.0:1788838183.348284:0:91027:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00100000:0.0:1788838183.348294:0:91027:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1788838183.348314:0:91027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149709 is committed 00010000:00010000:2.0:1788838183.348362:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348376:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348383:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348389:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838183.348394:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348401:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348419:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348426:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc90eb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348457:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348463:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348469:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348487:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838183.348490:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348496:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348505:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.348511:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5a00/0x88da08396ccc90f9 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91059 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788838183.348865:0:91059:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788838183.348911:0:91059:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788838183.348925:0:91059:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8ff61fcd2a00 x1875729135082112/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:84/0 lens 224/0 e 0 to 0 dl 1788838194 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788838183.349030:0:91059:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.30@tcp: req@ffff8ff504f4c700 x1875729116427648/t0(0) o400->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:84/0 lens 224/0 e 0 to 0 dl 1788838194 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838183.349103:0:91059:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1788838183.350827:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788838183.350844:0:3642:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8ff640e55180 x1875729135082112/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838199 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838183.350855:0:3642:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8ff640e55180 x1875729135082112/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838199 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838183.350872:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788838183.350883:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788838183.350888:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135082112:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788838183.353941:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135082240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838183.354018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838183.354127:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135082240 00000100:00100000:0.0:1788838183.354136:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135082240 00000100:00100000:0.0:1788838183.354195:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4131 00000100:00100000:0.0:1788838183.354207:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135082240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838183.354242:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1788838183.354306:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135082240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.354313:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4131 00000100:00100000:1.0:1788838183.354417:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135082240:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1788838183.386130:0:91059:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f5188623e10 00100000:10000000:0.0:1788838183.386146:0:91059:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788838183.387000:0:91047:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:1.0:1788838183.387046:0:91047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91047:1875729135082368:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788838183.387122:0:91047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838183.387155:0:91047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff614983540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838183.387178:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135082368 00000100:00100000:1.0:1788838183.387184:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135082368 00000100:00100000:1.0:1788838183.387226:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5955 00000100:00100000:1.0:1788838183.387234:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:91047:x1875729135082368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788838183.387261:0:8462:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -30 00002000:02000040:1.0:1788838183.387267:0:8462:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:833) 00000004:00080000:0.0:1788838183.389823:0:91045:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x322:0x0] 00000100:00100000:0.0:1788838183.389890:0:91045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91045:1875729135082496:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788838183.389961:0:91045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838183.389996:0:91045:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838183.390026:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135082496 00000100:00100000:0.0:1788838183.390033:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135082496 00000100:00100000:0.0:1788838183.390075:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5956 00000100:00100000:0.0:1788838183.390083:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:91045:x1875729135082496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788838183.390107:0:26208:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -31 00002000:02000040:0.0:1788838183.390111:0:26208:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:803 to 0x280000401:833) 00002000:00010000:0.0:1788838183.408013:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.408028:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1e66/0x88da08396ccc910e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.408046:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x341:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.408051:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x341:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.408057:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1e66/0x88da08396ccc910e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.408075:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3b1e66/0x88da08396ccc910e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.408085:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3b1e66/0x88da08396ccc910e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.408111:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d3b1e66/0x88da08396ccc910e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.408313:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.408439:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.408445:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b5c1a54/0x88da08396ccc9115 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.408453:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x340:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.408456:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x340:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.408460:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b5c1a54/0x88da08396ccc9115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.408469:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b5c1a54/0x88da08396ccc9115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.408476:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b5c1a54/0x88da08396ccc9115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.408483:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b5c1a54/0x88da08396ccc9115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.409162:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838183.409173:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d3b1e66/0x88da08396ccc910e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.409194:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718fc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838183.409199:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1e66/0x88da08396ccc910e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.409209:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3b1e66/0x88da08396ccc910e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.409227:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d3b1e66/0x88da08396ccc910e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.409233:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3b1e66/0x88da08396ccc910e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.409260:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838183.409263:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b5c1a54/0x88da08396ccc9115 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.409269:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718ee00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838183.409272:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b5c1a54/0x88da08396ccc9115 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.409280:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b5c1a54/0x88da08396ccc9115 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.409290:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b5c1a54/0x88da08396ccc9115 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.409304:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.409305:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.409307:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788838183.410522:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788838183.410682:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788838183.410701:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b5c1a54/0x88da08396ccc9115 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838183.411057:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.411064:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396ccc911c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411076:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33f:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.411080:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.411086:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396ccc911c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411100:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396ccc911c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411109:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396ccc911c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411118:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396ccc911c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411135:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838183.411145:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838183.411150:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396ccc911c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411158:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.411163:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396ccc911c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411179:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396ccc911c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411194:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396ccc911c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411201:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396ccc911c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411216:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.411218:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.411219:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.411293:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.411299:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc9123 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411307:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33e:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.411310:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.411314:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc9123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411323:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc9123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411331:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc9123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411345:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc9123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411358:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.411401:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.411406:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001782184f/0x88da08396ccc912a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411413:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33d:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.411416:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.411420:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001782184f/0x88da08396ccc912a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411429:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001782184f/0x88da08396ccc912a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411437:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001782184f/0x88da08396ccc912a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411443:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001782184f/0x88da08396ccc912a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411455:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838183.411492:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.411497:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc9131 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411509:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33c:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.411511:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.411515:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc9131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411523:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc9131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411531:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc9131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411537:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc9131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411550:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788838183.411557:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838183.411561:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc9123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411567:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.411571:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc9123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411579:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc9123 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411602:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc9123 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411609:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000607be43a/0x88da08396ccc9123 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411622:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838183.411625:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001782184f/0x88da08396ccc912a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411632:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.411635:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001782184f/0x88da08396ccc912a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411642:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001782184f/0x88da08396ccc912a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411651:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001782184f/0x88da08396ccc912a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411658:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001782184f/0x88da08396ccc912a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411669:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838183.411672:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc9131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411683:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.411839:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc9131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411850:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc9131 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411935:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc9131 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411943:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007a43bf0/0x88da08396ccc9131 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.411958:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.411960:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.411962:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.412011:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.412017:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc9138 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412025:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33b:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.412028:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.412032:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc9138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412042:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc9138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412057:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc9138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412065:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc9138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412078:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838183.412085:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838183.412088:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc9138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412094:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.412097:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc9138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412105:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc9138 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412116:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc9138 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412123:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbdc834d/0x88da08396ccc9138 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412135:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.412143:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.412145:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.412189:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.412193:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc913f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412200:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33a:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.412202:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.412206:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc913f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412214:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc913f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412222:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc913f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412229:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc913f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412241:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838183.412246:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838183.412250:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc913f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412256:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.412259:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc913f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412277:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc913f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412289:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc913f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412296:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001028aa39/0x88da08396ccc913f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412307:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.412309:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.412310:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.412352:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.412357:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc9146 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412364:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x339:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.412367:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x339:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.412371:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc9146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412380:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc9146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412387:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc9146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412400:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc9146 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412412:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838183.412418:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838183.412421:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc9146 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412427:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.412430:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc9146 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412437:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc9146 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412447:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc9146 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412454:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0540df5/0x88da08396ccc9146 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412466:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.412467:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.412469:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.412508:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.412518:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc914d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412526:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x338:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.412529:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x338:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.412533:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc914d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412542:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc914d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412550:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc914d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412557:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc914d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412570:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838183.412576:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838183.412580:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc914d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412587:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.412590:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc914d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412597:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc914d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412614:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc914d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412621:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003a5a456/0x88da08396ccc914d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.412635:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.412636:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.412637:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.412678:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.412683:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc9154 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.412908:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.413140:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.413147:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.413186:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x337:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.413191:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.413195:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc9154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413209:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc9154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413216:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc9154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413223:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc9154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413364:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.413427:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.413432:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc915b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413441:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x336:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.413444:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x336:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.413448:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc915b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413457:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc915b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413465:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc915b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413472:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc915b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.413601:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838183.413608:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc9154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.413615:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838183.413619:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc9154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.413627:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc9154 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.413640:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc9154 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.413648:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000820f80f4/0x88da08396ccc9154 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.413667:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838183.413670:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc915b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413855:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:0.0:1788838183.413915:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.413920:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc9162 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413927:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x335:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.413936:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x335:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.413940:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc9162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413950:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc9162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413958:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc9162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413964:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc9162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.413980:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.414020:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.414026:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccc9169 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414033:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x334:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.414036:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x334:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.414041:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccc9169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414049:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccc9169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414058:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccc9169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414071:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccc9169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414084:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838183.414122:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.414127:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccc9170 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414135:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x333:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.414138:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x333:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.414142:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccc9170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414150:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccc9170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414157:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccc9170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414164:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccc9170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414172:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788838183.414205:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.414209:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccc9177 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414222:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x332:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.414225:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.414229:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccc9177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414237:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccc9177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414244:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccc9177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414263:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccc9177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414272:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788838183.414313:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.414318:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccc917e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414326:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x331:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.414329:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x331:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.414333:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccc917e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414341:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccc917e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414360:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccc917e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414367:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccc917e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414376:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788838183.414416:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.414421:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccc9185 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414428:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x330:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.414431:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.414435:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccc9185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414444:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccc9185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414451:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccc9185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414457:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccc9185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414476:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788838183.414518:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.414523:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccc918c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414531:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32f:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.414533:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.414537:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccc918c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414545:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccc918c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414552:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccc918c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414559:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccc918c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414567:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788838183.414600:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.414604:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccc9193 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414610:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32e:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.414618:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.414622:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccc9193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414631:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccc9193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414639:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccc9193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414645:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccc9193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414652:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788838183.414708:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.414713:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccc919a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414721:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32d:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.414724:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.414728:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccc919a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414736:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccc919a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414743:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccc919a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414757:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccc919a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414765:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788838183.414836:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.414841:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccc91a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414849:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32c:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.414851:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.414855:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccc91a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414864:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccc91a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414871:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccc91a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414878:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccc91a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414886:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1788838183.414916:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.414920:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccc91a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414933:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32b:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.414936:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.414940:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccc91a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414949:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccc91a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414956:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccc91a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414964:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccc91a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.414971:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1788838183.415004:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.415008:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccc91af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415015:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32a:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.415017:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.415022:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccc91af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415029:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccc91af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415047:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccc91af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415054:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccc91af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415062:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1788838183.415101:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.415106:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc91b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415114:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x329:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.415117:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x329:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.415121:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc91b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415129:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc91b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415137:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc91b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415143:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc91b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415161:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:0.0:1788838183.415198:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.415202:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc91bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415209:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x328:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.415212:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x328:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.415215:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc91bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415223:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc91bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415231:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc91bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415237:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc91bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415245:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:0.0:1788838183.415278:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.415283:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc91c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415290:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x327:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.415299:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x327:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.415303:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc91c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415312:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc91c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415319:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc91c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415326:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc91c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415334:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:0.0:1788838183.415373:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.415377:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc91cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415386:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x326:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.415388:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x326:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.415392:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc91cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415399:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc91cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415407:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc91cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415421:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc91cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415429:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:0.0:1788838183.415472:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.415477:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc358ab5/0x88da08396ccc91d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415485:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x325:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.415488:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.415493:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc358ab5/0x88da08396ccc91d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415502:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc358ab5/0x88da08396ccc91d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415510:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc358ab5/0x88da08396ccc91d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415518:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc358ab5/0x88da08396ccc91d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415526:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:0.0:1788838183.415559:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.415564:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc91d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415577:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x324:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.415580:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x324:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.415585:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc91d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415594:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc91d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415602:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc91d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415609:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc91d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415617:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:0.0:1788838183.415655:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.415660:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f225263/0x88da08396ccc91e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415668:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x323:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.415671:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x323:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.415675:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f225263/0x88da08396ccc91e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415685:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f225263/0x88da08396ccc91e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415703:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f225263/0x88da08396ccc91e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415710:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f225263/0x88da08396ccc91e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.415719:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00080000:0.0:1788838183.415749:0:26208:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:802 00000100:00100000:0.0:1788838183.415896:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:91045:x1875729135082496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25809us (25929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.415907:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5956 00000100:00100000:0.0:1788838183.415971:0:91045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91045:1875729135082496:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788838183.415988:0:91045:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x341:0x0] from OST, last_created [0x280000401:0x341:0x0]last_used is [0x280000401:0x322:0x0] 00000100:00100000:0.0:1788838183.416066:0:91045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91045:1875729135082752:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788838183.416101:0:91045:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838183.416123:0:91045:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624ea63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838183.416138:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838183.416149:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135082624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838183.416174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838183.416204:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135082752 00000100:00100000:0.0:1788838183.416209:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135082752 00000100:00100000:0.0:1788838183.416245:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5957 00000100:00100000:0.0:1788838183.416252:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:91045:x1875729135082752:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788838183.416286:0:26208:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 834 00010000:00010000:3.0:1788838183.417187:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:3.0:1788838183.417198:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc9162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417209:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417213:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc9162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417225:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc9162 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417254:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc9162 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417261:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002adec276/0x88da08396ccc9162 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417284:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:3.0:1788838183.417288:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccc9169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417294:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417297:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccc9169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417312:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccc9169 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417322:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccc9169 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417329:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccc9169 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417341:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1788838183.417345:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccc9170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417350:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417353:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccc9170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417359:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccc9170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417367:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccc9170 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417374:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccc9170 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417396:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1788838183.417400:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccc9177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417406:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417409:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccc9177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417416:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccc9177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417424:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccc9177 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417431:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccc9177 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417441:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1788838183.417444:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccc917e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417450:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417453:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccc917e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417469:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccc917e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417479:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccc917e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417485:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccc917e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417497:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1788838183.417501:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccc9185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417506:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417508:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccc9185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417515:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccc9185 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417524:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccc9185 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417530:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccc9185 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417553:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1788838183.417556:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccc918c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417562:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417565:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccc918c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417573:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccc918c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417582:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccc918c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417589:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccc918c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417600:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1788838183.417603:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccc9193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417609:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417611:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccc9193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417627:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccc9193 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417637:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccc9193 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417644:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccc9193 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417656:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1788838183.417659:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccc919a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417664:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417667:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccc919a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417673:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccc919a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417681:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccc919a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417702:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccc919a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417726:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788838183.417730:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccc91a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417737:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417740:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccc91a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417746:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccc91a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417756:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccc91a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417762:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccc91a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417782:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788838183.417786:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccc91a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417791:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417793:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccc91a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417831:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccc91a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417841:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccc91a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417848:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccc91a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417871:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788838183.417875:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccc91af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417881:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417883:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccc91af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417890:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccc91af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417898:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccc91af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417905:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccc91af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417927:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788838183.417931:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc91b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417936:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3caa00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417938:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc91b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417945:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc91b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417953:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc91b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417959:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc91b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417971:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788838183.417974:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc91bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417980:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.417982:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc91bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.417998:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc91bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418007:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc91bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418014:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc91bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418025:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788838183.418029:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc91c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418036:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.418038:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc91c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418045:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc91c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418055:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc91c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418062:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc91c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418085:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788838183.418088:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc91cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418094:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cba00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.418097:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc91cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418104:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc91cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418114:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc91cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418120:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc91cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418131:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788838183.418134:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc358ab5/0x88da08396ccc91d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418139:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cbc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.418142:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc358ab5/0x88da08396ccc91d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418159:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc358ab5/0x88da08396ccc91d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418169:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc358ab5/0x88da08396ccc91d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418175:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc358ab5/0x88da08396ccc91d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418188:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838183.418191:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc91d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418197:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.418200:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc91d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418206:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc91d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418215:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc91d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418221:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc91d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418244:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838183.418248:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f225263/0x88da08396ccc91e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418255:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.418258:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f225263/0x88da08396ccc91e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418265:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f225263/0x88da08396ccc91e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418274:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f225263/0x88da08396ccc91e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418282:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f225263/0x88da08396ccc91e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.418292:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.418294:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.418296:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.418667:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838183.418674:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc915b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.418699:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc915b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.418712:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc915b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.418718:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000459ee172/0x88da08396ccc915b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.418737:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.418738:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.418740:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838183.418757:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135082624 00000100:00100000:2.0:1788838183.418766:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135082624 00000100:00100000:2.0:1788838183.419038:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:2.0:1788838183.419048:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135082624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788838183.419076:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 896 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838183.419160:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135082624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838183.419168:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00010000:00010000:2.0:1788838183.419193:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838183.419319:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135082624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788838183.419347:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788838183.420120:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838183.420131:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069abe6ce/0x88da08396ccc91e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420145:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x341:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:2.0:1788838183.420149:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x341:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838183.420155:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069abe6ce/0x88da08396ccc91e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420169:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069abe6ce/0x88da08396ccc91e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420178:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069abe6ce/0x88da08396ccc91e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420185:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069abe6ce/0x88da08396ccc91e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420202:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788838183.420515:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838183.420521:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc91ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420530:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x340:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:2.0:1788838183.420533:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x340:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838183.420545:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc91ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420554:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc91ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420562:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc91ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420569:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc91ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420585:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788838183.420594:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838183.420599:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069abe6ce/0x88da08396ccc91e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420607:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838183.420611:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069abe6ce/0x88da08396ccc91e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420619:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069abe6ce/0x88da08396ccc91e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420633:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069abe6ce/0x88da08396ccc91e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420651:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069abe6ce/0x88da08396ccc91e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420669:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838183.420673:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc91ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420680:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838183.420683:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc91ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420709:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc91ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420720:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc91ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420727:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dffee80/0x88da08396ccc91ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.420739:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.420740:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.420742:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.422329:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838183.423379:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:91045:x1875729135082752:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7121us (7271us total) trans 4294969454 rc 0/0 00000100:00100000:0.0:1788838183.423390:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5957 00000100:00100000:3.0:1788838183.428150:0:91045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91045:1875729135082752:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788838183.428171:0:91045:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x341:0x0]-[0x280000401:0x361:0x0] 00000001:00100000:1.0:1788838183.429089:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788838183.429402:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.429412:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc91f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429431:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33f:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.429436:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.429442:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc91f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429457:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc91f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429467:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc91f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429475:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc91f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429500:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.429555:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.429561:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc91fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429568:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33e:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.429580:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.429584:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc91fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429594:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc91fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429602:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc91fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429609:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc91fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429624:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838183.429635:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838183.429641:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc91f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429648:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.429653:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc91f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429662:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc91f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.429677:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc91f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.429790:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838183.429796:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc91fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.429822:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.429826:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc91fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.429834:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc91fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.429846:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc91fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.429853:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc91fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.429886:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.429888:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.429889:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.430049:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc91f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430064:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.430066:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.430068:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.430118:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.430123:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc9203 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430131:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33d:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.430135:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.430138:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc9203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430148:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc9203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430155:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc9203 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430163:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc9203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430183:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.430221:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.430232:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc920a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430239:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33c:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.430242:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.430246:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc920a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430254:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc920a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430261:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc920a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430267:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc920a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430278:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838183.430317:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.430322:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc9211 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430330:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33b:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.430332:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.430336:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc9211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430344:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc9211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430358:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc9211 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430365:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc9211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430376:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788838183.430415:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.430420:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9218 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430428:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33a:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.430431:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.430435:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430444:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430451:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9218 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430457:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430480:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788838183.430489:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788838183.430493:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc9203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430499:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cbe00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.430502:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc9203 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430510:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc9203 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430520:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc9203 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430527:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc9203 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430541:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838183.430544:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc920a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430549:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.430552:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc920a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430570:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc920a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430582:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc920a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430589:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc920a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430600:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838183.430602:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc9211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430608:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.430610:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc9211 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430617:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc9211 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430626:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc9211 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430633:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc9211 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430657:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838183.430660:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430667:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.430670:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9218 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.430677:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9218 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.431965:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.431974:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.431978:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.432964:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9218 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.432986:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9218 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433015:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.433017:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.433019:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.433132:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.433139:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc921f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433154:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x339:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.433169:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x339:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.433175:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc921f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433189:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc921f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433198:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc921f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433205:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc921f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433231:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.433270:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.433275:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9226 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433282:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x338:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.433284:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x338:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.433288:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9226 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433296:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9226 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433304:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9226 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433317:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9226 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433332:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838183.433387:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.433393:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc922d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433401:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x337:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.433403:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.433407:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc922d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433415:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc922d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433422:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc922d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433428:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc922d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433438:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788838183.433475:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.433480:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9234 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433493:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x336:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.433495:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x336:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.433499:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433507:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433514:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433520:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433534:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788838183.433541:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788838183.433545:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc921f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433551:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.433555:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc921f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433563:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc921f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433588:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc921f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433595:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc921f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433610:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838183.433613:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9226 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433619:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cae00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.433622:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9226 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433628:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9226 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433636:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9226 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433643:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9226 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433652:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838183.433655:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc922d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433666:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.433669:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc922d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433676:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc922d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.433685:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc922d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.434080:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838183.434087:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.434095:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.434098:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.434119:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.434132:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9234 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.434138:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9234 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.434153:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.434155:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.434157:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.434163:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.434167:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.434397:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc922d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434411:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.434412:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.434414:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.434487:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.434494:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc923b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434502:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x335:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.434505:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x335:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.434510:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc923b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434520:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc923b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434535:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc923b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434543:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc923b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434564:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.434604:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.434609:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9242 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434616:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x334:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.434619:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x334:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.434622:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434630:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434638:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434644:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.434666:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788838183.434996:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838183.435002:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc923b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.435021:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.435025:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc923b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.435034:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc923b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.435048:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc923b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.435066:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc923b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.435083:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838183.435086:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.435092:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.435095:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.435103:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.435113:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9242 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.435127:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9242 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.435140:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838183.435141:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838183.435143:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.435169:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.435176:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9249 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435184:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x333:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.435187:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x333:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.435191:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435199:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435207:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435213:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435236:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.435282:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.435287:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc9250 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435295:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x332:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.435304:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.435307:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc9250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435316:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc9250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435323:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc9250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435331:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc9250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435344:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838183.435352:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838183.435355:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435362:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.435365:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435372:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435382:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9249 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435399:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9249 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435413:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838183.435416:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc9250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435423:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.435426:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc9250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435433:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc9250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435444:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc9250 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435451:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc9250 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435461:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.435462:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.435464:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.435508:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.435513:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9257 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435526:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x331:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.435529:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x331:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.435533:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435542:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435550:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435557:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435570:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838183.435578:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838183.435582:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435588:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838183.435592:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435599:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9257 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435622:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9257 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435629:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9257 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.435642:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.435644:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.435646:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.436241:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838183.436290:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838183.436327:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.436337:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc925e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.436348:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x330:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.436351:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.436356:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc925e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.436366:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc925e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.436375:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc925e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.436382:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc925e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.436448:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.436513:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.436518:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9265 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.436525:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32f:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.436528:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.436532:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.436541:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.436549:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.436556:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437137:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838183.437159:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc925e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437171:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.437176:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc925e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437186:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc925e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437213:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc925e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437221:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc925e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437243:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838183.437485:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:0.0:1788838183.437555:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.437561:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc926c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.437570:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32e:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:1.0:1788838183.437574:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.437583:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.437594:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc926c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437596:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.437602:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.437614:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc926c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437616:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9265 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.437639:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc926c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437643:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9265 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.437651:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc926c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437656:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9265 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437676:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838183.437679:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc926c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437685:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.437689:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc926c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437696:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc926c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437706:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc926c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.437719:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838183.437721:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.437757:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838183.439846:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.440989:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.444001:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788838183.444019:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc926c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838183.444163:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.444170:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9273 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444182:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32d:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.444187:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.444192:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444205:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444221:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444228:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444251:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.444290:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.444295:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc927a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444301:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32c:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.444304:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.444309:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc927a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444319:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc927a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444327:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc927a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444333:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc927a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444404:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838183.444447:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.444452:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9281 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444460:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32b:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.444463:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.444466:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444475:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444482:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.444489:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445457:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838183.445468:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445479:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.445484:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445494:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445512:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9273 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445520:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9273 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445541:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838183.445545:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc927a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445552:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.445564:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc927a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445572:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc927a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445581:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc927a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445588:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc927a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445602:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838183.445605:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445612:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.445615:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445623:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9281 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445631:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9281 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.445637:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838183.445644:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838183.445646:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.447858:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.450973:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788838183.450989:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9281 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838183.451147:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.451154:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc9288 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.451182:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32a:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.451187:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.451194:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc9288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.451207:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc9288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.451216:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc9288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.451224:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc9288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.451291:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.451333:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.451338:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc928f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.451345:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x329:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.451348:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x329:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.451352:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc928f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.451361:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc928f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.451382:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc928f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.451389:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc928f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.454466:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838183.454480:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc9288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.454494:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.454499:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc9288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.454510:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc9288 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.454547:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc9288 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.454556:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc9288 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.454583:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838183.454587:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc928f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.454593:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838183.454597:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc928f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.454604:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc928f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.454613:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc928f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838183.454620:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.454622:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838183.454624:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.454841:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788838183.454845:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838183.454850:0:8462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc928f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838183.455276:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.455283:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ea177f2/0x88da08396ccc9296 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455295:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x328:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.455299:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x328:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.455305:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ea177f2/0x88da08396ccc9296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455318:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ea177f2/0x88da08396ccc9296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455328:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ea177f2/0x88da08396ccc9296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455348:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ea177f2/0x88da08396ccc9296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455375:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838183.455434:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.455439:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b488b3/0x88da08396ccc929d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455447:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x327:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.455450:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x327:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.455455:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036b488b3/0x88da08396ccc929d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455464:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036b488b3/0x88da08396ccc929d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455472:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b488b3/0x88da08396ccc929d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455479:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036b488b3/0x88da08396ccc929d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455495:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838183.455535:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.455540:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080469be0/0x88da08396ccc92a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455554:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x326:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.455557:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x326:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.455562:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080469be0/0x88da08396ccc92a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455570:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080469be0/0x88da08396ccc92a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455578:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080469be0/0x88da08396ccc92a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455585:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080469be0/0x88da08396ccc92a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455597:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788838183.455633:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.455638:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556e88e5/0x88da08396ccc92ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455645:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x325:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.455648:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.455652:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000556e88e5/0x88da08396ccc92ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455661:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000556e88e5/0x88da08396ccc92ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455679:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556e88e5/0x88da08396ccc92ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455685:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000556e88e5/0x88da08396ccc92ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455854:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788838183.455965:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838183.455971:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce74c12a/0x88da08396ccc92b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455980:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x324:0x0].0x0 since=3577s v=(0 0) 00010000:00010000:0.0:1788838183.455983:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x324:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838183.455987:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce74c12a/0x88da08396ccc92b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.455996:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce74c12a/0x88da08396ccc92b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.456003:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce74c12a/0x88da08396ccc92b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.456011:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce74c12a/0x88da08396ccc92b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838183.456032:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:0.0:1788838183.456060:0:8462:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:0.0:1788838183.456146:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:91047:x1875729135082368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 68909us (69021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.456155:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5955 00010000:00010000:1.0:1788838183.456527:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788838183.456536:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ea177f2/0x88da08396ccc9296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456545:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.456550:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ea177f2/0x88da08396ccc9296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456559:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ea177f2/0x88da08396ccc9296 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456577:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ea177f2/0x88da08396ccc9296 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456585:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ea177f2/0x88da08396ccc9296 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456606:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788838183.456610:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036b488b3/0x88da08396ccc929d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456616:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e4800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.456619:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b488b3/0x88da08396ccc929d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456640:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b488b3/0x88da08396ccc929d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456651:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036b488b3/0x88da08396ccc929d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456658:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036b488b3/0x88da08396ccc929d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456672:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838183.456676:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080469be0/0x88da08396ccc92a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.456682:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e4000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838183.456685:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080469be0/0x88da08396ccc92a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.456898:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838183.456911:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000556e88e5/0x88da08396ccc92ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.456919:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e5e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838183.456922:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000556e88e5/0x88da08396ccc92ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.456931:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000556e88e5/0x88da08396ccc92ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.456943:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000556e88e5/0x88da08396ccc92ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.456951:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000556e88e5/0x88da08396ccc92ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.456967:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838183.456970:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce74c12a/0x88da08396ccc92b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.456977:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e4600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838183.456980:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce74c12a/0x88da08396ccc92b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.456988:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce74c12a/0x88da08396ccc92b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.457010:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce74c12a/0x88da08396ccc92b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.457018:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce74c12a/0x88da08396ccc92b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838183.457031:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.457032:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838183.457034:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838183.457149:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080469be0/0x88da08396ccc92a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.457161:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080469be0/0x88da08396ccc92a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.457169:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080469be0/0x88da08396ccc92a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838183.457195:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838183.457197:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838183.457199:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838183.457245:0:91047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91047:1875729135082368:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788838183.457272:0:91047:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x341:0x0] from OST, last_created [0x2c0000401:0x341:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:1.0:1788838183.457358:0:91047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504b21180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91047:1875729135083008:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788838183.457406:0:91047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838183.457432:0:91047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff614983540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838183.457447:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838183.457457:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135082880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838183.457483:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838183.457517:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135083008 00000100:00100000:1.0:1788838183.457524:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135083008 00000100:00100000:1.0:1788838183.457565:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5958 00000100:00100000:1.0:1788838183.457573:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:91047:x1875729135083008:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788838183.457614:0:26215:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 834 00010000:00010000:3.0:1788838183.459235:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838183.459998:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135082880 00000100:00100000:0.0:1788838183.460010:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135082880 00000100:00100000:0.0:1788838183.460080:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:0.0:1788838183.460090:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135082880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788838183.460113:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838183.460193:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135082880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838183.460200:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00010000:00010000:0.0:1788838183.460225:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838183.460503:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135082880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838183.461544:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:91047:x1875729135083008:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3967us (4133us total) trans 4294969453 rc 0/0 00000100:00100000:1.0:1788838183.461554:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5958 00000100:00100000:2.0:1788838183.461617:0:91047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504b21180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91047:1875729135083008:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788838183.461632:0:91047:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x341:0x0]-[0x2c0000401:0x361:0x0] 00000001:00100000:3.0:1788838183.812903:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:3.0:1788838183.956462:0:91415:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788838183.956705:0:91415:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788838183.997146:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838184.510723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838184.510778:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838184.510844:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838184.510865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838184.510888:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838184.510914:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116428032 00000100:00100000:3.0:1788838184.510925:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116428032 00000100:00100000:3.0:1788838184.510988:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116427904 00000100:00100000:3.0:1788838184.511000:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116427904 00000100:00100000:3.0:1788838184.511032:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1280 00000100:00100000:3.0:1788838184.511041:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116428032:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838184.511108:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116428032:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838184.511115:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1280 00000100:00100000:3.0:1788838184.511130:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1281 00000100:00100000:3.0:1788838184.511135:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2405:x1875729116427904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838184.511187:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2405:x1875729116427904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 51us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838184.511193:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1281 00000100:00100000:0.0:1788838184.511423:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116427776 00000100:00100000:0.0:1788838184.511430:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116427776 00000100:00100000:0.0:1788838184.511471:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:0.0:1788838184.511479:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:2405:x1875729116427776:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838184.511870:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116428288 00000100:00100000:1.0:1788838184.511875:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116428288 00000100:00100000:1.0:1788838184.511923:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116428160 00000100:00100000:1.0:1788838184.511927:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116428160 00000100:00100000:1.0:1788838184.511949:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2604 00000100:00100000:1.0:1788838184.511967:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff641348c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2405:x1875729116428288:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838184.517793:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:2405:x1875729116427776:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 6301us (7065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838184.517824:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:0.0:1788838184.517894:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2605 00000100:00100000:0.0:1788838184.517909:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116428160:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838184.517960:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2405:x1875729116428160:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 57us (7070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838184.517980:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2605 00000100:00080000:0.0:1788838184.518022:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838184.518027:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838184.518030:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838184.518607:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff641348c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2405:x1875729116428288:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 6637us (7758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838184.518616:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2604 00010000:00010000:1.0:1788838185.021060:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838185.341166:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838185.341191:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135083136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838185.341292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838185.341459:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135083136 00000100:00100000:3.0:1788838185.341468:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135083136 00000100:00100000:3.0:1788838185.341543:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1788838185.341554:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135083136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838185.341605:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838185.341652:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135083136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838185.341659:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:2.0:1788838185.341770:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135083136:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788838185.341975:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838185.342084:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838185.342096:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135083264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838185.342132:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838185.342254:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135083264 00000100:00100000:2.0:1788838185.342259:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135083264 00000100:00100000:2.0:1788838185.342299:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1788838185.342307:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135083264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838185.342323:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838185.342366:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135083264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838185.342372:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:0.0:1788838185.342495:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135083264:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788838185.342551:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838185.858624:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838185.863519:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116428416 00000100:00100000:2.0:1788838185.863552:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116428416 00000100:00100000:2.0:1788838185.863718:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1281 00000100:00100000:2.0:1788838185.863731:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:69805:x1875729116428416:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838185.863761:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838185.863830:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc92b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd6a expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838185.863906:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838185.863920:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838185.863932:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838185.864003:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838185.864007:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838185.864046:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838185.864072:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc92b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd6a expref: 9 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838185.864091:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd6a expref: 8 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838185.864100:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:2.0:1788838185.864103:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838185.864106:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8e00, rc 0) 00000100:00100000:2.0:1788838185.864176:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:69805:x1875729116428416:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 448us (5560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838185.864183:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1281 00000100:00080000:1.0:1788838185.864271:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838185.869895:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838185.870030:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116428544 00000100:00100000:3.0:1788838185.870040:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116428544 00000100:00100000:3.0:1788838185.870105:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1282 00000100:00100000:3.0:1788838185.870115:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:69805:x1875729116428544:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838185.870152:0:66254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1788838185.870217:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:69805:x1875729116428544:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 103us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838185.870224:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1282 00000100:00100000:3.0:1788838185.875330:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838185.875502:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116428672 00000100:00100000:2.0:1788838185.875513:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116428672 00000100:00100000:2.0:1788838185.875576:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1283 00000100:00100000:2.0:1788838185.875586:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:69805:x1875729116428672:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788838185.875624:0:66255:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788838185.875716:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:69805:x1875729116428672:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 131us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838185.875724:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1283 00000100:00100000:2.0:1788838185.880717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838185.880989:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116428800 00000100:00100000:0.0:1788838185.881001:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116428800 00000100:00100000:0.0:1788838185.881063:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2050 00000100:00100000:0.0:1788838185.881074:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:69805:x1875729116428800:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:0.0:1788838185.881101:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838185.881174:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:69805:x1875729116428800:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 102us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838185.881181:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2050 00000100:00100000:1.0:1788838185.884333:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838185.884590:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116428928 00000100:00100000:3.0:1788838185.884600:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116428928 00000100:00100000:3.0:1788838185.884663:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2051 00000100:00100000:3.0:1788838185.884673:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:69805:x1875729116428928:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1788838185.884697:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838185.884771:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:69805:x1875729116428928:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 99us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838185.884779:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2051 00010000:00010000:3.0:1788838186.044992:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838187.068955:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838188.093037:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838188.413430:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135083392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838188.413504:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838188.413566:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135083392 00000100:00100000:2.0:1788838188.413574:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135083392 00000100:00100000:2.0:1788838188.413637:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4132 00000100:00100000:2.0:1788838188.413645:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135083392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838188.413679:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:2.0:1788838188.413726:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135083392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838188.413733:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4132 00000100:00100000:2.0:1788838188.413792:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135083392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838188.414946:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135083776:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.415002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838188.415036:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135084288:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.415063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838188.415082:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135084800:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.415104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838188.415123:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788838188.415129:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135083648:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.415151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838188.415169:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135084160:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.415188:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838188.415202:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135084672:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.415228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838188.415784:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135083520:0@lo:400:kworker.0 00000100:00100000:2.0:1788838188.415845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838188.415891:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135084032:0@lo:400:kworker.0 00000100:00100000:2.0:1788838188.415916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838188.415936:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135084544:0@lo:400:kworker.0 00000100:00100000:2.0:1788838188.415960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838188.415978:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135085056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838188.415997:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838188.416017:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788838188.416024:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135083904:0@lo:400:kworker.0 00000100:00100000:2.0:1788838188.416047:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838188.416066:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135084416:0@lo:400:kworker.0 00000100:00100000:2.0:1788838188.416131:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838188.416149:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135084928:0@lo:400:kworker.0 00000100:00100000:2.0:1788838188.416170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838188.416204:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135083776 00000100:00100000:2.0:1788838188.416211:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135083776 00000100:00100000:3.0:1788838188.416315:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135083520 00000100:00100000:3.0:1788838188.416320:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135083520 00000100:00100000:3.0:1788838188.416367:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788838188.416377:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135083520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.416432:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135083520:12345-0@lo:400:kworker.0 Request processed in 57us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838188.416440:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788838188.416487:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135083648 00000100:00100000:3.0:1788838188.416491:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135083648 00000100:00100000:3.0:1788838188.416522:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135084032 00000100:00100000:3.0:1788838188.416524:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135084032 00000100:00100000:3.0:1788838188.416536:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135083904 00000100:00100000:3.0:1788838188.416538:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135083904 00000100:00100000:3.0:1788838188.416550:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135084416 00000100:00100000:3.0:1788838188.416553:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135084416 00000100:00100000:3.0:1788838188.416561:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135084928 00000100:00100000:3.0:1788838188.416563:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135084928 00000100:00100000:3.0:1788838188.417757:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1788838188.417774:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135083648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.417865:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135083648:12345-0@lo:400:kworker.0 Request processed in 98us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838188.417873:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1788838188.417896:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1788838188.417903:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135084032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.417933:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135084032:12345-0@lo:400:kworker.0 Request processed in 32us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838188.417939:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1788838188.417951:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1788838188.417958:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135083904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.417986:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135083904:12345-0@lo:400:kworker.0 Request processed in 30us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838188.417992:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1788838188.418003:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1788838188.418009:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135084416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.418035:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135084416:12345-0@lo:400:kworker.0 Request processed in 26us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838188.418040:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1788838188.418052:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:3.0:1788838188.418058:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135084928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.418085:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135084928:12345-0@lo:400:kworker.0 Request processed in 26us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838188.418090:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:3.0:1788838188.418129:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135084544 00000100:00100000:3.0:1788838188.418136:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135084544 00000100:00100000:3.0:1788838188.418218:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135085056 00000100:00100000:3.0:1788838188.418222:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135085056 00000100:00100000:3.0:1788838188.418243:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4133 00000100:00100000:3.0:1788838188.418249:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135084544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.418283:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135084544:12345-0@lo:400:kworker.0 Request processed in 34us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838188.418289:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4133 00000100:00100000:3.0:1788838188.418301:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4134 00000100:00100000:3.0:1788838188.418307:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135085056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838188.418330:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838188.418376:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135085056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838188.418383:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4134 00000100:00100000:3.0:1788838188.418435:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135083648:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.418497:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135083904:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.418508:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135084416:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.418538:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135084928:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.418550:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135083520:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.418560:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135084032:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.418569:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135084544:0@lo:400:kworker.0 00000100:00100000:3.0:1788838188.418581:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135085056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838188.419047:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:2.0:1788838188.419056:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135083776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838188.419105:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135083776:12345-0@lo:400:kworker.0 Request processed in 51us (4103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838188.419111:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:2.0:1788838188.419159:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135083776:0@lo:400:kworker.0 00000100:00100000:0.0:1788838188.419449:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135084288 00000100:00100000:0.0:1788838188.419455:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135084288 00000100:00100000:0.0:1788838188.419498:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135084800 00000100:00100000:0.0:1788838188.419501:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135084800 00000100:00100000:0.0:1788838188.419522:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135084160 00000100:00100000:0.0:1788838188.419525:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135084160 00000100:00100000:0.0:1788838188.419547:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135084672 00000100:00100000:0.0:1788838188.419550:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135084672 00000100:00100000:0.0:1788838188.419568:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:0.0:1788838188.419574:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135084288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838188.419754:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135084288:12345-0@lo:400:kworker.0 Request processed in 180us (4689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838188.419773:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:0.0:1788838188.419788:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:0.0:1788838188.419794:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135084800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838188.419858:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135084800:12345-0@lo:400:kworker.0 Request processed in 64us (4752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838188.419864:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:0.0:1788838188.419875:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:0.0:1788838188.419881:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135084160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838188.419908:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135084160:12345-0@lo:400:kworker.0 Request processed in 27us (4719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838188.419913:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:0.0:1788838188.419924:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1788838188.419929:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135084672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838188.419956:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135084672:12345-0@lo:400:kworker.0 Request processed in 26us (4726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838188.419961:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1788838188.420021:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135084160:0@lo:400:kworker.0 00000100:00100000:0.0:1788838188.420033:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135084672:0@lo:400:kworker.0 00000100:00100000:0.0:1788838188.420043:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135084288:0@lo:400:kworker.0 00000100:00100000:0.0:1788838188.420053:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135084800:0@lo:400:kworker.0 00000100:00080000:0.0:1788838188.420319:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838188.420324:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838188.420326:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838188.420336:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838188.927353:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135085184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838188.927426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838188.927509:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135085184 00000100:00100000:3.0:1788838188.927517:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135085184 00000100:00100000:3.0:1788838188.927559:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:3.0:1788838188.927568:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135085184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838188.927598:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838188.927643:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135085184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838188.927651:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:3.0:1788838188.927702:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135085184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838188.928433:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838188.928444:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135085312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838188.928477:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838188.928566:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135085312 00000100:00100000:0.0:1788838188.928571:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135085312 00000100:00100000:0.0:1788838188.928651:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:0.0:1788838188.928660:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135085312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788838188.928678:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838188.928720:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135085312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838188.928726:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000001:00080000:1.0:1788838188.933520:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969453 is committed 00000100:00100000:0.0:1788838188.938604:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135085312:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788838188.942994:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969454 is committed 00010000:00010000:1.0:1788838189.120991:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838189.638944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838189.638998:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838189.639040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838189.639070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838189.639251:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116429184 00000100:00100000:0.0:1788838189.639262:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116429184 00000100:00100000:1.0:1788838189.639273:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116429056 00000100:00100000:1.0:1788838189.639280:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116429056 00000100:00100000:0.0:1788838189.639327:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116429312 00000100:00100000:0.0:1788838189.639331:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116429312 00000100:00100000:1.0:1788838189.639338:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:1.0:1788838189.639351:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116429056:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838189.639365:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1288 00000100:00100000:0.0:1788838189.639375:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116429184:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838189.639517:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116429440 00000100:00100000:2.0:1788838189.639522:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116429440 00000100:00100000:2.0:1788838189.639553:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2610 00000100:00100000:2.0:1788838189.639561:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116429440:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838189.641894:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2406:x1875729116429184:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2510us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838189.641908:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1288 00000100:00100000:0.0:1788838189.641943:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1289 00000100:00100000:0.0:1788838189.641954:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116429312:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838189.641999:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116429312:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 49us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838189.642005:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1289 00000100:00080000:0.0:1788838189.642030:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838189.642035:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838189.642049:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838189.643204:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838189.648010:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116429056:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 8649us (8955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838189.648028:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:1.0:1788838189.648140:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116429568 00000100:00100000:1.0:1788838189.648149:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116429568 00000100:00100000:1.0:1788838189.648211:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2611 00000100:00100000:1.0:1788838189.648219:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116429568:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838189.648284:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116429568:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 65us (5085us total) trans 0 rc 0/0 00000100:00080000:0.0:1788838189.648356:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838189.649882:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2611 00000100:00100000:2.0:1788838189.657886:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116429440:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 18301us (18862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838189.657904:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2610 00010000:00010000:3.0:1788838190.141045:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838190.462244:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135085440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838190.462352:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838190.462626:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135085440 00000100:00100000:0.0:1788838190.462638:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135085440 00000100:00100000:0.0:1788838190.462731:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1788838190.462745:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135085440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838190.462787:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838190.462884:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135085440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838190.462892:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00080000:1.0:1788838190.463023:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838190.463117:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135085440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838190.473440:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838190.473482:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135085568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838190.473578:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838190.473641:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135085568 00000100:00100000:1.0:1788838190.473649:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135085568 00000100:00100000:1.0:1788838190.473734:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1788838190.473746:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135085568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838190.473781:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838190.473845:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135085568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838190.473851:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00080000:1.0:1788838190.473873:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838190.474070:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135085568:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788838190.958887:0:91609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1788838191.165641:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838192.189140:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788838192.351988:0:91657:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1788838193.213496:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838193.533412:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135085696:0@lo:400:kworker.0 00000100:00100000:0.0:1788838193.533520:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838193.533579:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135086208:0@lo:400:kworker.0 00000100:00100000:0.0:1788838193.533611:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838193.533634:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135086720:0@lo:400:kworker.0 00000100:00100000:0.0:1788838193.533657:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838193.533673:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135087232:0@lo:400:kworker.0 00000100:00100000:0.0:1788838193.533698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838193.533737:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788838193.533743:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135085824:0@lo:400:kworker.0 00000100:00100000:0.0:1788838193.533765:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838193.533780:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135086336:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535038:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135086208 00000100:00100000:2.0:1788838193.535049:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135086208 00000100:00100000:2.0:1788838193.535133:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135086720 00000100:00100000:2.0:1788838193.535137:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135086720 00000100:00100000:2.0:1788838193.535158:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135087232 00000100:00100000:2.0:1788838193.535161:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135087232 00000100:00100000:2.0:1788838193.535173:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135085824 00000100:00100000:2.0:1788838193.535175:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135085824 00000100:00100000:2.0:1788838193.535194:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1788838193.535195:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135087360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838193.535204:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135086208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535283:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135086208:12345-0@lo:400:kworker.0 Request processed in 80us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838193.535293:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1788838193.535310:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1788838193.535315:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135086720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535344:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135086720:12345-0@lo:400:kworker.0 Request processed in 30us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838193.535350:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1788838193.535360:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1788838193.535366:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135087232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535392:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135087232:12345-0@lo:400:kworker.0 Request processed in 27us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838193.535418:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1788838193.535431:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1788838193.535437:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135085824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535467:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135085824:12345-0@lo:400:kworker.0 Request processed in 31us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838193.535473:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1788838193.535498:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135086080:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535532:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838193.535560:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135086592:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535587:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838193.535609:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135087104:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535631:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838193.535656:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788838193.535663:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135085952:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535686:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838193.535698:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135086464:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838193.535755:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135086976:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.535778:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838193.535825:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135087488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838193.536050:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135085696 00000100:00100000:3.0:1788838193.536056:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135085696 00000100:00100000:3.0:1788838193.536112:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788838193.536120:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff608228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135085696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838193.536163:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff608228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135085696:12345-0@lo:400:kworker.0 Request processed in 44us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838193.536169:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788838193.536223:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135086080 00000100:00100000:3.0:1788838193.536226:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135086080 00000100:00100000:3.0:1788838193.536247:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135085952 00000100:00100000:3.0:1788838193.536249:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135085952 00000100:00100000:3.0:1788838193.536262:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1788838193.536268:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135086080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838193.536297:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135086080:12345-0@lo:400:kworker.0 Request processed in 29us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838193.536303:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1788838193.536315:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1788838193.536321:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135085952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838193.536346:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135085952:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838193.536352:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1788838193.536377:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135086592 00000100:00100000:3.0:1788838193.536381:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135086592 00000100:00100000:3.0:1788838193.536410:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135087104 00000100:00100000:3.0:1788838193.536413:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135087104 00000100:00100000:3.0:1788838193.536435:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135086464 00000100:00100000:3.0:1788838193.536450:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135086464 00000100:00100000:3.0:1788838193.536476:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135086976 00000100:00100000:3.0:1788838193.536479:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135086976 00000100:00100000:3.0:1788838193.536500:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1788838193.536506:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135086592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838193.536539:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135086592:12345-0@lo:400:kworker.0 Request processed in 32us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838193.536545:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1788838193.536556:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:3.0:1788838193.536562:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135087104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838193.536590:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135087104:12345-0@lo:400:kworker.0 Request processed in 29us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838193.536596:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:3.0:1788838193.536606:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1788838193.536613:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135086464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838193.536641:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135086464:12345-0@lo:400:kworker.0 Request processed in 29us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838193.536647:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1788838193.536657:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:3.0:1788838193.536662:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135086976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838193.536688:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135086976:12345-0@lo:400:kworker.0 Request processed in 26us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838193.536694:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00080000:3.0:1788838193.536821:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838193.536827:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838193.536830:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838193.536832:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838193.537571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838193.537663:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135087360 00000100:00100000:1.0:1788838193.537670:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135087360 00000100:00100000:1.0:1788838193.537855:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4135 00000100:00100000:1.0:1788838193.537866:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135087360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838193.537913:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788838193.537915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838193.537994:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135086336 00000100:00100000:0.0:1788838193.538017:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135086336 00000100:00100000:1.0:1788838193.538060:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135087360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 195us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838193.538069:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4135 00000100:00100000:1.0:1788838193.538132:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135087360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838193.538193:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135086848:0@lo:400:kworker.0 00000100:00100000:1.0:1788838193.538230:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838193.538263:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135085696:0@lo:400:kworker.0 00000100:00100000:1.0:1788838193.538279:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135086208:0@lo:400:kworker.0 00000100:00100000:1.0:1788838193.538293:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135086720:0@lo:400:kworker.0 00000100:00100000:1.0:1788838193.538317:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135087232:0@lo:400:kworker.0 00000100:00100000:1.0:1788838193.538340:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135085824:0@lo:400:kworker.0 00000100:00100000:3.0:1788838193.538597:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135086848 00000100:00100000:3.0:1788838193.538602:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135086848 00000100:00100000:3.0:1788838193.538643:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4136 00000100:00100000:3.0:1788838193.538651:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135086848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838193.538715:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135086848:12345-0@lo:400:kworker.0 Request processed in 64us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838193.538722:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4136 00000100:00100000:1.0:1788838193.538809:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135086848:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.538811:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838193.538859:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135086080:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.538873:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135086592:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.538896:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 2 00000100:00100000:2.0:1788838193.538908:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135087104:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.538931:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135085952:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.538945:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff626a88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135086464:0@lo:400:kworker.0 00000100:00100000:2.0:1788838193.538959:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:2.0:1788838193.538969:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135086976:0@lo:400:kworker.0 00000100:00100000:3.0:1788838193.539039:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135087488 00000100:00100000:3.0:1788838193.539043:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135087488 00000100:00100000:3.0:1788838193.539243:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4137 00000100:00100000:3.0:1788838193.539253:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135087488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838193.539282:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1788838193.539374:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135087488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838193.539382:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4137 00000100:00100000:2.0:1788838193.539742:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135087488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838193.542165:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4138 00000100:00100000:0.0:1788838193.542189:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135086336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838193.542314:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135086336:12345-0@lo:400:kworker.0 Request processed in 137us (4409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838193.542452:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4138 00000100:00100000:1.0:1788838193.542587:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135086336:0@lo:400:kworker.0 00000100:00100000:1.0:1788838194.045183:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838194.046371:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135087744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838194.046764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838194.046894:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135087744 00000100:00100000:2.0:1788838194.046905:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135087744 00000100:00100000:2.0:1788838194.046974:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:2.0:1788838194.046986:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135087744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788838194.047029:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838194.047098:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135087744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838194.047107:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:2.0:1788838194.047191:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135087744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838194.050085:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135087616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838194.050165:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838194.050219:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135087616 00000100:00100000:1.0:1788838194.050225:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135087616 00000100:00100000:1.0:1788838194.050272:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1788838194.050280:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135087616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838194.050314:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838194.050363:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135087616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838194.050371:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1788838194.050422:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135087616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838194.078600:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838194.078848:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116429696 00000100:00100000:3.0:1788838194.078863:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116429696 00000100:00100000:3.0:1788838194.078969:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1284 00000100:00100000:3.0:1788838194.078983:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70272:x1875729116429696:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838194.079034:0:66253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1788838194.079132:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70272:x1875729116429696:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 153us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838194.079141:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1284 00000100:00080000:1.0:1788838194.079383:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838194.082904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838194.083056:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116429824 00000100:00100000:0.0:1788838194.083070:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116429824 00000100:00100000:0.0:1788838194.083218:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1285 00000100:00100000:0.0:1788838194.083231:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:70272:x1875729116429824:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1788838194.083283:0:66254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788838194.083381:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:70272:x1875729116429824:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 153us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838194.083390:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1285 00000100:00080000:1.0:1788838194.086752:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838194.090070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838194.090178:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116429952 00000100:00100000:1.0:1788838194.090637:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116429952 00000100:00100000:1.0:1788838194.090780:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2058 00000100:00100000:1.0:1788838194.090792:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff626a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:70272:x1875729116429952:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:1.0:1788838194.090866:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838194.090944:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff626a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:70272:x1875729116429952:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 155us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838194.090952:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2058 00000100:00080000:3.0:1788838194.094101:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838194.098118:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838194.100538:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116430080 00000100:00100000:1.0:1788838194.100559:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116430080 00000100:00100000:1.0:1788838194.100745:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2059 00000100:00100000:1.0:1788838194.100759:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:70272:x1875729116430080:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:1.0:1788838194.100816:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838194.100927:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:70272:x1875729116430080:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 171us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838194.100934:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2059 00000100:00080000:3.0:1788838194.104196:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838194.164003:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838194.164113:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116430336 00000100:00100000:3.0:1788838194.164144:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116430336 00000100:00100000:3.0:1788838194.164235:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1286 00000100:00100000:3.0:1788838194.164248:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70289:x1875729116430336:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788838194.164275:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838194.164301:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc92c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd71 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164393:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164408:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164425:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164440:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc92d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164447:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc92d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164453:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc92d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164545:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164554:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164560:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164573:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164589:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838194.164593:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164602:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164615:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:3.0:1788838194.164618:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838194.164622:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164629:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc92ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164643:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc92d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164649:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc92d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164654:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc92d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164657:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838194.164660:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc92d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164674:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc92d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164682:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff64216e700) 00010000:00010000:3.0:1788838194.164685:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838194.164687:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc92d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164693:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5600/0x88da08396ccc92d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164739:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc92c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd71 expref: 9 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164750:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:3.0:1788838194.164752:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788838194.164755:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc92c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd71 expref: 9 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.164765:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4c00, rc 0) 00000100:00100000:3.0:1788838194.164899:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70289:x1875729116430336:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 653us (911us total) trans 0 rc 301/301 00000100:00100000:3.0:1788838194.164907:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1286 00000100:00100000:0.0:1788838194.167922:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838194.168065:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116430464 00000100:00100000:3.0:1788838194.168087:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116430464 00000100:00100000:3.0:1788838194.168160:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1287 00000100:00100000:3.0:1788838194.168171:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70289:x1875729116430464:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1788838194.168299:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168320:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168334:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168354:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc92e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168361:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc92e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168369:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc92e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168464:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168474:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168481:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838194.168535:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:3.0:1788838194.168541:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838194.168557:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168574:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168588:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168595:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168602:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168608:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838194.168614:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168623:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168638:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:3.0:1788838194.168641:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838194.168646:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168653:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc92dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168669:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc92e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168675:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc92e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168681:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc92e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168694:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838194.168707:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc92e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168715:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc92e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168723:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff64216e500) 00010000:00010000:3.0:1788838194.168726:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838194.168729:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc92e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168735:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc92e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168755:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168760:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168766:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168770:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838194.168773:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168778:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168829:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff6055e2400) 00010000:00010000:3.0:1788838194.168832:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838194.168835:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.168841:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc92ea lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838194.168950:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70289:x1875729116430464:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 778us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838194.168960:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1287 00000100:00100000:2.0:1788838194.188217:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838194.188341:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116430720 00000100:00100000:0.0:1788838194.188357:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116430720 00000100:00100000:0.0:1788838194.188439:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1288 00000100:00100000:0.0:1788838194.188453:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70291:x1875729116430720:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838194.188485:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838194.188516:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5400/0x88da08396ccc92f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd78 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188629:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188672:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188687:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188717:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5000/0x88da08396ccc92ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188726:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5000/0x88da08396ccc92ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188733:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5000/0x88da08396ccc92ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188902:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188912:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188920:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188927:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188934:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e5a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838194.188939:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188949:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188973:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:0.0:1788838194.188976:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838194.188983:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.188990:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5a00/0x88da08396ccc92f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.189008:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5000/0x88da08396ccc92ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.189017:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5000/0x88da08396ccc92ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.189022:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5000/0x88da08396ccc92ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.189027:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e5000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838194.189031:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5000/0x88da08396ccc92ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.189037:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5000/0x88da08396ccc92ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.189043:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff608f3c400) 00010000:00010000:0.0:1788838194.189046:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838194.189049:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5000/0x88da08396ccc92ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.189055:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5000/0x88da08396ccc92ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.189107:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5400/0x88da08396ccc92f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd78 expref: 9 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.189119:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:0.0:1788838194.189122:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838194.189125:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5400/0x88da08396ccc92f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd78 expref: 9 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838194.189134:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50b8e5400, rc 0) 00000100:00100000:0.0:1788838194.189220:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70291:x1875729116430720:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 769us (1020us total) trans 0 rc 301/301 00000100:00100000:0.0:1788838194.189229:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1288 00000100:00100000:1.0:1788838194.196140:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838194.196395:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116430848 00000100:00100000:3.0:1788838194.196410:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116430848 00000100:00100000:3.0:1788838194.196492:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1289 00000100:00100000:3.0:1788838194.196506:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70291:x1875729116430848:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1788838194.196620:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196641:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196656:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196675:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc930d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196683:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc930d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196721:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc930d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196868:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196878:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196885:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838194.196941:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:3.0:1788838194.196947:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838194.196963:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196980:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196987:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.196995:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197003:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197010:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838194.197015:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197030:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197046:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:3.0:1788838194.197050:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838194.197055:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197062:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197090:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc930d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197096:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc930d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197103:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc930d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197108:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838194.197112:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc930d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197118:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc930d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197125:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff64216e500) 00010000:00010000:3.0:1788838194.197127:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838194.197130:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc930d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197146:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc930d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197164:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197169:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197285:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197291:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838194.197294:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197301:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197309:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff6055e2400) 00010000:00010000:3.0:1788838194.197311:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838194.197315:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.197321:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc9314 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838194.197417:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70291:x1875729116430848:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 913us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838194.197428:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1289 00000100:00100000:2.0:1788838194.232469:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838194.232572:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116431104 00000100:00100000:3.0:1788838194.232594:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116431104 00000100:00100000:3.0:1788838194.232676:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1290 00000100:00100000:3.0:1788838194.232688:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70296:x1875729116431104:12345-192.168.203.30@tcp:101:md5sum.0 00010000:00010000:3.0:1788838194.232724:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838194.232752:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc931b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd7f expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.232904:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.232923:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.232937:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.232955:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9329 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.232962:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.232968:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233115:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9330 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233124:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9330 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233153:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9330 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838194.233167:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00010000:00010000:3.0:1788838194.233311:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233320:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233327:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233334:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233340:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838194.233345:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233354:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233368:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:3.0:1788838194.233371:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838194.233376:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233383:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5200/0x88da08396ccc9322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233400:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233414:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9329 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233421:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233426:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838194.233429:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233437:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9329 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233446:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8ff64216e500) 00010000:00010000:3.0:1788838194.233448:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838194.233451:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9329 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233458:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4600/0x88da08396ccc9329 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233541:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5000/0x88da08396ccc931b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd7f expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233556:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9330 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd7f expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838194.233563:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff6055e2400) 00010000:00010000:3.0:1788838194.233566:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838194.233574:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4c00, rc 0) 00000100:00100000:3.0:1788838194.233652:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:70296:x1875729116431104:12345-192.168.203.30@tcp:101:md5sum.0 Request processed in 966us (1197us total) trans 115964116993 rc 0/0 00000100:00100000:3.0:1788838194.233662:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1290 00010000:00010000:3.0:1788838194.237033:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838194.243840:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838194.244083:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116431232 00000100:00100000:1.0:1788838194.244093:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116431232 00002000:00100000:1.0:1788838194.244153:0:25104:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff8ff502708a80 x1875729116431232/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:95/0 lens 488/0 e 0 to 0 dl 1788838205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838194.244165:0:25104:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff502708a80 with x1875729116431232 ext(0->32767) 00002000:00010000:1.0:1788838194.244170:0:25104:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ff502708a80 00000100:00100000:1.0:1788838194.244204:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1005 00000100:00100000:1.0:1788838194.244214:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116431232:12345-192.168.203.30@tcp:3:md5sum.0 00000100:00100000:2.0:1788838194.249201:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116431232:12345-192.168.203.30@tcp:3:md5sum.0 Request processed in 4977us (5358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838194.249214:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1005 00002000:00100000:2.0:1788838194.249227:0:25104:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff8ff502708a80 x1875729116431232/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:95/0 lens 488/440 e 0 to 0 dl 1788838205 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788838194.249239:0:25104:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff502708a80 with x1875729116431232 ext(0->32767) 00002000:00010000:2.0:1788838194.249246:0:25104:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ff502708a80 00000100:00100000:0.0:1788838194.266415:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838194.266756:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116431360 00000100:00100000:1.0:1788838194.266766:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116431360 00002000:00100000:1.0:1788838194.266838:0:26090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff8ff50f38ca80 x1875729116431360/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:95/0 lens 488/0 e 0 to 0 dl 1788838205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838194.266848:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f38ca80 with x1875729116431360 ext(32768->1048575) 00002000:00010000:1.0:1788838194.266854:0:26090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ff50f38ca80 00000100:00100000:1.0:1788838194.266893:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1006 00000100:00100000:1.0:1788838194.266903:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116431360:12345-192.168.203.30@tcp:3:md5sum.0 00000100:00100000:0.0:1788838194.270395:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838194.270575:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116431488 00000100:00100000:3.0:1788838194.270585:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116431488 00002000:00100000:3.0:1788838194.270628:0:24879:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff8ff50f38c000 x1875729116431488/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:95/0 lens 488/0 e 0 to 0 dl 1788838205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838194.270639:0:24879:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f38c000 with x1875729116431488 ext(1048576->2097151) 00002000:00010000:3.0:1788838194.270644:0:24879:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f38c000 00000100:00100000:3.0:1788838194.270679:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1007 00000100:00100000:3.0:1788838194.270689:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116431488:12345-192.168.203.30@tcp:3:md5sum.0 00000100:00100000:1.0:1788838194.271846:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2404:x1875729116431360:12345-192.168.203.30@tcp:3:md5sum.0 Request processed in 4938us (5435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838194.271857:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1006 00002000:00100000:1.0:1788838194.271867:0:26090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff8ff50f38ca80 x1875729116431360/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:95/0 lens 488/440 e 0 to 0 dl 1788838205 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838194.271877:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f38ca80 with x1875729116431360 ext(32768->1048575) 00002000:00010000:1.0:1788838194.271882:0:26090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ff50f38ca80 00000100:00100000:1.0:1788838194.296608:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116431488:12345-192.168.203.30@tcp:3:md5sum.0 Request processed in 25896us (26198us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788838194.296626:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1007 00002000:00100000:1.0:1788838194.296643:0:24879:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff8ff50f38c000 x1875729116431488/t0(0) o3->fdcf066d-ff07-4b2e-96ab-52415ed6bf72@192.168.203.30@tcp:95/0 lens 488/440 e 0 to 0 dl 1788838205 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838194.296656:0:24879:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f38c000 with x1875729116431488 ext(1048576->2097151) 00002000:00010000:1.0:1788838194.296664:0:24879:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f38c000 00000100:00100000:0.0:1788838194.318458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838194.319011:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116431744 00000100:00100000:3.0:1788838194.319026:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116431744 00000100:00100000:3.0:1788838194.319095:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:3.0:1788838194.319109:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:70296:x1875729116431744:12345-192.168.203.30@tcp:35:md5sum.0 00000100:00100000:2.0:1788838194.324625:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:70296:x1875729116431744:12345-192.168.203.30@tcp:35:md5sum.0 Request processed in 5507us (6169us total) trans 115964116994 rc 0/0 00000100:00100000:2.0:1788838194.324639:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:0.0:1788838194.749341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838194.749405:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838194.749440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838194.749466:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838194.749492:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838194.749527:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116432384 00000100:00100000:0.0:1788838194.749540:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116432384 00000100:00100000:0.0:1788838194.749598:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116432256 00000100:00100000:0.0:1788838194.749600:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116432256 00000100:00100000:0.0:1788838194.749624:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2616 00000100:00100000:0.0:1788838194.749636:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116432384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838194.749678:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2617 00000100:00100000:1.0:1788838194.749728:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116432256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838194.749838:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116431872 00000100:00100000:2.0:1788838194.749845:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116431872 00000100:00100000:2.0:1788838194.749885:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:2.0:1788838194.749894:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116431872:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838194.749955:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116432128 00000100:00100000:3.0:1788838194.749960:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116432128 00000100:00100000:3.0:1788838194.749994:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116432000 00000100:00100000:3.0:1788838194.749998:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116432000 00000100:00100000:3.0:1788838194.750034:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1296 00000100:00100000:3.0:1788838194.750042:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116432128:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838194.750169:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2406:x1875729116432384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 535us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838194.750178:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2616 00000100:00100000:1.0:1788838194.752138:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116432256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2408us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838194.752153:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2617 00000100:00100000:1.0:1788838194.752216:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1297 00000100:00100000:1.0:1788838194.752231:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2406:x1875729116432000:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838194.752283:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2406:x1875729116432000:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 59us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838194.752290:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1297 00000100:00100000:2.0:1788838194.754003:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60822b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4043f878-3455-4729-a2a8-e06e8394cc00+10:2406:x1875729116431872:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 4092us (4661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838194.754023:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:3.0:1788838194.754782:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2406:x1875729116432128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 4734us (5370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838194.754811:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1296 00010000:00010000:3.0:1788838195.260989:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838195.581242:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838195.581267:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135087872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838195.581331:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838195.581416:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135087872 00000100:00100000:2.0:1788838195.581425:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135087872 00000100:00100000:2.0:1788838195.581482:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:2.0:1788838195.581492:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135087872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838195.581515:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838195.581563:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135087872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838195.581570:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:2.0:1788838195.581627:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff609dd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135087872:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788838195.581926:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838195.584880:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135088000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838195.584964:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838195.585193:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135088000 00000100:00100000:0.0:1788838195.585202:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135088000 00000100:00100000:0.0:1788838195.585264:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:0.0:1788838195.585274:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135088000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838195.585298:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838195.585343:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135088000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838195.585351:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:2.0:1788838195.585433:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135088000:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788838195.585535:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788838196.290185:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838197.312929:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838198.333286:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838198.653255:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135088128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838198.653344:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838198.653555:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135088128 00000100:00100000:1.0:1788838198.653564:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135088128 00000100:00100000:1.0:1788838198.653616:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4139 00000100:00100000:1.0:1788838198.653627:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135088128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838198.653663:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:1.0:1788838198.653725:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875729135088128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838198.653732:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4139 00000100:00100000:1.0:1788838198.653767:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135088512:0@lo:400:kworker.0 00000100:00100000:1.0:1788838198.653794:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838198.653834:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135089024:0@lo:400:kworker.0 00000100:00100000:1.0:1788838198.653858:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838198.653876:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135088256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838198.653899:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135089536:0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.653918:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838198.653939:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135088768:0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.653976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838198.653993:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135089280:0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.654016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838198.654036:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788838198.654246:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135088384:0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.654279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838198.654306:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838198.654314:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135088896:0@lo:400:kworker.0 00000100:00100000:1.0:1788838198.654335:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788838198.654343:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838198.654345:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135088640:0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.654368:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135089408:0@lo:400:kworker.0 00000100:00100000:1.0:1788838198.654377:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838198.654400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838198.654403:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135089152:0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.654439:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135088384 00000100:00100000:3.0:1788838198.654444:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135088384 00000100:00100000:0.0:1788838198.654735:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838198.654745:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff60925aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135089792:0@lo:400:kworker.0 00000100:00100000:0.0:1788838198.654774:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838198.654819:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135088256 00000100:00100000:0.0:1788838198.654823:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135088256 00000100:00100000:0.0:1788838198.654914:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135089408 00000100:00100000:0.0:1788838198.654917:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135089408 00000100:00100000:0.0:1788838198.655076:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4140 00000100:00100000:0.0:1788838198.655085:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135088256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788838198.655109:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445441536 avail 1299202048 00000100:00100000:0.0:1788838198.655145:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135088256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838198.655152:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4140 00000100:00100000:0.0:1788838198.655178:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4141 00000100:00100000:0.0:1788838198.655183:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135089408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838198.655211:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135089408:12345-0@lo:400:kworker.0 Request processed in 28us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838198.655216:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4141 00000100:00100000:0.0:1788838198.655232:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135088512 00000100:00100000:0.0:1788838198.655236:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135088512 00000100:00100000:1.0:1788838198.655272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838198.655293:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838198.655302:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135089664:0@lo:400:kworker.0 00000100:00100000:1.0:1788838198.655493:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838198.655785:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135089024 00000100:00100000:2.0:1788838198.655791:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135089024 00000100:00100000:2.0:1788838198.655846:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135089536 00000100:00100000:2.0:1788838198.655850:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135089536 00000100:00100000:2.0:1788838198.655871:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135089152 00000100:00100000:2.0:1788838198.655873:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135089152 00000100:00100000:2.0:1788838198.655889:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135089664 00000100:00100000:2.0:1788838198.655892:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135089664 00000100:00100000:2.0:1788838198.655909:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:2.0:1788838198.655916:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135089024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.655966:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135089024:12345-0@lo:400:kworker.0 Request processed in 49us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838198.655972:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:2.0:1788838198.655984:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1788838198.655989:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135089536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.656016:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135089536:12345-0@lo:400:kworker.0 Request processed in 26us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838198.656021:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1788838198.656030:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1788838198.656035:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135089152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.656074:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135089152:12345-0@lo:400:kworker.0 Request processed in 38us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838198.656090:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1788838198.656101:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1788838198.656106:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135089664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.656134:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135089664:12345-0@lo:400:kworker.0 Request processed in 28us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838198.656139:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1788838198.656198:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135088128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838198.656232:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135089408:0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.656243:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135088256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838198.656274:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135089664:0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.656285:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135089152:0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.656300:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135089024:0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.656388:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135089536:0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.656445:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788838198.656453:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff608228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135088384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.656490:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff608228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135088384:12345-0@lo:400:kworker.0 Request processed in 39us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838198.656496:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788838198.656532:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135088384:0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.656572:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135088768 00000100:00100000:2.0:1788838198.656576:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135088768 00000100:00100000:3.0:1788838198.657355:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135089280 00000100:00100000:3.0:1788838198.657362:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135089280 00000100:00100000:0.0:1788838198.658280:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135088896 00000100:00100000:0.0:1788838198.658288:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135088896 00000100:00100000:0.0:1788838198.658314:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135088640 00000100:00100000:0.0:1788838198.658317:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135088640 00000100:00100000:0.0:1788838198.658336:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135089792 00000100:00100000:0.0:1788838198.658339:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135089792 00000100:00100000:0.0:1788838198.658354:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:0.0:1788838198.658361:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135088512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838198.658715:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135088512:12345-0@lo:400:kworker.0 Request processed in 352us (4917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838198.658724:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:0.0:1788838198.658745:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1788838198.658753:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135088896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.658768:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:3.0:1788838198.658779:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135088640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838198.658825:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135088896:12345-0@lo:400:kworker.0 Request processed in 73us (4482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838198.658833:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:3.0:1788838198.658851:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135088640:12345-0@lo:400:kworker.0 Request processed in 74us (4472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838198.658852:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1788838198.658861:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135089792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.658871:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:3.0:1788838198.658902:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1788838198.658904:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135089792:12345-0@lo:400:kworker.0 Request processed in 42us (4125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838198.658911:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135089280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838198.658924:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1788838198.658949:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135089280:12345-0@lo:400:kworker.0 Request processed in 39us (4930us total) trans 0 rc 0/0 00000100:00080000:0.0:1788838198.658954:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838198.658956:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00080000:0.0:1788838198.658961:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838198.658966:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838198.658969:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838198.659189:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff60925aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135089792:0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.659229:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1788838198.659230:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135088896:0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.659244:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135088768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.659251:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135089280:0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.659288:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135088640:0@lo:400:kworker.0 00000100:00100000:3.0:1788838198.659298:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135088512:0@lo:400:kworker.0 00000100:00100000:2.0:1788838198.659320:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135088768:12345-0@lo:400:kworker.0 Request processed in 80us (5341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838198.659327:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1788838198.659426:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135088768:0@lo:400:kworker.0 00000100:00100000:1.0:1788838199.165186:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135089920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838199.165259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838199.165362:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135089920 00000100:00100000:3.0:1788838199.165371:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135089920 00000100:00100000:3.0:1788838199.165424:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:3.0:1788838199.165433:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135089920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838199.165462:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838199.165517:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135089920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838199.165524:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:1.0:1788838199.165702:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135089920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838199.166152:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838199.166165:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135090048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838199.166202:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838199.166284:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135090048 00000100:00100000:1.0:1788838199.166288:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135090048 00000100:00100000:1.0:1788838199.166328:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1788838199.166337:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135090048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838199.166355:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838199.166399:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135090048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838199.166406:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:0.0:1788838199.167552:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135090048:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788838199.357109:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788838199.682781:0:91027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00000100:00100000:2.0:1788838199.869233:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838199.869286:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838199.869323:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838199.869354:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838199.869385:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838199.869423:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116432768 00000100:00100000:2.0:1788838199.869438:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116432768 00000100:00100000:2.0:1788838199.869513:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116432640 00000100:00100000:2.0:1788838199.869516:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116432640 00000100:00100000:2.0:1788838199.869548:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1304 00000100:00100000:2.0:1788838199.869562:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116432768:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838199.869681:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116432768:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 123us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838199.869690:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1304 00000100:00100000:2.0:1788838199.869710:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1305 00000100:00100000:2.0:1788838199.869717:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:2407:x1875729116432640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838199.869752:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:2407:x1875729116432640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838199.869768:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1305 00000100:00100000:2.0:1788838199.869792:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116433024 00000100:00100000:2.0:1788838199.869831:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116433024 00000100:00100000:2.0:1788838199.869866:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116432896 00000100:00100000:2.0:1788838199.869870:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116432896 00000100:00100000:2.0:1788838199.869903:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2622 00000100:00100000:2.0:1788838199.869911:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116433024:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838199.869922:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2623 00000100:00100000:3.0:1788838199.869935:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116432896:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838199.869947:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2407:x1875729116433024:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838199.869955:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2622 00000100:00100000:3.0:1788838199.869976:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2407:x1875729116432896:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 43us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838199.869985:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2623 00000100:00080000:2.0:1788838199.869986:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838199.869992:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838199.869996:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838199.869998:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838199.870239:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116432512 00000100:00100000:1.0:1788838199.870244:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116432512 00000100:00100000:1.0:1788838199.870286:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:1.0:1788838199.870294:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2407:x1875729116432512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838199.870335:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60822b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4043f878-3455-4729-a2a8-e06e8394cc00+10:2407:x1875729116432512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 42us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838199.870350:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00000001:02000400:0.0:1788838199.923333:0:91852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 23:29:59 (1788838199) 00000100:00100000:2.0:1788838199.976341:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838199.976461:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116433280 00000100:00100000:1.0:1788838199.976477:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116433280 00000100:00100000:3.0:1788838199.976767:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1291 00000100:00100000:3.0:1788838199.976840:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:70880:x1875729116433280:12345-192.168.203.30@tcp:36:mkdir.0 00000100:00100000:3.0:1788838199.977023:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:66253:1875729135090176:0@lo:900:mdt00_000.0 00000100:00100000:3.0:1788838199.977094:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838199.977132:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6102bca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838199.977157:0:66265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135090176 00000100:00100000:3.0:1788838199.977161:0:66265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135090176 00000100:00100000:3.0:1788838199.977197:0:66265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788838199.977206:0:66265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640d2d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66253:x1875729135090176:12345-0@lo:900:mdt00_000.0 00000100:00100000:3.0:1788838199.977266:0:66265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640d2d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:66253:x1875729135090176:12345-0@lo:900:mdt00_000.0 Request processed in 60us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838199.977275:0:66265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788838199.977302:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:66253:1875729135090176:0@lo:900:mdt00_000.0 00000100:00100000:0.0:1788838199.977394:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135090304:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.977433:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838199.977453:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff614983f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838199.977472:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135090304 00000100:00100000:0.0:1788838199.977477:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135090304 00000100:00100000:0.0:1788838199.977514:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4142 00000100:00100000:0.0:1788838199.977521:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66253:x1875729135090304:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.978041:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66253:x1875729135090304:12345-0@lo:1000:mdt00_000.0 Request processed in 511us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838199.978058:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4142 00000100:00100000:3.0:1788838199.978069:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135090304:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788838199.978161:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135090432:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788838199.978205:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838199.978233:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6102bc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788838199.978376:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135090432 00000100:00100000:2.0:1788838199.978382:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135090432 00000100:00100000:2.0:1788838199.978428:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4143 00000100:00100000:2.0:1788838199.978436:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66253:x1875729135090432:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788838199.978718:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66253:x1875729135090432:12345-0@lo:1000:mdt00_000.0 Request processed in 281us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838199.978727:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4143 00000100:00100000:3.0:1788838199.978778:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135090432:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788838199.979477:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135090560:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788838199.979536:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838199.980619:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6102bc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838199.981019:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135090560 00000100:00100000:1.0:1788838199.981029:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135090560 00000100:00100000:1.0:1788838199.981106:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4144 00000100:00100000:1.0:1788838199.981117:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66253:x1875729135090560:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788838199.981297:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66253:x1875729135090560:12345-0@lo:1000:mdt00_000.0 Request processed in 182us (1762us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838199.981306:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4144 00000100:00100000:3.0:1788838199.981438:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135090560:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788838199.981527:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838199.981539:0:66253:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838199.981572:0:66253:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838199.981592:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135090688:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1788838199.981635:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838199.981655:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6102bc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838199.981735:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135090688 00000100:00100000:1.0:1788838199.981741:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135090688 00000100:00100000:1.0:1788838199.981852:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4145 00000100:00100000:1.0:1788838199.981863:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66253:x1875729135090688:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1788838199.981877:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838199.981902:0:8472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccc9345 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc933e expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838199.981936:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd6a expref: 8 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838199.981947:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccc9345 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc933e expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838199.981979:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd6a expref: 8 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838199.982012:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd6a expref: 8 pid: 67312 timeout: 3694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838199.982024:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504b20000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8472:1875729135090816:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788838199.982108:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff604e51840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838199.987639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838199.987754:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116433408 00000100:00100000:2.0:1788838199.987767:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116433408 00010000:00010000:2.0:1788838199.987868:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd6a expref: 9 pid: 67312 timeout: 3694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838199.987941:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2547 00000100:00100000:2.0:1788838199.987954:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:2404:x1875729116433408:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838199.987974:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838199.987983:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd6a expref: 9 pid: 67312 timeout: 3694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988000:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd6a expref: 9 pid: 67312 timeout: 3694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988034:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:2.0:1788838199.988043:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccc9345 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc933e expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988057:0:6532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccc9345 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x88da08396ccc933e expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988067:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccc9345 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x88da08396ccc933e expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988114:0:6532:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccc9345 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc933e expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838199.988134:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6532:1875729135090944:0@lo:105: 00000100:00100000:2.0:1788838199.988206:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838199.988263:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6149fc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788838199.988301:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135090944 00000100:00100000:2.0:1788838199.988307:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135090944 00000100:00100000:2.0:1788838199.988345:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788838199.988355:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6532:x1875729135090944:12345-0@lo:105: 00010000:00010000:2.0:1788838199.988369:0:6530:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988380:0:6530:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988391:0:6530:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988400:0:6530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988407:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988417:0:6530:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838199.988435:0:6530:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8ff5059a5600) 00000100:00100000:2.0:1788838199.988488:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6532:x1875729135090944:12345-0@lo:105: Request processed in 134us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838199.988496:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788838199.988550:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6532:1875729135090944:0@lo:105: 00010000:00010000:2.0:1788838199.988572:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838199.988630:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:2404:x1875729116433408:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 679us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838199.988638:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2547 00010000:00010000:3.0:1788838199.989083:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc92c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd6a expref: 8 pid: 67312 timeout: 3694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838199.989103:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504b20000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8472:1875729135090816:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788838199.989129:0:8472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccc9345 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc933e expref: 7 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838199.989140:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:3.0:1788838199.989143:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838199.989146:0:8472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712dc00, rc 0) 00000100:00100000:3.0:1788838199.989204:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66253:x1875729135090688:12345-0@lo:101:mdt00_000.0 Request processed in 7344us (7569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838199.989212:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4145 00000100:00100000:2.0:1788838199.989752:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff604231500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135090688:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788838199.989777:0:66253:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838199.989986:0:66253:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788838199.990103:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838199.990113:0:66253:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838199.990126:0:66253:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838199.990167:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2af100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091072:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1788838199.990229:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838199.990313:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6102bc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838199.990491:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135091072 00000100:00100000:1.0:1788838199.990500:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135091072 00000100:00100000:0.0:1788838199.990732:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4146 00000100:00100000:0.0:1788838199.990747:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66253:x1875729135091072:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788838199.990778:0:23765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838199.990842:0:23765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4a00/0x88da08396ccc9353 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc934c expref: -99 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838199.990871:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4a00/0x88da08396ccc9353 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc934c expref: 8 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838199.990886:0:23765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4a00/0x88da08396ccc9353 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc934c expref: 8 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838199.990896:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8ff608f3ca00) 00010000:00010000:0.0:1788838199.990899:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838199.990902:0:23765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50b8e4a00, rc 0) 00000100:00100000:0.0:1788838199.990953:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091072:12345-0@lo:101:mdt00_000.0 Request processed in 211us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838199.990960:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4146 00000100:00100000:0.0:1788838199.991003:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2af100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091072:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788838199.991019:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838199.991030:0:66253:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838199.991052:0:66253:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1788838199.991100:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2af100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091200:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.991135:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838199.991154:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6149830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838199.991179:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135091200 00000100:00100000:0.0:1788838199.991183:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135091200 00000100:00100000:0.0:1788838199.991216:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4147 00000100:00100000:0.0:1788838199.991223:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.991292:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091200:12345-0@lo:1000:mdt00_000.0 Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838199.991299:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4147 00000100:00100000:0.0:1788838199.991332:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2af100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091200:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.991375:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2af100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091328:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.991412:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838199.991427:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6149830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838199.991438:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135091328 00000100:00100000:0.0:1788838199.991442:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135091328 00000100:00100000:0.0:1788838199.991462:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4148 00000100:00100000:0.0:1788838199.991467:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.991570:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091328:12345-0@lo:1000:mdt00_000.0 Request processed in 102us (157us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788838199.991576:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4148 00000100:00100000:0.0:1788838199.991603:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2af100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091328:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.991695:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091456:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.991721:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838199.991735:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6149830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838199.991746:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135091456 00000100:00100000:0.0:1788838199.991750:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135091456 00000100:00100000:0.0:1788838199.991777:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4149 00000100:00100000:0.0:1788838199.991784:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091456:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.991879:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091456:12345-0@lo:1000:mdt00_000.0 Request processed in 95us (157us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788838199.991887:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4149 00000100:00100000:0.0:1788838199.991913:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091456:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.991972:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091584:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.991996:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838199.992009:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6149830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838199.992020:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135091584 00000100:00100000:0.0:1788838199.992023:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135091584 00000100:00100000:0.0:1788838199.992046:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4150 00000100:00100000:0.0:1788838199.992052:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.992101:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091584:12345-0@lo:1000:mdt00_000.0 Request processed in 49us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838199.992108:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4150 00000100:00100000:0.0:1788838199.992133:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091584:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.992175:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091712:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.992200:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838199.992214:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6149830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838199.992224:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135091712 00000100:00100000:0.0:1788838199.992227:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135091712 00000100:00100000:0.0:1788838199.992247:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4151 00000100:00100000:0.0:1788838199.992253:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091712:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.992314:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091712:12345-0@lo:1000:mdt00_000.0 Request processed in 60us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838199.992320:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4151 00000100:00100000:0.0:1788838199.992357:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091712:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.992398:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091840:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.992422:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838199.992436:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6149830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838199.992448:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135091840 00000100:00100000:0.0:1788838199.992452:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135091840 00000100:00100000:0.0:1788838199.992475:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4152 00000100:00100000:0.0:1788838199.992481:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788838199.992536:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66253:x1875729135091840:12345-0@lo:1000:mdt00_000.0 Request processed in 55us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838199.992543:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4152 00000100:00100000:0.0:1788838199.992568:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135091840:0@lo:1000:mdt00_000.0 00000040:00080000:0.0:1788838199.995568:0:66253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].5, 1000 off40872 00000040:00080000:0.0:1788838199.996088:0:66253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].4, 1152 off39352 00000004:00080000:0.0:1788838199.996102:0:66253:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8ff614983a80 with version 12 00000004:00080000:3.0:1788838199.996281:0:75683:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8ff626ae9780 version 12 rpc_version 12 00000020:00100000:3.0:1788838199.996332:0:75683:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788838199.996345:0:75683:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8ff627d2bb80 x1875729135092096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838199.996375:0:75683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff627d2bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135092096:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788838199.996475:0:75683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838199.996522:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6102bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788838199.996587:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135092096 00000100:00100000:0.0:1788838199.996597:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135092096 00000100:00100000:0.0:1788838199.996672:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4153 00000100:00100000:0.0:1788838199.996684:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75683:x1875729135092096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788838200.012460:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75683:x1875729135092096:12345-0@lo:1000:osp_up0-1.0 Request processed in 15771us (15978us total) trans 115964116995 rc 0/0 00000100:00100000:3.0:1788838200.012476:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4153 00000100:00100000:1.0:1788838200.012569:0:75683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff627d2bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135092096:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1788838200.012641:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.012669:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.012738:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838200.012760:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b806d21b reply state 00000000802499a7 transno 77309411438 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.012772:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.012792:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:3.0:1788838200.012795:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838200.012828:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788838200.012834:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00000004:00080000:3.0:1788838200.012844:0:66253:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788838200.012856:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.012866:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.012874:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.012895:0:66253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788838200.012900:0:66253:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788838200.012912:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838200.012921:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.012930:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5600 already unused, calling callback (ffffffffc19f7ee0) 00010000:00010000:3.0:1788838200.012935:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838200.012945:0:6534:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.012987:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.012999:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838200.013027:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.013035:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5600/0x88da08396ccc933e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9345 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.013055:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838200.013056:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838200.013058:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838200.013784:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135092224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838200.014116:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788838200.014233:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.014252:0:66253:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838200.014412:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135092224 00000100:00100000:2.0:1788838200.014421:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70880:x1875729116433280:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 37619us (38086us total) trans 77309411438 rc 0/0 00000100:00100000:1.0:1788838200.014424:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135092224 00000100:00100000:2.0:1788838200.014438:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1291 00000100:00100000:1.0:1788838200.014490:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1788838200.014502:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3644:x1875729135092224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838200.014517:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838200.014542:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccc9345 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc933e expref: 9 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838200.014562:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff63f831800) 00010000:00010000:1.0:1788838200.014571:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838200.014633:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3644:x1875729135092224:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838200.014645:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1788838200.015240:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135092224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838200.037759:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838200.037893:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116433536 00000100:00100000:2.0:1788838200.037909:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116433536 00000100:00100000:2.0:1788838200.037984:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1292 00000100:00100000:2.0:1788838200.037995:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70881:x1875729116433536:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838200.038022:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838200.038049:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9361 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd86 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.038141:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc9368 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.038178:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc9368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.038193:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc9368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838200.038254:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838200.038259:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838200.038284:0:66255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc9368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.038314:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9361 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd86 expref: 10 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.038337:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc9368 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd86 expref: 9 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.038345:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c700) 00010000:00010000:2.0:1788838200.038348:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838200.038352:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8600, rc 0) 00000100:00100000:2.0:1788838200.038434:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:70881:x1875729116433536:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 440us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838200.038442:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1292 00000100:00100000:3.0:1788838200.042057:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838200.042462:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116433664 00000100:00100000:2.0:1788838200.042477:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116433664 00000100:00100000:2.0:1788838200.042563:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1293 00000100:00100000:2.0:1788838200.042576:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:70881:x1875729116433664:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838200.042603:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838200.042639:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc936f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd8d expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.042741:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9376 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.042759:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.042775:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.042790:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.042826:0:75504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4a00/0x88da08396ccc9353 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc934c expref: 7 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.042836:0:75504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.042881:0:75504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4a00/0x88da08396ccc9353 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc934c expref: 7 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838200.042900:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:75504:1875729135092352:0@lo:104: 00000100:00100000:2.0:1788838200.042971:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838200.043023:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff607ecbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838200.043104:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135092352 00000100:00100000:3.0:1788838200.043109:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135092352 00000100:00100000:3.0:1788838200.043159:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788838200.043169:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff604231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:75504:x1875729135092352:12345-0@lo:104: 00010000:00010000:3.0:1788838200.043186:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.043252:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788838200.043258:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff604231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:75504:x1875729135092352:12345-0@lo:104: Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838200.043266:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00010000:3.0:1788838200.043293:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838200.043300:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.043324:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5c00 already unused, calling callback (ffffffffc19f7ee0) 00010000:00010000:3.0:1788838200.043330:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838200.043340:0:6535:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.043373:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.043381:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838200.043407:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.043414:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a5c00/0x88da08396ccc934c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9353 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.043434:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838200.043436:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838200.043438:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838200.043452:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135092480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838200.043486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838200.043531:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135092480 00000100:00100000:3.0:1788838200.043535:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135092480 00010000:00010000:3.0:1788838200.043552:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4a00/0x88da08396ccc9353 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x88da08396ccc934c expref: 8 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838200.043590:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1788838200.043597:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3645:x1875729135092480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838200.043609:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788838200.044074:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:75504:1875729135092352:0@lo:104: 00010000:00010000:3.0:1788838200.044098:0:75504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788838200.046289:0:91027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00010000:00010000:1.0:1788838200.046441:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4a00/0x88da08396ccc9353 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc934c expref: 7 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838200.046475:0:26219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8ff608f3ca00) 00010000:00010000:1.0:1788838200.046481:0:26219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838200.046490:0:26219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838200.046498:0:26219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838200.046576:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838200.046695:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135092480:12345-0@lo:103:ldlm_bl.0 Request processed in 3095us (3205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838200.046706:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:2.0:1788838200.047219:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135092480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838200.049378:0:75504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.049399:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838200.049586:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:75504:1875729135092608:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788838200.050245:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838200.050848:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6102bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788838200.055401:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135092608 00000100:00100000:0.0:1788838200.055421:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135092608 00000100:00100000:0.0:1788838200.055539:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4154 00000100:00100000:0.0:1788838200.055553:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:75504:x1875729135092608:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838200.055744:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:75504:x1875729135092608:12345-0@lo:1000:mdt00_004.0 Request processed in 195us (5503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838200.055752:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4154 00000100:00100000:2.0:1788838200.056326:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640e55180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:75504:1875729135092608:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788838200.056419:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9384 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056449:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9384 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056466:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9384 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838200.056499:0:75504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9384 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056515:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056523:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9376 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056531:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9376 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056540:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838200.056545:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9376 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056555:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9376 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056571:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c700) 00010000:00010000:2.0:1788838200.056574:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838200.056579:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056585:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccc9376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056607:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056613:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056619:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056625:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838200.056628:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056635:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056644:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8ff608f3ca00) 00010000:00010000:2.0:1788838200.056646:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838200.056650:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056656:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc937d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056720:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8400/0x88da08396ccc936f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd8d expref: 11 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056738:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9384 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd8d expref: 10 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.056759:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff61254cb00) 00010000:00010000:2.0:1788838200.056762:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788838200.056765:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9e00, rc 0) 00000100:00100000:2.0:1788838200.056868:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:70881:x1875729116433664:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 14295us (14825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838200.056877:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1293 00000100:00100000:1.0:1788838200.064997:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838200.065063:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116433792 00000100:00100000:1.0:1788838200.065076:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116433792 00000100:00100000:2.0:1788838200.065300:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1294 00000100:00100000:2.0:1788838200.065313:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:70881:x1875729116433792:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838200.065344:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838200.065367:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8800/0x88da08396ccc938b lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd94 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.065450:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031c00/0x88da08396ccc9392 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.065464:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031c00/0x88da08396ccc9392 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.065473:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031c00/0x88da08396ccc9392 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838200.065528:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00000004:00200000:2.0:1788838200.065531:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788838200.065569:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8800/0x88da08396ccc938b lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd94 expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.065588:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031c00/0x88da08396ccc9392 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd94 expref: 9 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.065604:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:2.0:1788838200.065607:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788838200.065611:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600031c00, rc 0) 00000100:00100000:2.0:1788838200.065695:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:70881:x1875729116433792:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 385us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838200.065703:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1294 00000100:00100000:1.0:1788838200.067787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838200.068264:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116433920 00000100:00100000:2.0:1788838200.068277:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116433920 00000100:00100000:2.0:1788838200.068486:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1295 00000100:00100000:2.0:1788838200.068500:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:70881:x1875729116433920:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838200.068531:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838200.068556:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031800/0x88da08396ccc9399 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cd9b expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068637:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068654:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068678:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068695:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93a7 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068702:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93a7 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068720:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93a7 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068776:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068784:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068790:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068817:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068824:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838200.068830:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068838:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068852:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:2.0:1788838200.068856:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838200.068861:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068867:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc93a0 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068879:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93a7 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068890:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93a7 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068896:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93a7 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068901:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838200.068905:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93a7 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068911:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93a7 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068919:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xf7117594 (ffff8ff61254c800) 00010000:00010000:2.0:1788838200.068921:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838200.068923:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93a7 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068929:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93a7 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068969:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031800/0x88da08396ccc9399 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd9b expref: 10 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.068979:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:2.0:1788838200.068982:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838200.068986:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031800/0x88da08396ccc9399 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd9b expref: 10 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.069005:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600031800, rc 0) 00000100:00100000:2.0:1788838200.069079:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:70881:x1875729116433920:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 583us (1304us total) trans 0 rc 301/301 00000100:00100000:2.0:1788838200.069086:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1295 00000100:00100000:2.0:1788838200.077551:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838200.077643:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116434048 00000100:00100000:3.0:1788838200.077655:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116434048 00000100:00100000:3.0:1788838200.077771:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1296 00000100:00100000:3.0:1788838200.077782:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:70881:x1875729116434048:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788838200.077834:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838200.077859:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93ae lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cda2 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.077947:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.077974:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.077989:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078007:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93bc lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078014:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93bc lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078021:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93bc lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078079:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078087:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078094:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078102:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078108:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838200.078113:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078121:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078155:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:3.0:1788838200.078159:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838200.078164:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078171:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93b5 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078187:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93bc lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078194:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93bc lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078200:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93bc lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078206:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838200.078209:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93bc lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078214:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93bc lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078222:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xf7117594 (ffff8ff6055e2000) 00010000:00010000:3.0:1788838200.078225:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838200.078227:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93bc lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078233:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93bc lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078287:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93ae lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cda2 expref: 10 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078299:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:3.0:1788838200.078301:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838200.078304:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93ae lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cda2 expref: 10 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.078313:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5c00, rc 0) 00000100:00100000:3.0:1788838200.078403:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:70881:x1875729116434048:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 621us (865us total) trans 0 rc 301/301 00000100:00100000:3.0:1788838200.078410:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1296 00000100:00100000:2.0:1788838200.089521:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838200.089577:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116434176 00000100:00100000:2.0:1788838200.089589:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116434176 00000100:00100000:2.0:1788838200.089672:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1297 00000100:00100000:2.0:1788838200.089685:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+9:70881:x1875729116434176:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838200.089711:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838200.089741:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031800/0x88da08396ccc93c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cda9 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.089864:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93ca lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.089883:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93ca lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.089899:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93ca lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838200.089958:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00000004:00200000:2.0:1788838200.089963:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838200.089987:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93ca lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.090154:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031800/0x88da08396ccc93c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cda9 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.090181:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93ca lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cda9 expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.090192:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:2.0:1788838200.090195:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788838200.090200:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030400, rc 0) 00000100:00100000:2.0:1788838200.090269:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:70881:x1875729116434176:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 587us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838200.090278:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1297 00000100:00100000:3.0:1788838200.097544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838200.103075:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116434432 00000100:00100000:1.0:1788838200.103096:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116434432 00000100:00100000:1.0:1788838200.104343:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1298 00000100:00100000:1.0:1788838200.104369:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:70881:x1875729116434432:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788838200.104401:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838200.104438:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50712ca00/0x88da08396ccc93d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cdb0 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838200.104589:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1788838200.104733:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50712ca00/0x88da08396ccc93d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdb0 expref: 12 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838200.104763:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff612676f00) 00010000:00010000:1.0:1788838200.104766:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788838200.104772:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50712ca00/0x88da08396ccc93d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdb0 expref: 12 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838200.104823:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712ca00, rc 0) 00000100:00100000:1.0:1788838200.104922:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:70881:x1875729116434432:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 565us (7392us total) trans 77309411439 rc 301/301 00000100:00100000:1.0:1788838200.104931:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1298 00000100:00100000:2.0:1788838200.118551:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838200.118664:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116434688 00000100:00100000:3.0:1788838200.118679:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116434688 00000100:00100000:3.0:1788838200.118824:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1299 00000100:00100000:3.0:1788838200.118839:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60876c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:70881:x1875729116434688:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1788838200.118945:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838200.118983:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc93ca lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cda9 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119008:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:3.0:1788838200.119013:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838200.119097:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93df lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119113:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93df lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119148:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93df lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119168:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119175:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119182:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119878:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119893:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119902:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838200.119919:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000695c8ffb reply state 000000007361bbd1 transno 77309411440 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119931:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119939:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:3.0:1788838200.119942:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838200.119947:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788838200.119954:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00010000:00010000:3.0:1788838200.119972:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93df lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119980:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93df lrc: 2/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119988:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93df lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.119994:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838200.119999:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93df lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.120008:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93df lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.120019:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:3.0:1788838200.120022:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838200.120025:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93df lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.120032:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5c00/0x88da08396ccc93df lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838200.120043:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000695c8ffb reply state 000000007361bbd1 transno 77309411440 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.120052:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.120058:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xf7117594 (ffff8ff6055e2000) 00010000:00010000:3.0:1788838200.120061:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838200.120069:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788838200.120191:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60876c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:70881:x1875729116434688:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 1351us (1651us total) trans 77309411440 rc 0/0 00000100:00100000:3.0:1788838200.120200:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1299 00000100:00100000:3.0:1788838200.125964:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838200.126085:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116434944 00000100:00100000:1.0:1788838200.126099:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116434944 00000100:00100000:1.0:1788838200.126355:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 231 00000100:00100000:1.0:1788838200.126370:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+12:70881:x1875729116434944:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1788838200.127351:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:70881:x1875729116434944:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 977us (1397us total) trans 77309411441 rc 0/0 00000100:00100000:1.0:1788838200.127362:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 231 00000100:00100000:1.0:1788838200.174349:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838200.174409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838200.174444:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116435328 00000100:00100000:1.0:1788838200.174455:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838200.174458:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116435328 00000100:00100000:1.0:1788838200.174503:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838200.174578:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116435712 00000100:00100000:3.0:1788838200.174583:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116435712 00000100:00100000:3.0:1788838200.174630:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5959 00000100:00100000:3.0:1788838200.174641:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+7:2403:x1875729116435712:12345-192.168.203.30@tcp:9:umount.0 00000020:00000080:3.0:1788838200.174692:0:8463:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8cd1 00000020:00010000:3.0:1788838200.174703:0:8463:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff608210800: total 0 00000100:00080000:3.0:1788838200.174708:0:8463:0:(import.c:65:import_set_state_nolock()) ffff8ff5031c7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788838200.174766:0:8463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:3.0:1788838200.175043:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+5:2403:x1875729116435712:12345-192.168.203.30@tcp:9:umount.0 Request processed in 403us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838200.175052:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5959 00000020:00010000:3.0:1788838200.175083:0:15289:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff608210800: total 0 00010000:00010000:3.0:1788838200.175111:0:15289:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff608210800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788838200.175194:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055a03679/0x88da08396ccc8e13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd24 expref: 4 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.175236:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036d84314/0x88da08396ccc8e21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd32 expref: 3 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.175253:0:15289:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff608210800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788838200.175269:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838200.175272:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838200.175273:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838200.176318:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116435200 00000100:00100000:1.0:1788838200.176331:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116435200 00000100:00100000:1.0:1788838200.176381:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116435072 00000100:00100000:1.0:1788838200.176385:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116435072 00000100:00100000:1.0:1788838200.176417:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 720 00000100:00100000:1.0:1788838200.176426:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4043f878-3455-4729-a2a8-e06e8394cc00+12:2404:x1875729116435328:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838200.176455:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838200.176475:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9600/0x88da08396ccc909e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd4e expref: 12 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838200.176489:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838200.176514:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 721 00000100:00100000:3.0:1788838200.176525:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4043f878-3455-4729-a2a8-e06e8394cc00+11:2407:x1875729116435200:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788838200.176537:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788838200.176548:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4043f878-3455-4729-a2a8-e06e8394cc00+11:2404:x1875729116435328:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 122us (2211us total) trans 0 rc 0/0 00010000:00010000:3.0:1788838200.176551:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8000/0x88da08396ccc90ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd5c expref: 11 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838200.176565:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 720 00010000:00010000:3.0:1788838200.176569:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838200.176590:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 722 00000100:00100000:1.0:1788838200.176599:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4043f878-3455-4729-a2a8-e06e8394cc00+9:2407:x1875729116435072:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838200.176609:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838200.176619:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc90a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd55 expref: 9 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838200.176628:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838200.176649:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4043f878-3455-4729-a2a8-e06e8394cc00+8:2407:x1875729116435072:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 51us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838200.176667:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 722 00000100:00100000:3.0:1788838200.176888:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4043f878-3455-4729-a2a8-e06e8394cc00+7:2407:x1875729116435200:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 354us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838200.176902:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 721 00000100:00100000:1.0:1788838200.180325:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838200.183109:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116435968 00000100:00100000:3.0:1788838200.183259:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116435968 00000100:00100000:3.0:1788838200.183348:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5960 00000100:00100000:3.0:1788838200.183363:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+6:2403:x1875729116435968:12345-192.168.203.30@tcp:9:umount.0 00000020:00000080:3.0:1788838200.183408:0:26213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8cca 00000020:00010000:3.0:1788838200.183420:0:26213:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff608210000: total 0 00000100:00080000:3.0:1788838200.183426:0:26213:0:(import.c:65:import_set_state_nolock()) ffff8ff608211000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788838200.183496:0:26213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000020:00010000:1.0:1788838200.183679:0:63563:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff608210000: total 0 00010000:00010000:1.0:1788838200.183685:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838200.184346:0:63563:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff608210000, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1788838200.184417:0:63563:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1788838200.184423:0:63563:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb atime from disk: 0 -> 1788838146 00002000:00010000:1.0:1788838200.184426:0:63563:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1788838200.184475:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381c7203/0x88da08396ccc8e1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd2b expref: 5 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838200.184533:0:63563:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff608210000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788838200.185370:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838200.185375:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838200.185378:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838200.185419:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+2:2403:x1875729116435968:12345-192.168.203.30@tcp:9:umount.0 Request processed in 2055us (5106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838200.185432:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5960 00000100:00100000:0.0:1788838200.199000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838200.199428:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116436480 00000100:00100000:1.0:1788838200.199445:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116436480 00000100:00100000:1.0:1788838200.199542:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1300 00000100:00100000:1.0:1788838200.199560:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+10:2403:x1875729116436480:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:1.0:1788838200.199620:0:66253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f24 00000020:00010000:1.0:1788838200.199640:0:66253:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff6048e2000: total 0 00000100:00080000:1.0:1788838200.199646:0:66253:0:(import.c:65:import_set_state_nolock()) ffff8ff632f54000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788838200.199693:0:66253:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116995 00000100:00100000:1.0:1788838200.199956:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+8:2403:x1875729116436480:12345-192.168.203.30@tcp:39:umount.0 Request processed in 401us (976us total) trans 115964116996 rc 0/0 00000100:00100000:1.0:1788838200.199965:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1300 00000020:00010000:0.0:1788838200.200653:0:6534:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff6048e2000: total 0 00010000:00010000:0.0:1788838200.200738:0:6534:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff6048e2000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788838200.200781:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c700) 00010000:00010000:0.0:1788838200.200786:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788838200.200826:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8600/0x88da08396ccc9368 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd86 expref: 7 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.200857:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff6055e2400) 00010000:00010000:0.0:1788838200.200859:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838200.200865:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9330 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd7f expref: 6 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.200880:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff61254cb00) 00010000:00010000:0.0:1788838200.200882:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838200.200886:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9384 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd8d expref: 5 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.200903:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8ff6055e2400) 00010000:00010000:0.0:1788838200.200906:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788838200.200910:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9107 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd1d expref: 4 pid: 91059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.200925:0:6534:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff6048e2000, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1788838200.200938:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838200.200941:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838200.200943:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838200.214631:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838200.214867:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116436736 00000100:00100000:1.0:1788838200.214881:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116436736 00000100:00100000:0.0:1788838200.215004:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1301 00000100:00100000:0.0:1788838200.215023:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+13:2403:x1875729116436736:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:0.0:1788838200.215111:0:66254:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc3c2e 00000020:00010000:0.0:1788838200.215131:0:66254:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff605443000: total 0 00000100:00080000:0.0:1788838200.215137:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff5031c2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788838200.215205:0:66254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411441 00000100:00100000:0.0:1788838200.215415:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fdcf066d-ff07-4b2e-96ab-52415ed6bf72+11:2403:x1875729116436736:12345-192.168.203.30@tcp:39:umount.0 Request processed in 398us (799us total) trans 77309411442 rc 0/0 00000100:00100000:0.0:1788838200.215425:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1301 00010000:00010000:0.0:1788838200.215460:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215473:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215480:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215488:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838200.215493:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215502:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215523:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xf7117594 (ffff8ff6055e2000) 00010000:00010000:0.0:1788838200.215527:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838200.215533:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215540:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc93e6 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215584:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215592:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215600:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215606:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838200.215610:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215618:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215629:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:0.0:1788838200.215632:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838200.215635:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.215643:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5600/0x88da08396ccc93ed lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.215970:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.215979:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.215984:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.215990:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838200.215993:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.216010:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.216021:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:2.0:1788838200.216024:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838200.216027:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838200.216033:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc935a lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1788838200.216244:0:6535:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff605443000: total 0 00010000:00010000:3.0:1788838200.216328:0:6535:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff605443000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788838200.216361:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff64216e000) 00010000:00010000:3.0:1788838200.216364:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788838200.216371:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031c00/0x88da08396ccc9392 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd94 expref: 8 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838200.216406:0:6535:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff605443000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788838200.216424:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838200.216426:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838200.216428:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838200.246999:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838200.247227:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116436992 00000100:00100000:2.0:1788838200.247242:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116436992 00000100:00100000:2.0:1788838200.247319:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:2.0:1788838200.247332:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a55ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+7:2403:x1875729116436992:12345-192.168.203.30@tcp:251:umount.0 00000020:00000080:2.0:1788838200.247542:0:91036:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8eb4 00000020:00010000:2.0:1788838200.247553:0:91036:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff503f8d800: total 0 00000100:00080000:2.0:1788838200.247558:0:91036:0:(import.c:65:import_set_state_nolock()) ffff8ff503f8e800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788838200.247669:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a55ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4043f878-3455-4729-a2a8-e06e8394cc00+3:2403:x1875729116436992:12345-192.168.203.30@tcp:251:umount.0 Request processed in 329us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838200.247679:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00000020:00010000:0.0:1788838200.247919:0:15289:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff503f8d800: total 0 00010000:00010000:0.0:1788838200.247998:0:15289:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff503f8d800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788838200.248639:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc90b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cd63 expref: 2 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838200.248757:0:15289:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff503f8d800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788838200.248850:0:15289:0:(genops.c:885:class_export_put()) final put ffff8ff503f8d800/4043f878-3455-4729-a2a8-e06e8394cc00 00010000:00010000:0.0:1788838200.248868:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838200.248870:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838200.248873:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788838200.249530:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503f8d800/4043f878-3455-4729-a2a8-e06e8394cc00 for MGS 00000020:00000080:2.0:1788838200.250062:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff503f8e800 for MGS 00010000:00010000:3.0:1788838200.381224:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838200.704199:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135092736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838200.704310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838200.704382:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838200.704392:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135092864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838200.704443:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838200.704482:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135092736 00000100:00100000:2.0:1788838200.704492:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135092736 00000100:00100000:2.0:1788838200.704552:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135092864 00000100:00100000:2.0:1788838200.704774:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135092864 00000100:00100000:2.0:1788838200.704841:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:2.0:1788838200.704853:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135092736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838200.704883:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838200.704951:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135092736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838200.704960:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:2.0:1788838200.704980:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:2.0:1788838200.704986:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135092864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838200.704997:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838200.705029:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135092864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838200.705037:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00080000:2.0:1788838200.705060:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838200.705064:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838200.705074:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135092736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838200.705094:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135092864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838201.278143:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.279113:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116437120 00000100:00100000:2.0:1788838201.279141:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116437120 00000100:00100000:2.0:1788838201.279206:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:2.0:1788838201.279216:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1875729116437120:12345-192.168.203.30@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788838201.279257:0:91032:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp t0 exp 0000000000000000 cur 3595 last 0 00000020:00000080:2.0:1788838201.279409:0:91032:0:(genops.c:1385:class_connect()) connect: client 2af93169-6705-472b-b7ff-fd7cc5c04782, cookie 0x88da08396ccc93f4 00000100:00080000:2.0:1788838201.279484:0:91032:0:(import.c:65:import_set_state_nolock()) ffff8ff608eb6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838201.279580:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+5:2403:x1875729116437120:12345-192.168.203.30@tcp:250:mount.lustre.0 Request processed in 364us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838201.279590:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:3.0:1788838201.291489:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838201.291535:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116437248 00000100:00100000:3.0:1788838201.291547:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116437248 00000100:00100000:3.0:1788838201.291609:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:3.0:1788838201.291619:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a55dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+5:70912:x1875729116437248:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788838201.291641:0:91034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838201.291675:0:91034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc93fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cdc5 expref: -99 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838201.291711:0:91034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc93fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdc5 expref: 6 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838201.291724:0:91034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc93fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdc5 expref: 6 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838201.291736:0:91034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5000, rc 0) 00000100:00100000:3.0:1788838201.291825:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a55dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70912:x1875729116437248:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 207us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838201.291832:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:1.0:1788838201.297128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838201.297598:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116437376 00000100:00100000:3.0:1788838201.297611:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116437376 00000100:00100000:3.0:1788838201.297689:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:3.0:1788838201.297720:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70912:x1875729116437376:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788838201.297923:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70912:x1875729116437376:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 206us (806us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788838201.297931:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:3.0:1788838201.304467:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.307292:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116437504 00000100:00100000:2.0:1788838201.307315:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116437504 00000100:00100000:2.0:1788838201.307432:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:2.0:1788838201.307446:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70912:x1875729116437504:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788838201.307469:0:91036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838201.307494:0:91036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff600031c00/0x88da08396ccc9402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cdcc expref: -99 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838201.307532:0:91036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600031c00/0x88da08396ccc9402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdcc expref: 7 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838201.307547:0:91036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff600031c00/0x88da08396ccc9402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdcc expref: 7 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838201.307559:0:91036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600031c00, rc 0) 00000100:00100000:2.0:1788838201.307657:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+7:70912:x1875729116437504:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 205us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838201.307665:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:3.0:1788838201.311266:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.311347:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116437632 00000100:00100000:2.0:1788838201.311362:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116437632 00000100:00100000:2.0:1788838201.311478:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:2.0:1788838201.311492:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+7:70912:x1875729116437632:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788838201.311743:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70912:x1875729116437632:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 255us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838201.311771:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:1.0:1788838201.315041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838201.315599:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116437760 00000100:00100000:3.0:1788838201.315612:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116437760 00000100:00100000:3.0:1788838201.315697:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:3.0:1788838201.315710:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70912:x1875729116437760:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788838201.316466:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70912:x1875729116437760:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 754us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838201.316477:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:1.0:1788838201.320518:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838201.320660:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116437888 00000100:00100000:3.0:1788838201.320674:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116437888 00000100:00100000:3.0:1788838201.320750:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:3.0:1788838201.320763:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70931:x1875729116437888:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838201.321370:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70931:x1875729116437888:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 607us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838201.321380:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:0.0:1788838201.347491:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.347630:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116438016 00000100:00100000:2.0:1788838201.347645:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116438016 00000100:00100000:2.0:1788838201.347729:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:2.0:1788838201.347742:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70931:x1875729116438016:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788838201.348025:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70931:x1875729116438016:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 284us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838201.348041:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:1.0:1788838201.352523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.357671:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116438144 00000100:00100000:2.0:1788838201.357695:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116438144 00000100:00100000:3.0:1788838201.357964:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:3.0:1788838201.357978:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70931:x1875729116438144:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838201.358321:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70931:x1875729116438144:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 344us (5812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838201.358341:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:1.0:1788838201.365293:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.365529:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116438272 00000100:00100000:2.0:1788838201.365553:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116438272 00000100:00100000:2.0:1788838201.365624:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:2.0:1788838201.365636:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50250e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70912:x1875729116438272:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788838201.365668:0:91036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838201.365693:0:91036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff600031800/0x88da08396ccc9409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cdfd expref: -99 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838201.365733:0:91036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600031800/0x88da08396ccc9409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdfd expref: 9 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838201.365745:0:91036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff600031800/0x88da08396ccc9409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdfd expref: 9 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838201.365757:0:91036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600031800, rc 0) 00000100:00100000:2.0:1788838201.365873:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50250e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70912:x1875729116438272:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 239us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838201.365894:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:0.0:1788838201.371150:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.371275:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116438400 00000100:00100000:2.0:1788838201.371289:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116438400 00000100:00100000:2.0:1788838201.371405:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:2.0:1788838201.371419:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70912:x1875729116438400:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788838201.371471:0:91033:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788838201.371508:0:91033:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788838201.371513:0:91033:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788838201.371516:0:91033:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788838201.371520:0:91033:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788838201.371523:0:91033:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 121 00000100:00100000:2.0:1788838201.377183:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70912:x1875729116438400:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 5749us (6029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838201.377204:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:1.0:1788838201.382981:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838201.383233:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116438528 00000100:00100000:3.0:1788838201.383246:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116438528 00000100:00100000:3.0:1788838201.383324:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:3.0:1788838201.383336:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70912:x1875729116438528:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788838201.383369:0:91034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838201.383403:0:91034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5c00/0x88da08396ccc9410 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce04 expref: -99 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838201.383443:0:91034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5c00/0x88da08396ccc9410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce04 expref: 10 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838201.383457:0:91034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5c00/0x88da08396ccc9410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce04 expref: 10 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838201.383468:0:91034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5c00, rc 0) 00000100:00100000:3.0:1788838201.384296:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70912:x1875729116438528:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 952us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838201.384309:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:0.0:1788838201.391270:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838201.391646:0:91032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116438656 00000100:00100000:3.0:1788838201.391669:0:91032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116438656 00000100:00100000:3.0:1788838201.391837:0:91032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:3.0:1788838201.391850:0:91032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70912:x1875729116438656:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788838201.392092:0:91032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70912:x1875729116438656:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 245us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838201.392102:0:91032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:1.0:1788838201.397313:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.397935:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116438784 00000100:00100000:2.0:1788838201.397949:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116438784 00000100:00100000:2.0:1788838201.398298:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:2.0:1788838201.398311:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70912:x1875729116438784:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788838201.398602:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70912:x1875729116438784:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 294us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838201.398608:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:1.0:1788838201.401996:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.402292:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116438912 00000100:00100000:2.0:1788838201.402304:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116438912 00000100:00100000:2.0:1788838201.402361:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:2.0:1788838201.402369:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70937:x1875729116438912:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788838201.402600:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70937:x1875729116438912:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 231us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838201.402607:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 96 00010000:00010000:0.0:1788838201.405018:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838201.406706:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838201.410332:0:91034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116439040 00000100:00100000:3.0:1788838201.410355:0:91034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116439040 00000100:00100000:3.0:1788838201.410440:0:91034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:3.0:1788838201.410452:0:91034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70937:x1875729116439040:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838201.412829:0:91034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70937:x1875729116439040:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 2347us (6103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838201.412849:0:91034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:1.0:1788838201.420303:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838201.420358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838201.420515:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116439168 00000100:00100000:3.0:1788838201.420528:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116439168 00000100:00100000:3.0:1788838201.420621:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116439424 00000100:00100000:3.0:1788838201.420626:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116439424 00000100:00100000:3.0:1788838201.420672:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1302 00000100:00100000:3.0:1788838201.420683:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116439168:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788838201.420790:0:75504:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp t0 exp 0000000000000000 cur 3595 last 0 00000100:00100000:0.0:1788838201.420856:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1303 00000100:00100000:0.0:1788838201.420864:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116439424:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788838201.420884:0:67312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp t0 exp 0000000000000000 cur 3595 last 0 00000020:00000080:3.0:1788838201.420907:0:75504:0:(genops.c:1385:class_connect()) connect: client efc561ba-875e-4857-b79b-9bd7023bd57c, cookie 0x88da08396ccc9417 00000020:00000080:0.0:1788838201.420941:0:67312:0:(genops.c:1385:class_connect()) connect: client efc561ba-875e-4857-b79b-9bd7023bd57c, cookie 0x88da08396ccc941e 00000004:00100000:3.0:1788838201.420947:0:75504:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:0.0:1788838201.420959:0:67312:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788838201.421110:0:75504:0:(import.c:65:import_set_state_nolock()) ffff8ff5036b1000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788838201.421110:0:67312:0:(import.c:65:import_set_state_nolock()) ffff8ff604960000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838201.421281:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116439168:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 597us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838201.421290:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1302 00000100:00100000:0.0:1788838201.421626:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116439424:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 760us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838201.421634:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1303 00000100:00100000:0.0:1788838201.425251:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.425388:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116439296 00000100:00100000:2.0:1788838201.425399:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116439296 00000100:00100000:2.0:1788838201.425472:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1304 00000100:00100000:2.0:1788838201.425482:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:0:x1875729116439296:12345-192.168.203.30@tcp:41:mount.lustre.0 00000100:00080000:0.0:1788838201.425592:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1788838201.425955:0:66255:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1788838201.427675:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:0:x1875729116439296:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 2180us (2423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838201.427700:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1304 00000100:00100000:1.0:1788838201.428418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838201.429167:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116439680 00000100:00100000:3.0:1788838201.429182:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116439680 00000100:00100000:3.0:1788838201.429254:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1305 00000100:00100000:3.0:1788838201.429265:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70912:x1875729116439680:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788838201.429309:0:75504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1788838201.431944:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70912:x1875729116439680:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 2664us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838201.432001:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1305 00000100:00100000:1.0:1788838201.433244:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838201.433698:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116439552 00000100:00100000:0.0:1788838201.433712:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116439552 00000100:00100000:1.0:1788838201.433845:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838201.433980:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116439808 00000100:00100000:0.0:1788838201.433984:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116439808 00000100:00100000:0.0:1788838201.434027:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1306 00000100:00100000:0.0:1788838201.434038:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+6:0:x1875729116439552:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788838201.434092:0:67312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:3.0:1788838201.434175:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1307 00000100:00100000:0.0:1788838201.434244:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+6:0:x1875729116439552:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 207us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838201.434252:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1306 00000100:00100000:3.0:1788838201.434669:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70912:x1875729116439808:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788838201.434722:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70912:x1875729116439808:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 538us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838201.434730:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1307 00000100:00080000:2.0:1788838201.438438:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838201.440397:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838201.440448:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838201.441127:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116439936 00000100:00100000:1.0:1788838201.441152:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116439936 00000100:00100000:1.0:1788838201.441211:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116440064 00000100:00100000:1.0:1788838201.441215:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116440064 00000100:00100000:1.0:1788838201.441245:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5961 00000100:00100000:1.0:1788838201.441256:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875729116439936:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788838201.441300:0:8460:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp t0 exp 0000000000000000 cur 3595 last 0 00000020:00000080:1.0:1788838201.441338:0:8460:0:(genops.c:1385:class_connect()) connect: client efc561ba-875e-4857-b79b-9bd7023bd57c, cookie 0x88da08396ccc9425 00002000:00100000:1.0:1788838201.441354:0:8460:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli efc561ba-875e-4857-b79b-9bd7023bd57c/ffff8ff50d51f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788838201.441377:0:8460:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788838201.441497:0:8460:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788838201.441533:0:8460:0:(import.c:65:import_set_state_nolock()) ffff8ff63f7cd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838201.441615:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116439936:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 360us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838201.441624:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5961 00000100:00100000:1.0:1788838201.441644:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5962 00000100:00100000:1.0:1788838201.441665:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875729116440064:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788838201.441683:0:8460:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp t0 exp 0000000000000000 cur 3595 last 0 00000020:00000080:1.0:1788838201.441720:0:8460:0:(genops.c:1385:class_connect()) connect: client efc561ba-875e-4857-b79b-9bd7023bd57c, cookie 0x88da08396ccc942c 00002000:00100000:1.0:1788838201.441725:0:8460:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli efc561ba-875e-4857-b79b-9bd7023bd57c/ffff8ff509c65000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788838201.441738:0:8460:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788838201.441778:0:8460:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788838201.441793:0:8460:0:(import.c:65:import_set_state_nolock()) ffff8ff639650800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838201.441925:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116440064:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 274us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838201.441933:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5962 00000100:00100000:1.0:1788838201.446522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838201.446899:0:66265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116440192 00000100:00100000:0.0:1788838201.446913:0:66265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116440192 00000100:00100000:0.0:1788838201.447027:0:66265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:0.0:1788838201.447040:0:66265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70912:x1875729116440192:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788838201.447154:0:66265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70912:x1875729116440192:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 117us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838201.447162:0:66265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1788838201.449976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838201.450695:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116440320 00000100:00100000:2.0:1788838201.450709:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116440320 00000100:00100000:2.0:1788838201.450826:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:2.0:1788838201.450839:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70912:x1875729116440320:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788838201.451098:0:66257:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788838201.451421:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70912:x1875729116440320:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 583us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838201.451431:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 232 00010000:00010000:3.0:1788838202.430289:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838203.234300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838203.235236:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116440448 00000100:00100000:2.0:1788838203.235249:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116440448 00000100:00100000:2.0:1788838203.235409:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1308 00000100:00100000:2.0:1788838203.235421:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70981:x1875729116440448:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838203.235440:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838203.235475:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc9433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce35 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838203.235540:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc943a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838203.235554:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc943a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838203.235566:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc943a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838203.235607:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838203.235611:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838203.235631:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc943a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838203.235665:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccc9433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 8 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838203.235685:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc943a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 7 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838203.235693:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:2.0:1788838203.235696:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838203.235699:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030000, rc 0) 00000100:00100000:2.0:1788838203.235766:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:70981:x1875729116440448:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 347us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.235774:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1308 00000100:00080000:0.0:1788838203.238832:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838203.239697:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838203.246322:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116440576 00000100:00100000:0.0:1788838203.246339:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116440576 00000100:00100000:0.0:1788838203.246419:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1309 00000100:00100000:0.0:1788838203.246429:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:70981:x1875729116440576:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1788838203.246466:0:67312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445076992 avail 1298837504 00000100:00100000:0.0:1788838203.246543:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:70981:x1875729116440576:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 115us (6852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838203.246551:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1309 00000100:00100000:1.0:1788838203.248739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838203.248830:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116440704 00000100:00100000:0.0:1788838203.248838:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116440704 00000100:00100000:0.0:1788838203.248907:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1310 00000100:00100000:0.0:1788838203.248916:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70981:x1875729116440704:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1788838203.248949:0:66254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:0.0:1788838203.249032:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70981:x1875729116440704:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 116us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838203.249039:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1310 00000100:00080000:2.0:1788838203.249144:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838203.253897:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838203.253991:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116440832 00000100:00100000:2.0:1788838203.254001:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116440832 00000100:00100000:2.0:1788838203.254077:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2066 00000100:00100000:2.0:1788838203.254088:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70981:x1875729116440832:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838203.254131:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838203.254202:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70981:x1875729116440832:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 116us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.254214:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2066 00000100:00080000:0.0:1788838203.254846:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838203.257182:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838203.257273:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116440960 00000100:00100000:2.0:1788838203.257281:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116440960 00000100:00100000:2.0:1788838203.257365:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2067 00000100:00100000:2.0:1788838203.257375:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70981:x1875729116440960:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838203.257408:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838203.257481:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+6:70981:x1875729116440960:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.257489:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2067 00000100:00080000:0.0:1788838203.257693:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788838203.452924:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838203.775050:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135092992:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.775125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.775166:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135093504:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.775191:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.775209:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135094016:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.775228:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.775262:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135094528:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.775281:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.775327:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788838203.775334:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135093376:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.775371:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.775388:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135093888:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.775410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.775427:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135094400:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.775887:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.775926:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135093120:0@lo:400:kworker.0 00000100:00100000:0.0:1788838203.775986:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135093888 00000100:00100000:0.0:1788838203.775994:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135093888 00000100:00100000:0.0:1788838203.776051:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135094400 00000100:00100000:0.0:1788838203.776055:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135094400 00000100:00100000:0.0:1788838203.776077:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:0.0:1788838203.776085:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135093888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838203.776138:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135093888:12345-0@lo:400:kworker.0 Request processed in 52us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838203.776145:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:0.0:1788838203.776160:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:0.0:1788838203.776166:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135094400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.776175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838203.776192:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135094400:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.776195:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135093632:0@lo:400:kworker.0 00000100:00100000:0.0:1788838203.776197:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00100000:2.0:1788838203.776218:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.776236:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135094144:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.776257:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.776272:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135094656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838203.776289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.776313:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788838203.776319:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135093248:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.776339:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.776368:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135093760:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.776388:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.776404:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135094272:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.776421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838203.776599:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838203.777078:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135094784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838203.777120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838203.777174:0:91033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135092992 00000100:00100000:2.0:1788838203.777179:0:91033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135092992 00000100:00100000:2.0:1788838203.777222:0:91033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788838203.777230:0:91033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135092992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.777268:0:91033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135092992:12345-0@lo:400:kworker.0 Request processed in 40us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.777276:0:91033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788838203.777316:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135093504 00000100:00100000:2.0:1788838203.777320:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135093504 00000100:00100000:2.0:1788838203.777350:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135094016 00000100:00100000:2.0:1788838203.777354:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135094016 00000100:00100000:2.0:1788838203.777366:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135094528 00000100:00100000:2.0:1788838203.777369:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135094528 00000100:00100000:2.0:1788838203.777379:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135093376 00000100:00100000:2.0:1788838203.777382:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135093376 00000100:00100000:2.0:1788838203.777394:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135093120 00000100:00100000:2.0:1788838203.777397:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135093120 00000100:00100000:2.0:1788838203.777408:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135093248 00000100:00100000:2.0:1788838203.777411:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135093248 00000100:00100000:2.0:1788838203.777423:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1788838203.777429:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135093504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.777475:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135093504:12345-0@lo:400:kworker.0 Request processed in 46us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.777482:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1788838203.777495:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1788838203.777500:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135094016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.777530:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135094016:12345-0@lo:400:kworker.0 Request processed in 29us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.777536:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1788838203.777555:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1788838203.777561:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135094528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.777590:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135094528:12345-0@lo:400:kworker.0 Request processed in 30us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.777596:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1788838203.777609:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1788838203.777614:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135093376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838203.777781:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135093632 00000100:00100000:3.0:1788838203.777786:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135093632 00000100:00100000:3.0:1788838203.777825:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135094144 00000100:00100000:3.0:1788838203.777829:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135094144 00000100:00100000:3.0:1788838203.777840:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135094656 00000100:00100000:3.0:1788838203.777842:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135094656 00000100:00100000:3.0:1788838203.777851:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135094784 00000100:00100000:3.0:1788838203.777853:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135094784 00000100:00100000:3.0:1788838203.777863:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4155 00000100:00100000:3.0:1788838203.777870:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135093632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838203.777915:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135093632:12345-0@lo:400:kworker.0 Request processed in 45us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838203.777921:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4155 00000100:00100000:3.0:1788838203.777934:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4156 00000100:00100000:3.0:1788838203.777940:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135094144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838203.777967:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135094144:12345-0@lo:400:kworker.0 Request processed in 28us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838203.777973:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4156 00000100:00100000:3.0:1788838203.777991:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4157 00000100:00100000:3.0:1788838203.777997:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135094656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838203.778014:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:3.0:1788838203.778046:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135094656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838203.778052:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4157 00000100:00100000:3.0:1788838203.778063:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4158 00000100:00100000:3.0:1788838203.778068:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135094784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838203.778092:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445076992 avail 1298837504 00000100:00100000:3.0:1788838203.778118:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135094784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838203.778124:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4158 00000100:00100000:2.0:1788838203.778130:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135093376:12345-0@lo:400:kworker.0 Request processed in 515us (2758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.778136:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1788838203.778148:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1788838203.778156:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135093120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.778187:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135093120:12345-0@lo:400:kworker.0 Request processed in 33us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.778193:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1788838203.778204:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1788838203.778210:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135093248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.778239:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135093248:12345-0@lo:400:kworker.0 Request processed in 29us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.778244:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1788838203.778272:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135093760 00000100:00100000:2.0:1788838203.778275:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135093760 00000100:00100000:2.0:1788838203.778306:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135094272 00000100:00100000:2.0:1788838203.778309:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135094272 00000100:00100000:2.0:1788838203.778327:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:2.0:1788838203.778332:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135093760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.778386:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135093760:12345-0@lo:400:kworker.0 Request processed in 53us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.778392:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:2.0:1788838203.778403:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:2.0:1788838203.778408:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135094272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.778434:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135094272:12345-0@lo:400:kworker.0 Request processed in 26us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838203.778641:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00080000:2.0:1788838203.778693:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838203.778697:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838203.778699:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838203.778893:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135093248:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.778908:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135093760:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.778919:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135094272:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.778927:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000004:00080000:2.0:1788838203.778933:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116995 committed transno 115964116995 00000100:00100000:2.0:1788838203.778960:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135094784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838203.778974:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135093120:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.778983:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135093632:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.778994:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135094144:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.779006:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135094656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838203.779051:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135093376:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.779074:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135093888:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.779086:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135094400:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.779165:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135092992:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.779183:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135093504:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.779194:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135094016:0@lo:400:kworker.0 00000100:00100000:2.0:1788838203.779206:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135094528:0@lo:400:kworker.0 00000100:00100000:3.0:1788838204.113234:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838204.113299:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116441088 00000100:00100000:0.0:1788838204.113310:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116441088 00000100:00100000:0.0:1788838204.113371:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1311 00000100:00100000:0.0:1788838204.113392:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71015:x1875729116441088:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:0.0:1788838204.113411:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838204.113430:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4400/0x88da08396ccc9441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce3c expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113506:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113521:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113534:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113549:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4200/0x88da08396ccc944f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113555:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4200/0x88da08396ccc944f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113563:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4200/0x88da08396ccc944f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113620:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5800/0x88da08396ccc9456 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113628:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5800/0x88da08396ccc9456 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113643:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5800/0x88da08396ccc9456 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838204.113682:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5800/0x88da08396ccc9456 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113696:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113710:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113715:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113734:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113740:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e5600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838204.113743:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113751:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113764:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:0.0:1788838204.113767:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838204.113772:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113777:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113789:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4200/0x88da08396ccc944f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113826:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4200/0x88da08396ccc944f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113833:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4200/0x88da08396ccc944f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113844:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e4200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838204.113847:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4200/0x88da08396ccc944f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113853:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4200/0x88da08396ccc944f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113861:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8ff608f3c300) 00010000:00010000:0.0:1788838204.113863:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838204.113866:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4200/0x88da08396ccc944f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113873:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4200/0x88da08396ccc944f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113905:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e4400/0x88da08396ccc9441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce3c expref: 9 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113916:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5800/0x88da08396ccc9456 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce3c expref: 8 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.113922:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff608f3c700) 00010000:00010000:0.0:1788838204.113924:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838204.113926:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50b8e5800, rc 0) 00000100:00100000:0.0:1788838204.113984:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71015:x1875729116441088:12345-192.168.203.30@tcp:101:cp.0 Request processed in 602us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838204.113991:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1311 00000100:00100000:0.0:1788838204.118626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838204.118730:0:66264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116441216 00000100:00100000:3.0:1788838204.118740:0:66264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116441216 00000100:00100000:3.0:1788838204.118826:0:66264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:3.0:1788838204.118837:0:66264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:efc561ba-875e-4857-b79b-9bd7023bd57c+6:71015:x1875729116441216:12345-192.168.203.30@tcp:900:cp.0 00000100:00100000:3.0:1788838204.118928:0:66264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:efc561ba-875e-4857-b79b-9bd7023bd57c+6:71015:x1875729116441216:12345-192.168.203.30@tcp:900:cp.0 Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838204.118936:0:66264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:3.0:1788838204.124994:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838204.125039:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116441344 00000100:00100000:2.0:1788838204.125050:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116441344 00000100:00100000:2.0:1788838204.125109:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1312 00000100:00100000:2.0:1788838204.125120:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:71015:x1875729116441344:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1788838204.125141:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838204.125165:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc945d lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce43 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838204.125229:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc9464 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838204.125244:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc9464 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838204.125257:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc9464 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838204.125302:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00000004:00200000:2.0:1788838204.125306:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788838204.125370:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600031600/0x88da08396ccc945d lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce43 expref: 8 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838204.125400:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc9464 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce43 expref: 7 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838204.125410:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:2.0:1788838204.125413:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788838204.125416:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030400, rc 0) 00000100:00100000:2.0:1788838204.125475:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71015:x1875729116441344:12345-192.168.203.30@tcp:101:cp.0 Request processed in 357us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838204.125483:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1312 00000100:00100000:2.0:1788838204.130048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838204.130101:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116441472 00000100:00100000:3.0:1788838204.130119:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116441472 00000100:00100000:3.0:1788838204.130180:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1313 00000100:00100000:3.0:1788838204.130190:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71015:x1875729116441472:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:3.0:1788838204.130209:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838204.130239:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc946b lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce4a expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130344:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130357:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130368:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130388:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc9479 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130395:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc9479 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130400:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc9479 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130581:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4800/0x88da08396ccc9480 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130587:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4800/0x88da08396ccc9480 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130591:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4800/0x88da08396ccc9480 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838204.130618:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00000004:00200000:3.0:1788838204.130620:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838204.130651:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4800/0x88da08396ccc9480 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130672:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130679:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130685:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130692:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130699:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838204.130704:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130711:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130724:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:3.0:1788838204.130727:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838204.130731:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130738:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9472 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130753:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc9479 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130759:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc9479 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130771:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc9479 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130776:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838204.130779:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc9479 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130785:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc9479 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130793:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xf7117594 (ffff8ff6055e2c00) 00010000:00010000:3.0:1788838204.130868:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838204.130871:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc9479 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130877:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc9479 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130911:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc946b lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce4a expref: 9 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130925:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4800/0x88da08396ccc9480 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce4a expref: 8 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.130932:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:3.0:1788838204.130935:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788838204.130937:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4800, rc 0) 00000100:00100000:3.0:1788838204.131101:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71015:x1875729116441472:12345-192.168.203.30@tcp:101:cp.0 Request processed in 911us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838204.131181:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1313 00000100:00100000:3.0:1788838204.138692:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838204.138932:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116441600 00000100:00100000:0.0:1788838204.138942:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116441600 00000100:00100000:0.0:1788838204.139612:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1314 00000100:00100000:0.0:1788838204.139626:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71015:x1875729116441600:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:0.0:1788838204.139656:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838204.139677:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4400/0x88da08396ccc9487 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce51 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139746:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139760:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139772:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139786:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9495 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139793:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9495 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139826:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9495 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139873:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139881:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139898:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139905:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139911:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e4200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838204.139916:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139924:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139937:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:0.0:1788838204.139940:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838204.139946:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139952:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4200/0x88da08396ccc948e lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139964:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9495 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139971:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9495 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139977:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9495 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139982:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e5600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838204.139991:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9495 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.139998:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9495 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.140006:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xb1bed465 (ffff8ff608f3c300) 00010000:00010000:0.0:1788838204.140009:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838204.140012:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9495 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.140033:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e5600/0x88da08396ccc9495 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.140066:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4400/0x88da08396ccc9487 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce51 expref: 9 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.140076:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:0.0:1788838204.140078:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838204.140082:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50b8e4400/0x88da08396ccc9487 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce51 expref: 9 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838204.140092:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50b8e4400, rc 0) 00000100:00100000:0.0:1788838204.140161:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71015:x1875729116441600:12345-192.168.203.30@tcp:101:cp.0 Request processed in 539us (1478us total) trans 0 rc 301/301 00000100:00100000:0.0:1788838204.140168:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1314 00000100:00100000:2.0:1788838204.144746:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838204.144812:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116441728 00000100:00100000:3.0:1788838204.144822:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116441728 00000100:00100000:3.0:1788838204.144878:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1315 00000100:00100000:3.0:1788838204.144890:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71015:x1875729116441728:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:3.0:1788838204.144912:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838204.144932:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc949c lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce58 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.144997:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145013:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145025:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145039:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc94aa lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145045:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc94aa lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145051:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc94aa lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145104:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145131:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145138:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145144:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145150:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838204.145155:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145163:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145175:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:3.0:1788838204.145178:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838204.145182:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145189:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5e00/0x88da08396ccc94a3 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145199:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc94aa lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145205:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc94aa lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145211:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc94aa lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145220:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838204.145223:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc94aa lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145230:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc94aa lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145238:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xb1bed465 (ffff8ff6055e2c00) 00010000:00010000:3.0:1788838204.145240:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838204.145243:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc94aa lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145249:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5800/0x88da08396ccc94aa lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145283:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc949c lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce58 expref: 9 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145292:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:3.0:1788838204.145295:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838204.145298:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5200/0x88da08396ccc949c lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce58 expref: 9 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838204.145306:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5200, rc 0) 00000100:00100000:3.0:1788838204.145371:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71015:x1875729116441728:12345-192.168.203.30@tcp:101:cp.0 Request processed in 483us (642us total) trans 0 rc 301/301 00000100:00100000:3.0:1788838204.145378:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1315 00000100:00100000:3.0:1788838204.148215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838204.149852:0:66262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116441856 00000100:00100000:1.0:1788838204.149867:0:66262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116441856 00000100:00100000:1.0:1788838204.150042:0:66262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1788838204.150054:0:66262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71015:x1875729116441856:12345-192.168.203.30@tcp:700:cp.0 00000020:02000000:1.0:1788838204.150070:0:66262:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:1.0:1788838204.164226:0:66262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71015:x1875729116441856:12345-192.168.203.30@tcp:700:cp.0 Request processed in 14164us (16011us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838204.164242:0:66262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1788838204.285021:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135095040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838204.285025:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135094912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838204.285092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838204.285122:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135095040 00000100:00100000:2.0:1788838204.285130:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135095040 00000100:00100000:2.0:1788838204.285185:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:3.0:1788838204.285188:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838204.285194:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135095040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788838204.285216:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838204.285261:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135094912 00000100:00100000:1.0:1788838204.285265:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135094912 00000100:00100000:2.0:1788838204.285268:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135095040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838204.285276:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:1.0:1788838204.285305:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:1.0:1788838204.285312:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135094912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838204.285324:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838204.285368:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135094912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838204.285375:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:2.0:1788838204.285447:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135094912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838204.285760:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135095040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788838204.477200:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838205.500964:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838205.821512:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838205.821538:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135095168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838205.821609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838205.822047:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135095168 00000100:00100000:2.0:1788838205.822057:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135095168 00000100:00100000:2.0:1788838205.822124:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1788838205.822142:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135095168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838205.822172:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838205.822221:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135095168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838205.822229:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1788838205.822276:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135095168:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788838205.822345:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838205.822860:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838205.822871:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135095296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838205.822909:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838205.822940:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135095296 00000100:00100000:2.0:1788838205.822945:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135095296 00000100:00100000:2.0:1788838205.822978:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:2.0:1788838205.822985:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135095296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838205.823004:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838205.823039:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135095296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838205.823053:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00080000:2.0:1788838205.823068:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838205.823089:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135095296:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1788838205.827391:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000001:00100000:1.0:1788838205.827406:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00080000:1.0:1788838205.827414:0:75678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411442 is committed 00000020:00000080:1.0:1788838205.827431:0:75678:0:(genops.c:885:class_export_put()) final put ffff8ff605443000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00080000:1.0:1788838205.827854:0:75678:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8ff6149830c0 refcount 2 committed 0 result 0 batchid 73014444093 00000020:00080000:1.0:1788838205.827860:0:75678:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ff611ac3500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8ff614983a80 00000020:00080000:1.0:1788838205.827864:0:75678:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].4 00000020:00080000:1.0:1788838205.827867:0:75678:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ff611ac3300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ff632992600 00000020:00080000:1.0:1788838205.827870:0:75678:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].5 00000001:00100000:1.0:1788838205.828343:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000001:00100000:1.0:1788838205.828353:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:1.0:1788838205.828357:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff608210000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00080000:3.0:1788838205.828411:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444093 committed batchid 73014444092 00000020:00080000:3.0:1788838205.828471:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444092 00000001:00100000:0.0:1788838205.828718:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000001:00100000:0.0:1788838205.828725:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:0.0:1788838205.828728:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff608210800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00100000:3.0:1788838205.828816:0:91027:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000001:00100000:3.0:1788838205.828824:0:91027:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000001:00080000:3.0:1788838205.828830:0:91027:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116996 is committed 00000020:00000080:3.0:1788838205.828833:0:91027:0:(genops.c:885:class_export_put()) final put ffff8ff6048e2000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 00000020:00000080:2.0:1788838205.828902:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff605443000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-MDT0001 00000020:00000080:2.0:1788838205.828956:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5031c2000 for lustre-MDT0001 00000020:00000080:2.0:1788838205.829084:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff608210000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-OST0000 00000020:00000080:2.0:1788838205.829122:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff608211000 for lustre-OST0000 00000020:00000080:1.0:1788838205.829287:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff608210800/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-OST0001 00000020:00000080:1.0:1788838205.829320:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5031c7000 for lustre-OST0001 00000020:00000080:2.0:1788838205.829447:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6048e2000/fdcf066d-ff07-4b2e-96ab-52415ed6bf72 for lustre-MDT0000 00000020:00000080:2.0:1788838205.829548:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff632f54000 for lustre-MDT0000 00000100:00100000:2.0:1788838206.527009:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838206.527050:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838206.527682:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838206.527710:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838206.527825:0:91036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116441984 00000100:00100000:3.0:1788838206.527850:0:91036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116441984 00000100:00100000:3.0:1788838206.527911:0:91036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:3.0:1788838206.527922:0:91036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2406:x1875729116441984:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838206.527990:0:91036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2406:x1875729116441984:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 69us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838206.527998:0:91036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 99 00010000:00010000:3.0:1788838206.528029:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838206.528140:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116442496 00000100:00100000:3.0:1788838206.528145:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116442496 00000100:00100000:3.0:1788838206.528196:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2628 00000100:00100000:3.0:1788838206.528205:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116442496:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838206.528238:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116442496:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838206.528287:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2628 00000100:00080000:3.0:1788838206.528359:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838206.531459:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116442240 00000100:00100000:2.0:1788838206.531524:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838206.531528:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116442240 00000100:00100000:2.0:1788838206.531552:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116442368 00000100:00100000:2.0:1788838206.531557:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116442368 00000100:00100000:1.0:1788838206.531590:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116442112 00000100:00100000:1.0:1788838206.531595:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116442112 00000100:00100000:2.0:1788838206.531602:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2629 00000100:00100000:2.0:1788838206.531624:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116442368:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838206.531636:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1312 00000100:00100000:1.0:1788838206.531648:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2406:x1875729116442240:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838206.531702:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116442368:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 90us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838206.531704:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2406:x1875729116442240:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 60us (4653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838206.531719:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2629 00000100:00100000:1.0:1788838206.531720:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1312 00000100:00100000:1.0:1788838206.531747:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1313 00000100:00100000:1.0:1788838206.531756:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116442112:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838206.531780:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116442112:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (4070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838206.531787:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1313 00000100:00080000:0.0:1788838206.535043:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838206.535054:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838206.535057:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:3.0:1788838206.783959:0:92046:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788838206.784025:0:92046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.784039:0:92046:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.784047:0:92046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.784056:0:92046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.784095:0:92046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788838206.784100:0:92046:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788838206.784127:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788838206.784132:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788838206.784137:0:92046:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1788838206.784253:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838206.784261:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.784270:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712da00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838206.784273:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.784283:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838206.784291:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838206.784298:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788838206.784300:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788838206.784303:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788838206.784344:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.784351:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838206.784376:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.784384:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712da00/0x88da08396ccc8fb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8fbe expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.784396:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838206.784398:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838206.784400:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838206.784417:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135095424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838206.784480:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838206.784945:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff610292800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788838206.785014:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135095552:0@lo:39:umount.0 00000100:00100000:2.0:1788838206.785051:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838206.785628:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135095424 00000100:00100000:1.0:1788838206.785638:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135095424 00000100:00100000:1.0:1788838206.785710:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1788838206.785721:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135095424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838206.785736:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838206.785755:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712d200/0x88da08396ccc8fbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8fb7 expref: 24 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.785768:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838206.785841:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3643:x1875729135095424:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838206.785849:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1788838206.785889:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135095424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838206.786326:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135095552 00000100:00100000:3.0:1788838206.786332:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135095552 00000100:00100000:3.0:1788838206.786372:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:3.0:1788838206.786378:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729135095552:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788838206.786400:0:66255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc90cf 00000100:00080000:3.0:1788838206.786408:0:66255:0:(import.c:65:import_set_state_nolock()) ffff8ff627d1b000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788838206.786464:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1875729135095552:12345-0@lo:39:umount.0 Request processed in 85us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838206.786471:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000020:00000080:3.0:1788838206.786478:0:66255:0:(genops.c:885:class_export_put()) final put ffff8ff627d1b800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788838206.786498:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788838206.786518:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d1b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788838206.786573:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff627d1b000 for lustre-MDT0000 00000100:00080000:3.0:1788838206.786596:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff610292800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788838206.786607:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135095552:0@lo:39:umount.0 00000100:00080000:3.0:1788838206.786639:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788838206.786642:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788838206.786647:0:92046:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788838206.787924:0:92046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.787940:0:92046:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.787947:0:92046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.787955:0:92046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.787974:0:92046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838206.787980:0:92046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.787986:0:92046:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.787991:0:92046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.788008:0:92046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.788020:0:92046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788838206.788032:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838206.788038:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.788045:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718f600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:3.0:1788838206.788049:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.788058:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838206.788065:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838206.788071:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788838206.788086:0:6535:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788838206.788114:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.788120:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838206.788141:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.788426:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838206.788433:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.788440:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838206.788450:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.788458:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838206.788464:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838206.788470:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838206.788472:0:6534:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788838206.788474:0:6534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788838206.788491:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.788497:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838206.788519:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.788526:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc8fda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8fe1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.788538:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838206.788540:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838206.788542:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838206.788548:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838206.788562:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135095808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838206.788626:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838206.788674:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135095808 00000100:00100000:1.0:1788838206.788680:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135095808 00000100:00100000:1.0:1788838206.788721:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1788838206.788735:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3646:x1875729135095808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838206.788747:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838206.788760:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712c200/0x88da08396ccc8fe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8fda expref: 23 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.788773:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838206.788820:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3646:x1875729135095808:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838206.788827:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1788838206.788862:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135095808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838206.788878:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838206.788884:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135095680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838206.788908:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838206.788930:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135095680 00000100:00100000:1.0:1788838206.788933:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135095680 00000100:00100000:1.0:1788838206.788956:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1788838206.788962:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3643:x1875729135095680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838206.788969:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838206.788978:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148e400/0x88da08396ccc8ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8ed7 expref: 22 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.788986:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838206.789012:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3643:x1875729135095680:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838206.789017:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1788838206.789065:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135095680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838206.789325:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396ccc8ed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8ede expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.789349:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838206.789351:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838206.789353:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838206.789371:0:92046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.789379:0:92046:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.789386:0:92046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.789392:0:92046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.789469:0:92046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838206.789476:0:92046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.789483:0:92046:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.789490:0:92046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838206.789496:0:92046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.790859:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838206.790870:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.790880:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838206.790885:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.790896:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838206.790904:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838206.790928:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788838206.790931:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788838206.790934:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788838206.790968:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.790975:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838206.791001:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.791008:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50718e400/0x88da08396ccc8fa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8fb0 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.791022:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838206.791025:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.791032:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50718e600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838206.791035:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.791042:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838206.791048:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838206.791054:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788838206.791056:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1788838206.791067:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.791092:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838206.791109:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838206.791117:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838206.791119:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838206.791121:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838206.791128:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838206.791144:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135096064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838206.791260:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135095936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838206.791324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838206.791379:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135095936 00000100:00100000:1.0:1788838206.791385:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135095936 00000100:00100000:1.0:1788838206.791439:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1788838206.791449:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3646:x1875729135095936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838206.791463:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838206.791479:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712d400/0x88da08396ccc8fb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8fa9 expref: 21 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.791493:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838206.791530:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3646:x1875729135095936:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838206.791538:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1788838206.791578:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135095936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838206.791953:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838206.792013:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135096064 00000100:00100000:1.0:1788838206.792018:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135096064 00000100:00100000:1.0:1788838206.792057:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1788838206.792065:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3644:x1875729135096064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838206.792085:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838206.792096:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148e000/0x88da08396ccc8ec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8ec2 expref: 20 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.792106:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838206.792134:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+19:3644:x1875729135096064:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838206.792140:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1788838206.792348:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135096064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838206.792501:0:92046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788838206.792516:0:92046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50718e600/0x88da08396ccc8ec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc8ec9 expref: -99 pid: 91026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838206.792528:0:92046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1788838206.792532:0:92046:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788838206.792535:0:92046:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788838206.792572:0:92046:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788838206.792576:0:92046:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788838206.792581:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788838206.792588:0:92046:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1788838206.794891:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1788838206.795539:0:92046:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1788838206.796237:0:92046:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1788838206.796251:0:92046:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff5036b5800 efc561ba-875e-4857-b79b-9bd7023bd57c 192.168.203.30@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788838206.796260:0:92046:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff5052d5800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788838206.796264:0:92046:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff627d1c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788838206.796268:0:92046:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff5052d0800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788838206.796272:0:92046:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff6048e4800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 115964116995 stale:0 00000020:00080000:3.0:1788838206.796277:0:92046:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8ff61d0e0000) has exports, disconnecting them 00000020:00080000:3.0:1788838206.796282:0:92046:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.30@tcp (ffff8ff5036b5800), last request at 1788838206 00000020:00000080:3.0:1788838206.796288:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9417 00000020:00010000:3.0:1788838206.796299:0:92046:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff5036b5800: total 0 00000100:00080000:3.0:1788838206.796304:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff5036b1000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788838206.796333:0:92046:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff5036b5800): rc 0 00000020:00080000:3.0:1788838206.796337:0:92046:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff5052d5800), last request at 1788838183 00000020:00000080:3.0:1788838206.796340:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc90c8 00000100:00080000:3.0:1788838206.796344:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff5052d7800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788838206.796361:0:92046:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff5052d5800): rc 0 00000020:00000080:3.0:1788838206.796364:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff5052d5800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788838206.796400:0:92046:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff627d1c000), last request at 1788838203 00000020:00000080:3.0:1788838206.796404:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc90c1 00000100:00080000:3.0:1788838206.796408:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff627d1d000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788838206.796419:0:92046:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff627d1c000): rc 0 00000020:00000080:3.0:1788838206.796421:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff627d1c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00010000:0.0:1788838206.796426:0:6535:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff5036b5800: total 2 00000020:00080000:3.0:1788838206.796427:0:92046:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff5052d0800), last request at 1788838203 00010000:00010000:0.0:1788838206.796432:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788838206.796433:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc90ba 00000100:00080000:3.0:1788838206.796446:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff5052d1800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788838206.796481:0:92046:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff5052d0800): rc 0 00010000:00010000:0.0:1788838206.796482:0:6535:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff5036b5800, canceled 0 locks, left on hash table 2. 00000020:00000080:3.0:1788838206.796485:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff5052d0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788838206.796490:0:92046:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff6048e4800), last request at 1788838177 00000020:00000080:3.0:1788838206.796494:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f2b 00000100:00080000:3.0:1788838206.796502:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff627d19000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788838206.796507:0:92046:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff6048e4800): rc 0 00000020:00000080:3.0:1788838206.796509:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff6048e4800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:3.0:1788838206.796516:0:92046:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f518147bae0 00010000:00010000:0.0:1788838206.796525:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc943a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 3 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788838206.796533:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788838206.796537:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788838206.796555:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50b8e5800/0x88da08396ccc9456 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce3c expref: 2 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838206.796573:0:6535:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff5036b5800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788838206.797264:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788838206.797336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5052d5800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788838206.801249:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d1c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788838206.801314:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5052d0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788838206.801340:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6048e4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788838206.801365:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5052d7800 for lustre-MDT0000 00000020:00000080:2.0:1788838206.801370:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff627d1d000 for lustre-MDT0000 00000020:00000080:2.0:1788838206.801374:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5052d1800 for lustre-MDT0000 00000020:00000080:2.0:1788838206.801376:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff627d19000 for lustre-MDT0000 00010000:00010000:2.0:1788838206.801394:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838206.801855:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838206.801893:0:92046:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788838206.801925:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff6104d8000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788838206.802344:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135096192:0@lo:39:umount.0 00000100:00100000:2.0:1788838206.802414:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838206.802551:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788838206.802555:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 3 00000004:00080000:3.0:1788838206.802572:0:92046:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788838206.802654:0:92046:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788838206.802667:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff6104df800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788838206.802676:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788838206.802679:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 3 00000004:00080000:3.0:1788838206.802688:0:92046:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788838206.802782:0:92046:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788838206.802792:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff62ceaf000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788838206.802861:0:92046:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff61d0e0000) has no exports 00000100:00100000:2.0:1788838206.802924:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135096320:0@lo:9:umount.0 00000100:00100000:2.0:1788838206.802953:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838206.802975:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135096448:0@lo:9:umount.0 00000100:00100000:2.0:1788838206.802995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838206.803061:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135096192 00000100:00100000:1.0:1788838206.803068:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135096192 00000100:00100000:1.0:1788838206.803254:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4159 00000100:00100000:1.0:1788838206.803265:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135096192:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788838206.803293:0:23765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f6a 00000100:00080000:1.0:1788838206.803300:0:23765:0:(import.c:65:import_set_state_nolock()) ffff8ff632f51000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788838206.803320:0:23765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411442 00000100:00100000:1.0:1788838206.803454:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3642:x1875729135096192:12345-0@lo:39:umount.0 Request processed in 191us (1040us total) trans 77309411443 rc 0/0 00000100:00100000:1.0:1788838206.803462:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4159 00010000:00010000:1.0:1788838206.803484:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788838206.803510:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6104d8000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788838206.803516:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135096192:0@lo:39:umount.0 00000100:00100000:3.0:1788838206.803586:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135096320 00000100:00100000:3.0:1788838206.803590:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135096320 00000100:00080000:1.0:1788838206.803678:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838206.803707:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135096448 00000100:00100000:3.0:1788838206.803711:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135096448 00000100:00080000:1.0:1788838206.803758:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838206.803820:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5963 00000100:00100000:2.0:1788838206.803837:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135096320:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788838206.803853:0:26213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f86 00000100:00080000:2.0:1788838206.803858:0:26213:0:(import.c:65:import_set_state_nolock()) ffff8ff604fe7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788838206.803896:0:26213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:2.0:1788838206.803992:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729135096320:12345-0@lo:9:umount.0 Request processed in 156us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838206.803999:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5963 00000100:00100000:2.0:1788838206.804013:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5964 00000100:00100000:2.0:1788838206.804020:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135096448:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788838206.804031:0:26213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f94 00000100:00080000:2.0:1788838206.804036:0:26213:0:(import.c:65:import_set_state_nolock()) ffff8ff604584000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788838206.804054:0:26213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:2.0:1788838206.804141:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729135096448:12345-0@lo:9:umount.0 Request processed in 120us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838206.804147:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5964 00010000:00010000:1.0:1788838206.804213:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788838206.804234:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6104df800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788838206.804247:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788838206.804249:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788838206.804252:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135096320:0@lo:9:umount.0 00000100:00080000:1.0:1788838206.804263:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62ceaf000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788838206.804267:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788838206.804268:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788838206.804271:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135096448:0@lo:9:umount.0 00010000:00010000:1.0:1788838206.804293:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788838206.807563:0:92046:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff61d0e0000) has no exports 00000020:00000080:0.0:1788838206.826748:0:6535:0:(genops.c:885:class_export_put()) final put ffff8ff5036b5800/efc561ba-875e-4857-b79b-9bd7023bd57c 00010000:00010000:0.0:1788838206.826834:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838206.826837:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838206.826839:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838206.827473:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5036b5800/efc561ba-875e-4857-b79b-9bd7023bd57c for lustre-MDT0000 00000020:00000080:1.0:1788838206.827528:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5036b1000 for lustre-MDT0000 00000020:00000080:3.0:1788838206.864260:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f40 00000020:00000080:3.0:1788838206.864275:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff50d51c800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788838206.864298:0:92046:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788838206.864329:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d51c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788838206.864355:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838206.864368:0:92046:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788838206.864373:0:92046:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ff61d0e3370) has no exports 00000020:00000080:2.0:1788838206.864825:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f39 00000020:00000080:2.0:1788838206.864830:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff509c62800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788838206.864880:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838206.864889:0:92046:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788838206.864892:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff503543800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788838206.864894:0:92046:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503543800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788838206.864899:0:92046:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788838206.865119:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c62800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788838206.865173:0:92046:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff61dfdad80 - data ffff8ff63fc8f870/ffff8ff604987000 00000020:01000000:2.0:1788838206.865308:0:92046:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff610de8ea0 - data ffff8ff63fe1d438/ffff8ff602a8e800 00000100:00080000:2.0:1788838206.913252:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788838206.913261:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788838206.913276:0:92046:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ff504f07800 x1875729135096192/t77309411443(77309411443) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838216 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838206.913304:0:92046:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788838206.915148:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788838206.915230:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 4 00000004:00080000:2.0:1788838206.915251:0:92046:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838206.915254:0:92046:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788838206.917376:0:91044:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788838206.917384:0:91044:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:0.0:1788838206.917394:0:91044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:2.0:1788838206.918262:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788838206.918267:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 4 00000004:00080000:2.0:1788838206.918287:0:92046:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838206.918290:0:92046:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788838206.919592:0:91046:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788838206.919598:0:91046:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:0.0:1788838206.919707:0:91046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:2.0:1788838206.923936:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8eec 00000020:00000080:2.0:1788838206.923949:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff6104de800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788838206.924524:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104de800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788838206.925323:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f01 00000020:00000080:2.0:1788838206.925332:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff5031c0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788838206.925345:0:92046:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788838206.925351:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838206.925362:0:92046:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788838206.925367:0:92046:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8ff6102419b8) has no exports 00000004:01000000:2.0:1788838206.925533:0:92046:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788838206.925541:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f8d 00000020:00000080:2.0:1788838206.925545:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff632f51800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788838206.925549:0:92046:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788838206.925553:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838206.925560:0:92046:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788838206.925563:0:92046:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8ff639560000) has no exports 00000020:00000080:2.0:1788838206.925569:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f7f 00000020:00000080:2.0:1788838206.925572:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff62ceac800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788838206.927251:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5031c0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788838206.927267:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632f51800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788838206.927273:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62ceac800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788838206.928591:0:92046:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788838206.928607:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788838206.928624:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 5 00000004:00080000:2.0:1788838206.928631:0:92046:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838206.928633:0:92046:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788838206.928685:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838206.928698:0:92046:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788838206.928706:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f71 00000020:00000080:2.0:1788838206.928714:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff610292000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788838206.928721:0:92046:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788838206.928726:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838206.928732:0:92046:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:0.0:1788838206.928879:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff62ceaf000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788838206.928888:0:36:0:(genops.c:885:class_export_put()) final put ffff8ff610297800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838206.928891:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff610297800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788838206.928897:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838206.928987:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff610292000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00080000:2.0:1788838206.929681:0:92046:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8ff6395619b8) has no exports 00000020:00000080:2.0:1788838206.929694:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f63 00000020:00000080:2.0:1788838206.929700:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff50d51d800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788838206.930351:0:92046:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788838206.930356:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788838206.930359:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 5 00000004:00080000:2.0:1788838206.930364:0:92046:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838206.930366:0:92046:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788838206.933665:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d51d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788838206.933885:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838206.933902:0:92046:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788838206.933920:0:92046:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788838206.933929:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f55 00000020:00000080:2.0:1788838206.933939:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff610291000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838206.934061:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6104df800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788838206.934069:0:36:0:(genops.c:885:class_export_put()) final put ffff8ff610297000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838206.934130:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff610297000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788838206.934138:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788838206.934557:0:92046:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788838206.934562:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838206.934571:0:92046:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788838206.934576:0:92046:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8ff503ca19b8) has no exports 00000020:00000080:2.0:1788838206.934583:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f4e 00000020:00000080:2.0:1788838206.934588:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff6104db800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788838206.934606:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff610291000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00010000:01000000:0.0:1788838206.935930:0:92046:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788838206.935937:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788838206.935942:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788838206.935949:0:92046:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788838206.936202:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104db800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788838206.936888:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838206.936903:0:92046:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838206.936939:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838206.936944:0:92046:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838206.936949:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff6048e5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838206.936953:0:92046:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6048e5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788838206.936960:0:92046:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838206.937084:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6104d8000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788838206.937091:0:36:0:(genops.c:885:class_export_put()) final put ffff8ff50d518800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788838206.937094:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d518800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788838206.937099:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838206.937368:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f08 00000020:00000080:0.0:1788838206.937376:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff5031c1000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788838206.937401:0:92046:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788838206.937543:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5031c1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788838206.937571:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838206.937579:0:92046:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788838206.937584:0:92046:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ff61d0e4d28) has no exports 00000020:00000080:0.0:1788838206.937628:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838206.937633:0:92046:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788838206.937636:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff6104d9800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788838206.937639:0:92046:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104d9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788838206.937643:0:92046:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788838206.937680:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8f0f 00000020:00000080:0.0:1788838206.937684:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff6048e0000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788838206.937702:0:92046:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff640eee800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788838206.937705:0:92046:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff640eee800 3 00000020:01000004:0.0:1788838206.937708:0:92046:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff640eee800 from lustre-MDT0000 00000020:00000080:0.0:1788838206.937726:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838206.937730:0:92046:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788838206.937732:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff6104df000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788838206.937734:0:92046:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104df000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788838206.937740:0:92046:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788838206.937771:0:92046:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788838206.937775:0:92046:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788838206.937777:0:92046:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788838206.937780:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838206.937782:0:92046:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788838206.937790:0:92046:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff608eb1000 2af93169-6705-472b-b7ff-fd7cc5c04782 192.168.203.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838206.937819:0:92046:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff639652800 57943c9a-ca27-46d8-8845-5d2bce640e45 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838206.937823:0:92046:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8ff610240000) has exports, disconnecting them 00000020:00080000:0.0:1788838206.937828:0:92046:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.30@tcp (ffff8ff608eb1000), last request at 1788838201 00000020:00000080:0.0:1788838206.937844:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc93f4 00000020:00010000:0.0:1788838206.937848:0:92046:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff608eb1000: total 1 00000100:00080000:0.0:1788838206.937853:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff608eb6000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838206.937872:0:92046:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff608eb1000): rc 0 00000020:00080000:0.0:1788838206.937875:0:92046:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ff639652800), last request at 1788838177 00000020:00000080:0.0:1788838206.937884:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8ebb 00000020:00010000:0.0:1788838206.937887:0:92046:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff639652800: total 1 00000100:00080000:0.0:1788838206.937890:0:92046:0:(import.c:65:import_set_state_nolock()) ffff8ff639656800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838206.937897:0:92046:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff639652800): rc 0 00000020:00080000:0.0:1788838206.937901:0:92046:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ff610240000) has no exports 00000020:00010000:1.0:1788838206.937981:0:63563:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff608eb1000: total 1 00010000:00010000:1.0:1788838206.938016:0:63563:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff608eb1000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788838206.938044:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc93fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdc5 expref: 5 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938061:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5c00/0x88da08396ccc9410 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce04 expref: 4 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938142:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600031c00/0x88da08396ccc9402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdcc expref: 3 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938235:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600031800/0x88da08396ccc9409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cdfd expref: 2 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938245:0:63563:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff608eb1000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1788838206.938270:0:63563:0:(genops.c:885:class_export_put()) final put ffff8ff608eb1000/2af93169-6705-472b-b7ff-fd7cc5c04782 00000020:00010000:1.0:1788838206.938276:0:63563:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff639652800: total 2 00010000:00010000:1.0:1788838206.938312:0:63563:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff639652800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788838206.938327:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712d600/0x88da08396ccc9051 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc904a expref: 14 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938339:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8c00/0x88da08396ccc905f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9058 expref: 13 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938357:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148e800/0x88da08396ccc8fef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8fe8 expref: 12 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938368:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4a00/0x88da08396ccc906d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9066 expref: 11 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938378:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9000/0x88da08396ccc8ffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc8ff6 expref: 10 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938391:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc907b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9074 expref: 9 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938402:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712cc00/0x88da08396ccc900b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9004 expref: 8 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938548:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc9097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9090 expref: 7 pid: 91032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938558:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712c000/0x88da08396ccc9027 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9020 expref: 6 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938569:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9089 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9082 expref: 5 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938580:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712c400/0x88da08396ccc9019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9012 expref: 4 pid: 91036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938592:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148fe00/0x88da08396ccc9035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc902e expref: 3 pid: 91034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938628:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712d000/0x88da08396ccc9043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc903c expref: 2 pid: 91033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838206.938639:0:63563:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff639652800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788838206.938662:0:63563:0:(genops.c:885:class_export_put()) final put ffff8ff639652800/57943c9a-ca27-46d8-8845-5d2bce640e45 00010000:00010000:1.0:1788838206.938668:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838206.938670:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838206.938672:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838206.938681:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838206.938688:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6048e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788838206.938695:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff608eb1000/2af93169-6705-472b-b7ff-fd7cc5c04782 for MGS 00000020:00000080:1.0:1788838206.938731:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff639652800/57943c9a-ca27-46d8-8845-5d2bce640e45 for MGS 00000020:00000080:1.0:1788838206.938745:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff608eb6000 for MGS 00000020:00000080:1.0:1788838206.938754:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff639656800 for MGS 00000100:00100000:3.0:1788838206.944260:0:91036:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8ff62c852800:91036] 3 exiting: rc = 0 00000100:00100000:3.0:1788838206.944393:0:91034:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ff62c852400:91034] 2 exiting: rc = 0 00000100:00100000:2.0:1788838206.949671:0:91033:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ff627caf600:91033] 1 exiting: rc = 0 00000100:00100000:2.0:1788838206.950814:0:91032:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ff50586b200:91032] 0 exiting: rc = 1 00000100:00100000:0.0:1788838206.950897:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950907:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950917:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950924:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950932:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950939:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950948:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950955:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950965:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950970:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950979:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950985:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950990:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.950996:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951002:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951007:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951012:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951018:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951023:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951030:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951035:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951041:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951047:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951053:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951059:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951065:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951070:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951083:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951089:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951094:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951100:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951106:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951110:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951115:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951121:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951127:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951132:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951138:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951144:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951156:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951162:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951168:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951173:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951179:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951184:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951190:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951197:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951256:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951265:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951272:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951280:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951287:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951292:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951297:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951302:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951307:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951312:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951317:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951323:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951329:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951334:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951339:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951360:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838206.951370:0:92046:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788838206.952351:0:92046:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff610f24cc0 - data ffff8ff63fc8e438/ffff8ff6244d6c00 00000020:01000000:0.0:1788838206.952480:0:92046:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff610de84e0 - data ffff8ff63fe36bd0/ffff8ff639c5b400 00000020:00000080:0.0:1788838206.953087:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8ead 00000020:00000080:0.0:1788838206.953096:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff604965800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788838206.953116:0:92046:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff640eee800 from MGS, refs=2 00000020:01000004:0.0:1788838206.953120:0:92046:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff640eee800 2 00000020:01000004:0.0:1788838206.953123:0:92046:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff640eee800 from MGS 00000020:00000080:0.0:1788838206.953143:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838206.953151:0:92046:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788838206.953154:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff604962800/MGS 00000020:00000080:0.0:1788838206.953157:0:92046:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604962800/MGS for MGS 00000020:01000000:0.0:1788838206.953165:0:92046:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1788838206.953166:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604965800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788838206.953241:0:92046:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788838206.953246:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838206.953255:0:92046:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788838206.953326:0:92046:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ff50a580000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838206.953333:0:92046:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8ff6271ccd28) has exports, disconnecting them 00000020:00080000:0.0:1788838206.953339:0:92046:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ff50a580000), last request at 1788838177 00000020:00000080:0.0:1788838206.953343:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8fcc 00000020:00080000:0.0:1788838206.953354:0:92046:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff50a580000): rc 0 00000020:00000080:0.0:1788838206.953358:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff50a580000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788838206.953494:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50a580000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788838206.954885:0:92046:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788838206.954892:0:92046:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788838206.954896:0:92046:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788838206.954904:0:92046:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788838206.955059:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838206.955085:0:92046:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788838206.955092:0:92046:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff640eee800 1 00000020:00000080:0.0:1788838206.955098:0:92046:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc8e9f 00000020:00000080:0.0:1788838206.955116:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff604964000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788838206.955121:0:92046:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788838206.955124:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838206.955128:0:92046:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788838206.955132:0:92046:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ff6271cb370) has no exports 00000020:00000080:0.0:1788838206.959492:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff610292800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788838206.959512:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff609269000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788838206.959516:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff609269000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788838206.959524:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788838206.959620:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604964000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788838207.064271:0:92046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838207.064286:0:92046:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788838207.064292:0:92046:0:(genops.c:885:class_export_put()) final put ffff8ff640eec800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788838207.064296:0:92046:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640eec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788838207.064308:0:92046:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788838207.064425:0:92046:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ff640eea000 00000020:02000400:0.0:1788838207.064492:0:92046:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788838207.549175:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838208.573221:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838208.893661:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135096576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838208.893741:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838208.893852:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135096576 00000100:00100000:2.0:1788838208.893861:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135096576 00000100:00100000:2.0:1788838208.893914:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4160 00000100:00100000:2.0:1788838208.893921:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1875729135096576:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788838208.893929:0:8471:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788838208.893992:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3644:x1875729135096576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (250us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788838208.894000:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4160 00000100:02020000:1.0:1788838208.894022:0:3644:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788838208.894028:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788838208.894033:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788838208.894037:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788838208.894044:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838208.894048:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3577 00000100:00080000:1.0:1788838208.894055:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838208.894087:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639568e00 x1875729135096704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838208.894120:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135096704:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788838208.894147:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838208.894176:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135096704 00000100:00100000:1.0:1788838208.894181:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135096704 00000100:00100000:1.0:1788838208.894211:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4161 00000100:00100000:1.0:1788838208.894218:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135096704:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788838208.894240:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838208.894282:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135096704:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 64us (135us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838208.894290:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4161 00000100:00100000:1.0:1788838208.894527:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135096832:0@lo:400:kworker.0 00000400:00000100:1.0:1788838208.894565:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135096832 offset 0 length 224: 4 00000100:00100000:1.0:1788838208.894589:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135097344:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.894627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838208.894647:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788838208.894651:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff501afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135096960:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.894670:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838208.894686:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135097472:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.894708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838208.894744:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135097344 00000100:00100000:1.0:1788838208.894749:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135097344 00000100:00100000:1.0:1788838208.894794:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135096960 00000100:00100000:1.0:1788838208.894815:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135096960 00000100:00100000:1.0:1788838208.894846:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1788838208.894856:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135097344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.894905:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135097344:12345-0@lo:400:kworker.0 Request processed in 53us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838208.894911:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1788838208.894925:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1788838208.894929:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875729135096960:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788838208.894934:0:66253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788838208.894959:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875729135096960:12345-0@lo:400:kworker.0 Request processed in 29us (288us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788838208.894964:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00080000:1.0:1788838208.894981:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838208.894996:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135097088:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895022:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838208.895041:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135097600:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895065:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838208.895086:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788838208.895092:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135097216:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895116:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838208.895132:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135097728:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838208.895176:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135097088 00000100:00100000:1.0:1788838208.895180:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135097088 00000100:00100000:1.0:1788838208.895208:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135097216 00000100:00100000:1.0:1788838208.895211:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135097216 00000100:00100000:1.0:1788838208.895220:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135097728 00000100:00100000:1.0:1788838208.895223:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135097728 00000100:00100000:1.0:1788838208.895247:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1788838208.895254:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135097088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895296:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135097088:12345-0@lo:400:kworker.0 Request processed in 43us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838208.895302:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1788838208.895315:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1788838208.895319:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875729135097216:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788838208.895324:0:66255:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788838208.895346:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875729135097216:12345-0@lo:400:kworker.0 Request processed in 25us (230us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788838208.895352:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1788838208.895363:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1788838208.895368:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875729135097728:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788838208.895372:0:66255:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788838208.895395:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875729135097728:12345-0@lo:400:kworker.0 Request processed in 25us (241us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788838208.895400:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1788838208.895417:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135097472 00000100:00100000:1.0:1788838208.895421:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135097472 00000100:00100000:1.0:1788838208.895450:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135097600 00000100:00100000:1.0:1788838208.895453:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135097600 00000100:00100000:1.0:1788838208.895480:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:1.0:1788838208.895488:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135097472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895522:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135097472:12345-0@lo:400:kworker.0 Request processed in 36us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838208.895528:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:1.0:1788838208.895540:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:1.0:1788838208.895555:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135097600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895586:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135097600:12345-0@lo:400:kworker.0 Request processed in 34us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838208.895592:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00080000:1.0:1788838208.895634:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838208.895637:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838208.895639:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838208.895659:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788838208.895663:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788838208.895667:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788838208.895673:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838208.895676:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3577 00000100:00080000:1.0:1788838208.895683:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838208.895705:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63956a300 x1875729135097856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838208.895722:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135097216:0@lo:400:kworker.0 00000100:00080000:1.0:1788838208.895735:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788838208.895737:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788838208.895741:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788838208.895744:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838208.895748:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3577 00000100:00080000:1.0:1788838208.895752:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838208.895766:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639568a80 x1875729135097984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838208.895789:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135097728:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895830:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135097088:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895842:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135097600:0@lo:400:kworker.0 00000100:00080000:1.0:1788838208.895883:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788838208.895886:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788838208.895889:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788838208.895892:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838208.895895:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3577 00000100:00080000:1.0:1788838208.895899:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838208.895914:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63956bb80 x1875729135098112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838208.895925:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff501afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135096960:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895938:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135097472:0@lo:400:kworker.0 00000100:00100000:1.0:1788838208.895950:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135097344:0@lo:400:kworker.0 00000100:00100000:2.0:1788838208.899900:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135097856:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788838208.899990:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838208.900026:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135097984:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788838208.900049:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838208.900068:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135098112:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788838208.900089:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788838208.900124:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838208.900129:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838208.900133:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135096704:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788838208.900173:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135097856 00000100:00100000:2.0:1788838208.900179:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135097856 00000100:00100000:2.0:1788838208.900210:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135097984 00000100:00100000:2.0:1788838208.900213:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135097984 00000100:00100000:2.0:1788838208.900225:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135098112 00000100:00100000:2.0:1788838208.900228:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135098112 00000100:00100000:2.0:1788838208.900241:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1788838208.900247:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135097856:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788838208.900270:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838208.900322:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135097856:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 73us (331us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838208.900330:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1788838208.900359:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1788838208.900363:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135097984:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788838208.900373:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838208.900397:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135097984:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 32us (347us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838208.900402:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1788838208.900413:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1788838208.900416:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135098112:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788838208.900424:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838208.900447:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135098112:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 29us (357us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838208.900453:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00080000:2.0:1788838208.900477:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838208.900481:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838208.900484:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135097856:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788838208.900491:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838208.900494:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838208.900496:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135097984:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788838208.900502:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838208.900505:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838208.900507:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135098112:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1788838209.597103:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838210.621165:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838210.941846:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838210.941866:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135098240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838210.941935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838210.942429:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135098240 00000100:00100000:2.0:1788838210.942449:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135098240 00000100:00100000:2.0:1788838210.942521:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:2.0:1788838210.942531:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135098240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838210.942558:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838210.942617:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135098240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838210.942624:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00080000:1.0:1788838210.942624:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838210.942679:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135098240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838210.943624:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135098368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838210.943777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838210.943906:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135098368 00000100:00100000:2.0:1788838210.943912:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135098368 00000100:00100000:2.0:1788838210.943980:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:2.0:1788838210.943988:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135098368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838210.944011:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788838210.944089:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838210.944377:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135098368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 388us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838210.944384:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:1.0:1788838210.944458:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135098368:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788838211.645260:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1788838211.649321:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116442624 offset 0 length 224: 4 00000100:00100000:2.0:1788838211.649363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838211.649402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838211.649434:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838211.649471:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838211.649516:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116443008 00000100:00100000:2.0:1788838211.649525:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116443008 00000100:00100000:2.0:1788838211.649577:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116443136 00000100:00100000:2.0:1788838211.649590:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116443136 00000100:00100000:2.0:1788838211.649617:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2632 00000100:00100000:2.0:1788838211.649628:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2404:x1875729116443008:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838211.649677:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116442752 00000100:00100000:3.0:1788838211.649686:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116442752 00000100:00100000:3.0:1788838211.649717:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116442880 00000100:00100000:3.0:1788838211.649721:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116442880 00000100:00100000:2.0:1788838211.649726:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2404:x1875729116443008:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 99us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838211.649736:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2632 00000100:00100000:3.0:1788838211.649756:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1316 00000100:00100000:2.0:1788838211.649761:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2633 00000100:00100000:3.0:1788838211.649768:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116442880:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838211.649773:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2404:x1875729116443136:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838211.649905:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116442880:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 140us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838211.649912:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1316 00000100:00100000:3.0:1788838211.649993:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1323 00000100:00100000:3.0:1788838211.649999:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1875729116442752:12345-192.168.203.30@tcp:400:kworker.0 00000020:00080000:3.0:1788838211.650005:0:67312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.30@tcp 00000100:00100000:3.0:1788838211.650030:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2405:x1875729116442752:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (667us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838211.650035:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1323 00000100:00080000:0.0:1788838211.650454:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838211.650459:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838211.650462:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838211.652188:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2404:x1875729116443136:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2408us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838211.652202:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2633 00000100:00100000:2.0:1788838211.655329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838211.655501:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116443264 00000100:00100000:1.0:1788838211.655512:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116443264 00000100:00100000:1.0:1788838211.655566:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1324 00000100:00100000:1.0:1788838211.655575:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875729116443264:12345-192.168.203.30@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788838211.655610:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838211.655676:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875729116443264:12345-192.168.203.30@tcp:38:ptlrpcd_00_01.0 Request processed in 98us (353us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838211.655684:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1324 00000001:00100000:2.0:1788838211.976943:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788838211.976960:0:75678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411443 is committed 00000020:00000080:2.0:1788838211.976965:0:75678:0:(genops.c:885:class_export_put()) final put ffff8ff632f50000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1788838211.976987:0:75678:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444093 batchid updated 00000020:00080000:3.0:1788838211.977078:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444093 00000004:00080000:3.0:1788838211.977161:0:75698:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8ff6397850c0 with version 13 00000020:00080000:3.0:1788838211.977188:0:75698:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444093 cancel update log [0x2000090a1:0x2:0x0].4: rc = 0 00000004:00080000:0.0:1788838211.977318:0:75683:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8ff626ae9780 version 13 rpc_version 13 00000020:00100000:0.0:1788838211.977353:0:75683:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788838211.977373:0:75683:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8ff505ac6300 x1875729135098624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838211.977396:0:75683:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8ff505ac6300 x1875729135098624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838211.977406:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000020:00080000:3.0:1788838211.977562:0:75698:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444093 cancel update log [0x2400088d0:0x2:0x0].5: rc = 0 00000020:00080000:3.0:1788838211.977571:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444093 00000020:00000080:1.0:1788838211.978854:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632f50000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788838211.979028:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff632f51000 for lustre-MDT0001 00010000:00010000:0.0:1788838212.669023:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838212.988969:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000001:00100000:0.0:1788838212.992040:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838212.992050:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff604587800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788838212.992532:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604587800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788838212.992590:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff604584000 for lustre-OST0001 00000001:00100000:1.0:1788838212.996046:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788838212.996062:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff604fe4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788838212.996246:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604fe4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788838212.996437:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff604fe7800 for lustre-OST0000 00010000:00010000:1.0:1788838213.693634:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838214.013012:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1788838214.013019:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838214.013025:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838214.013029:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788838214.013031:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135098752:0@lo:400:kworker.0 00000100:00080000:3.0:1788838214.013046:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3602 00000100:00080000:3.0:1788838214.013052:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838214.013059:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838214.013084:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504ff9c00 x1875729135098880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1788838214.013093:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135098752 offset 0 length 224: 4 00000100:00080000:3.0:1788838214.013122:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838214.013127:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838214.013129:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838214.013133:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3602 00000100:00080000:3.0:1788838214.013136:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838214.013141:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838214.013150:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135099008:0@lo:400:kworker.0 00000100:00100000:3.0:1788838214.013156:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504ffa680 x1875729135099136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838214.013189:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1788838214.013191:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838214.013208:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838214.013210:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838214.013216:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3602 00000100:00080000:3.0:1788838214.013219:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838214.013222:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838214.013289:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135099264:0@lo:400:kworker.0 00000100:00100000:2.0:1788838214.013324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838214.013369:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135099008 00000100:00100000:2.0:1788838214.013376:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135099008 00000100:00100000:2.0:1788838214.013423:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135099264 00000100:00100000:2.0:1788838214.013426:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135099264 00000100:00100000:2.0:1788838214.013451:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:2.0:1788838214.013460:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135099008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838214.013507:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135099008:12345-0@lo:400:kworker.0 Request processed in 47us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838214.013514:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:2.0:1788838214.013544:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1788838214.013550:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135099264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838214.013603:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135099264:12345-0@lo:400:kworker.0 Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838214.013609:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1788838214.013648:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135099264:0@lo:400:kworker.0 00000100:00100000:0.0:1788838214.014107:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135098880:0@lo:38:kworker.0 00000100:00100000:0.0:1788838214.014139:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838214.014160:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135099136:0@lo:38:kworker.0 00000100:00100000:0.0:1788838214.014181:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838214.014211:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135098880 00000100:00100000:0.0:1788838214.014215:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135098880 00000100:00100000:0.0:1788838214.014235:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135099136 00000100:00100000:0.0:1788838214.014238:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135099136 00000100:00100000:0.0:1788838214.014252:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1788838214.014258:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135098880:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838214.014276:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838214.014310:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135098880:12345-0@lo:38:kworker.0 Request processed in 51us (170us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838214.014317:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1788838214.014330:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1788838214.014334:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135099136:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838214.014343:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838214.014366:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135099136:12345-0@lo:38:kworker.0 Request processed in 30us (184us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838214.014372:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00080000:0.0:1788838214.014388:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838214.014407:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838214.014411:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838214.014415:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135098880:0@lo:38:kworker.0 00000100:00080000:0.0:1788838214.014432:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838214.014436:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838214.014438:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135099136:0@lo:38:kworker.0 00000100:00100000:2.0:1788838214.014746:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838214.016540:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135099008:0@lo:400:kworker.0 00000100:00100000:3.0:1788838214.023661:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504ff8380 x1875729135099392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838214.023729:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788838214.023820:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135099392:0@lo:38:kworker.0 00000100:00100000:0.0:1788838214.023896:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838214.024042:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135099392 00000100:00100000:1.0:1788838214.024050:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135099392 00000100:00100000:0.0:1788838214.024097:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838214.024108:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135099648:0@lo:400:kworker.0 00000100:00100000:1.0:1788838214.024110:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4162 00000100:00100000:1.0:1788838214.024121:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135099392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838214.024146:0:37907:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838214.024146:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838214.024184:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135099648 00000100:00100000:0.0:1788838214.024188:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135099648 00000100:00100000:1.0:1788838214.024200:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135099392:12345-0@lo:38:kworker.0 Request processed in 79us (303us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838214.024208:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4162 00000100:00100000:0.0:1788838214.024241:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:0.0:1788838214.024250:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135099648:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788838214.024255:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838214.024261:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838214.024266:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135099392:0@lo:38:kworker.0 00000100:00100000:0.0:1788838214.024299:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135099648:12345-0@lo:400:kworker.0 Request processed in 49us (154us total) trans 0 rc 0/0 00000100:00080000:1.0:1788838214.024300:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838214.024309:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00000100:00100000:1.0:1788838214.024341:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135099648:0@lo:400:kworker.0 00000100:00100000:1.0:1788838214.024370:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135099520:0@lo:400:kworker.0 00000100:00100000:1.0:1788838214.024396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838214.024427:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135099520 00000100:00100000:1.0:1788838214.024431:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135099520 00000100:00100000:1.0:1788838214.024461:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:1.0:1788838214.024470:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135099520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838214.024506:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135099520:12345-0@lo:400:kworker.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838214.024513:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00080000:1.0:1788838214.024526:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838214.024541:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135099520:0@lo:400:kworker.0 00000100:00080000:3.0:1788838214.027193:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838214.027198:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838214.027206:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3602 00000100:00080000:3.0:1788838214.027212:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788838214.027219:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838214.027263:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504ffbb80 x1875729135099776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838214.028087:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135099776:0@lo:38:kworker.0 00000100:00100000:1.0:1788838214.028162:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838214.028374:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135099776 00000100:00100000:0.0:1788838214.028384:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135099776 00000100:00100000:0.0:1788838214.028432:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1788838214.028440:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135099776:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838214.028462:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838214.028511:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135099776:12345-0@lo:38:kworker.0 Request processed in 69us (348us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838214.028518:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00080000:1.0:1788838214.029209:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838214.029228:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838214.029232:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135099776:0@lo:38:kworker.0 00010000:00010000:1.0:1788838214.719621:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838215.042576:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788838215.743490:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838216.061298:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135100032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838216.061369:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838216.061479:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135100032 00000100:00100000:3.0:1788838216.061488:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135100032 00000100:00100000:3.0:1788838216.061561:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:3.0:1788838216.061572:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135100032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838216.061601:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838216.061650:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135100032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838216.061657:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00080000:2.0:1788838216.061725:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838216.061760:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135100032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838216.061826:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838216.061837:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135099904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838216.061882:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838216.062014:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135099904 00000100:00100000:2.0:1788838216.062018:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135099904 00000100:00100000:2.0:1788838216.062063:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:2.0:1788838216.062070:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135099904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838216.062087:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838216.062122:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135099904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838216.062128:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000100:00100000:2.0:1788838216.062158:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135099904:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788838216.062242:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838216.067071:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1788838216.765251:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788838216.770933:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116443392 offset 0 length 224: 4 00000100:00100000:3.0:1788838216.770970:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838216.771027:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838216.771056:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838216.771074:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838216.771197:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116443776 00000100:00100000:2.0:1788838216.771207:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116443776 00000100:00100000:2.0:1788838216.771275:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116443904 00000100:00100000:2.0:1788838216.771279:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116443904 00000100:00100000:2.0:1788838216.771305:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2636 00000100:00100000:2.0:1788838216.771315:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116443776:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838216.771403:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116443776:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 83us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838216.771411:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2636 00000100:00100000:2.0:1788838216.771428:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2637 00000100:00100000:2.0:1788838216.771434:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116443904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838216.771459:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116443904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838216.771466:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2637 00000100:00100000:1.0:1788838216.771823:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116443648 00000100:00100000:1.0:1788838216.771828:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116443648 00000100:00100000:1.0:1788838216.771860:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116443520 00000100:00100000:1.0:1788838216.771863:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116443520 00000100:00100000:1.0:1788838216.771882:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1319 00000100:00100000:1.0:1788838216.771892:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116443648:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838216.771924:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116443648:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838216.771929:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1319 00000100:00100000:1.0:1788838216.771942:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1328 00000100:00100000:1.0:1788838216.771946:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116443520:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:1.0:1788838216.771966:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838216.771992:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116443520:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 44us (916us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838216.771998:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1328 00000100:00080000:3.0:1788838216.774854:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838216.774865:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838216.774868:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838217.085820:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788838217.790839:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838218.110477:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788838218.813072:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838219.133642:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00080000:0.0:1788838219.133777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838219.133783:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838219.133786:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838219.133793:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3608 00000100:00080000:0.0:1788838219.133814:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788838219.133821:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838219.133843:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637f8ea00 x1875729135100288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838219.133885:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838219.133889:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838219.133891:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838219.133895:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3608 00000100:00080000:0.0:1788838219.133899:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788838219.133902:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838219.133908:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135100416:0@lo:400:kworker.0 00000100:00100000:0.0:1788838219.133928:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637f8f800 x1875729135100544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838219.133948:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838219.133951:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838219.133953:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838219.133956:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3608 00000100:00080000:0.0:1788838219.133960:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788838219.133963:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838219.133977:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637f8f100 x1875729135100800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838219.133986:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788838219.134025:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788838219.134028:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788838219.134029:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838219.134033:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788838219.134038:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135100672:0@lo:400:kworker.0 00000100:00080000:0.0:1788838219.134039:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3608 00000100:00080000:0.0:1788838219.134045:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788838219.134051:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838219.134067:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838219.134069:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50719ce00 x1875729135101184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838219.134102:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135100416 00000100:00100000:2.0:1788838219.134109:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135100416 00000100:00100000:1.0:1788838219.134156:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135100160:0@lo:400:kworker.0 00000400:00000100:1.0:1788838219.134187:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135100160 offset 0 length 224: 4 00000100:00100000:1.0:1788838219.134232:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135101056:0@lo:400:kworker.0 00000100:00100000:1.0:1788838219.134260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838219.134283:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135100672 00000100:00100000:1.0:1788838219.134285:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838219.134289:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135100672 00000100:00100000:1.0:1788838219.134294:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135100928:0@lo:400:kworker.0 00000100:00100000:2.0:1788838219.134326:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1788838219.134327:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838219.134340:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135100416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838219.134384:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135101056 00000100:00100000:1.0:1788838219.134390:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135101056 00000100:00100000:3.0:1788838219.134398:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135100288:0@lo:38:kworker.0 00000100:00100000:2.0:1788838219.134403:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135100416:12345-0@lo:400:kworker.0 Request processed in 65us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838219.134413:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1788838219.134433:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135100928 00000100:00100000:2.0:1788838219.134438:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1788838219.134439:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135100928 00000100:00100000:2.0:1788838219.134448:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135100672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838219.134456:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838219.134467:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:3.0:1788838219.134479:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135100544:0@lo:38:kworker.0 00000100:00100000:1.0:1788838219.134479:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135101056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838219.134502:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838219.134511:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135101056:12345-0@lo:400:kworker.0 Request processed in 38us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838219.134516:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135100800:0@lo:38:kworker.0 00000100:00100000:1.0:1788838219.134518:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1788838219.134541:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:3.0:1788838219.134549:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838219.134549:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135100928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838219.134565:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135101184:0@lo:38:kworker.0 00000100:00100000:1.0:1788838219.134575:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135100928:12345-0@lo:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838219.134582:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:3.0:1788838219.134584:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838219.134602:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135100288 00000100:00100000:1.0:1788838219.134606:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135100288 00000100:00080000:3.0:1788838219.134609:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838219.134611:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135100672:12345-0@lo:400:kworker.0 Request processed in 162us (542us total) trans 0 rc 0/0 00000100:00080000:3.0:1788838219.134613:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838219.134618:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838219.134618:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135100544 00000100:00100000:1.0:1788838219.134621:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135100544 00000100:00100000:2.0:1788838219.134624:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1788838219.134634:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135101184 00000100:00100000:3.0:1788838219.134637:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1788838219.134638:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135101184 00000100:00100000:3.0:1788838219.134643:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135100288:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788838219.134647:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1788838219.134654:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135100544:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838219.134671:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838219.134699:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135100544:12345-0@lo:38:kworker.0 Request processed in 43us (196us total) trans 0 rc -19/-19 00010000:00020000:3.0:1788838219.134787:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838219.134835:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135100288:12345-0@lo:38:kworker.0 Request processed in 190us (379us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838219.134983:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135100928:0@lo:400:kworker.0 00000100:00100000:0.0:1788838219.134993:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135101056:0@lo:400:kworker.0 00000100:00100000:0.0:1788838219.135024:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135100800 00000100:00100000:0.0:1788838219.135028:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135100800 00000100:00100000:0.0:1788838219.135050:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4163 00000100:00100000:0.0:1788838219.135054:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135100800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838219.135065:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838219.135225:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135100800:12345-0@lo:38:kworker.0 Request processed in 168us (674us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838219.135233:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4163 00000100:00100000:0.0:1788838219.135317:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135100672:0@lo:400:kworker.0 00000100:00100000:0.0:1788838219.135329:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135100416:0@lo:400:kworker.0 00000100:00080000:0.0:1788838219.137379:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838219.137391:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838219.137410:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135100288:0@lo:38:kworker.0 00000100:00080000:0.0:1788838219.137426:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838219.137429:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838219.137432:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135100544:0@lo:38:kworker.0 00000100:00080000:0.0:1788838219.137451:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838219.137455:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838219.137458:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135100800:0@lo:38:kworker.0 00000100:00100000:1.0:1788838219.141699:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1788838219.141712:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135101184:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838219.141738:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838219.141790:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1788838219.141860:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135101184:12345-0@lo:38:kworker.0 Request processed in 147us (7272us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838219.141868:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00080000:0.0:1788838219.142720:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838219.142728:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838219.142732:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135101184:0@lo:38:kworker.0 00000100:00100000:3.0:1788838219.143046:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000400:00000100:3.0:1788838219.326521:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116444032 offset 0 length 224: 4 00000100:00100000:3.0:1788838219.326575:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838219.326598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838219.326641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838219.326667:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838219.326691:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116444544 00000100:00100000:3.0:1788838219.326700:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116444544 00000100:00100000:3.0:1788838219.326751:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116444416 00000100:00100000:3.0:1788838219.326755:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116444416 00000100:00100000:3.0:1788838219.326777:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2640 00000100:00100000:3.0:1788838219.326786:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116444544:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838219.326873:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116444544:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 87us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838219.326880:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2640 00000100:00100000:3.0:1788838219.326899:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2641 00000100:00100000:3.0:1788838219.326905:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116444416:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838219.326930:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116444416:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838219.326936:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2641 00000100:00100000:3.0:1788838219.326956:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116444160 00000100:00100000:3.0:1788838219.326960:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116444160 00000100:00100000:3.0:1788838219.326980:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116444288 00000100:00100000:3.0:1788838219.326982:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116444288 00000100:00100000:3.0:1788838219.327216:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1322 00000100:00100000:3.0:1788838219.327227:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116444288:12345-192.168.203.30@tcp:38:kworker.0 00010000:02000400:3.0:1788838219.327249:0:67312:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0001: Client efc561ba-875e-4857-b79b-9bd7023bd57c (at 192.168.203.30@tcp) reconnecting 00000100:00080000:2.0:1788838219.332163:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838219.332174:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838219.332177:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838219.332207:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1332 00000100:00100000:2.0:1788838219.332217:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875729116444160:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:2.0:1788838219.332242:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838219.332472:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875729116444160:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 253us (5829us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838219.332480:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1332 00010000:00080000:3.0:1788838219.338698:0:67312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp t0 exp ffff8ff604960800 cur 3613 last 1788838219 00000004:00100000:3.0:1788838219.338741:0:67312:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli 192.168.203.30@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1788838219.338768:0:67312:0:(import.c:65:import_set_state_nolock()) ffff8ff604960000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788838219.338988:0:67312:0:(import.c:65:import_set_state_nolock()) ffff8ff604960000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838219.339134:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116444288:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 11908us (12465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838219.339309:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1322 00000100:00100000:0.0:1788838219.353116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838219.353147:0:66262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116441856 00000100:00100000:0.0:1788838219.353156:0:66262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116441856 00000100:00100000:0.0:1788838219.353202:0:66262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:0.0:1788838219.353212:0:66262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71015:x1875729116441856:12345-192.168.203.30@tcp:700:cp.0 00000100:00080000:0.0:1788838219.353273:0:66262:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8ff50719c700 x1875729135101312/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838219.353284:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:2.0:1788838219.837555:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838220.157019:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788838220.412899:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:1.0:1788838220.861912:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838221.181928:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788838221.181952:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135101440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838221.182033:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838221.182066:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838221.182072:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135101568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838221.182095:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838221.182181:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135101440 00000100:00100000:3.0:1788838221.182189:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135101440 00000100:00100000:3.0:1788838221.182253:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135101568 00000100:00100000:3.0:1788838221.182256:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135101568 00000100:00100000:3.0:1788838221.182272:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:3.0:1788838221.182282:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135101440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838221.182311:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838221.182357:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135101440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838221.182364:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:3.0:1788838221.182380:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:3.0:1788838221.182385:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135101568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838221.182411:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838221.182434:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135101568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838221.182439:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00080000:0.0:1788838221.182641:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838221.182646:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838221.182683:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135101568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838221.182696:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135101440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838221.449526:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:1.0:1788838221.891089:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838222.205067:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838222.460925:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:2.0:1788838222.912341:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838223.229370:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838223.484978:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:2.0:1788838223.935191:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788838224.189894:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838208/real 1788838208] req@ffff8ff503c3ca80 x1875729135096832/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838224 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838224.189963:0:3645:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8ff503c3ca80 x1875729135096832/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838224 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838224.189975:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788838224.189979:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788838224.189984:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788838224.189987:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788838224.189991:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff503c3ca80 x1875729135096832/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838224 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838224.190001:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff504ff9f80 x1875729135098752/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838230 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838224.190024:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff637f8dc00 x1875729135100160/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838235 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788838224.190048:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788838224.190051:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788838224.190053:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788838224.190055:0:3645:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788838224.190086:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135096832:0@lo:400:kworker.0 00000100:00100000:3.0:1788838224.190102:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135100160:0@lo:400:kworker.0 00000100:00100000:0.0:1788838224.190273:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135098752:0@lo:400:kworker.0 00000100:00080000:0.0:1788838224.190317:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838224.190322:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788838224.190325:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838224.190330:0:63434:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3571 00000100:00080000:0.0:1788838224.190341:0:63434:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838224.190377:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50719c000 x1875729135101696/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838224.190406:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838224.190410:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838224.190412:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838224.190416:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3613 00000100:00080000:0.0:1788838224.190420:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788838224.190424:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838224.190442:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50719f480 x1875729135101824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838224.190472:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1788838224.190476:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135101696:0@lo:250:kworker.0 00000100:00080000:0.0:1788838224.190476:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838224.190478:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838224.190481:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3613 00000100:00080000:0.0:1788838224.190492:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788838224.190507:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838224.190516:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135101952:0@lo:400:kworker.0 00000400:00000100:3.0:1788838224.193727:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135101696 offset 0 length 520: 4 00000100:00100000:0.0:1788838224.193744:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838224.193831:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135101824:0@lo:38:kworker.0 00000100:00100000:3.0:1788838224.193888:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838224.194070:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135101952 00000100:00100000:2.0:1788838224.194081:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135101952 00000100:00100000:2.0:1788838224.194151:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135101824 00000100:00100000:2.0:1788838224.194155:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135101824 00000100:00100000:2.0:1788838224.194176:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1788838224.194186:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135101952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838224.194253:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135101952:12345-0@lo:400:kworker.0 Request processed in 68us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838224.194260:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1788838224.194303:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1788838224.194308:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135101824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838224.194332:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838224.194371:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135101824:12345-0@lo:38:kworker.0 Request processed in 61us (482us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838224.194378:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00080000:3.0:1788838224.194519:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838224.194524:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838224.194528:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135101824:0@lo:38:kworker.0 00000100:00100000:0.0:1788838224.203184:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135101952:0@lo:400:kworker.0 00000100:00080000:0.0:1788838224.203260:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838224.203436:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50719f800 x1875729135102080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838224.203513:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838224.203518:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838224.203521:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788838224.203530:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135102080:0@lo:38:kworker.0 00000100:00080000:0.0:1788838224.203534:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3613 00000100:00080000:0.0:1788838224.203539:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788838224.203548:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838224.203555:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838224.203563:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135102208:0@lo:400:kworker.0 00000100:00100000:1.0:1788838224.204915:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50364b480 x1875729135102336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838224.204966:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838224.204971:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838224.204974:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838224.204979:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3613 00000100:00080000:1.0:1788838224.204983:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788838224.204988:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838224.204998:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504f05180 x1875729135102720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838224.210113:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135102464:0@lo:400:kworker.0 00000100:00100000:3.0:1788838224.210554:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838224.210633:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135102336:0@lo:38:kworker.0 00000100:00100000:3.0:1788838224.210675:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838224.210700:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135102720:0@lo:38:kworker.0 00000100:00100000:3.0:1788838224.210726:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838224.210880:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135102080 00000100:00100000:3.0:1788838224.210890:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135102080 00000100:00100000:3.0:1788838224.211372:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135102720 00000100:00100000:3.0:1788838224.211379:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135102720 00000100:00100000:3.0:1788838224.211410:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1788838224.211419:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135102080:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838224.211449:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838224.211533:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135102080:12345-0@lo:38:kworker.0 Request processed in 111us (978us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838224.211542:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1788838224.211564:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1788838224.211568:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135102720:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838224.211577:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838224.211605:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135102720:12345-0@lo:38:kworker.0 Request processed in 35us (877us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838224.211611:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1788838224.211662:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135102336 00000100:00100000:3.0:1788838224.211667:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135102336 00000100:00100000:3.0:1788838224.211694:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4164 00000100:00100000:3.0:1788838224.211699:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135102336:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838224.211710:0:8471:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838224.212511:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838224.213140:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135102336:12345-0@lo:38:kworker.0 Request processed in 1434us (2458us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838224.213155:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4164 00000100:00100000:3.0:1788838224.213868:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135102208 00000100:00100000:3.0:1788838224.213882:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135102208 00000100:00100000:3.0:1788838224.214316:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1788838224.214332:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135102208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838224.214446:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135102208:12345-0@lo:400:kworker.0 Request processed in 119us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838224.214641:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838224.214679:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838224.214692:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135102592:0@lo:400:kworker.0 00000100:00100000:1.0:1788838224.214727:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788838224.218114:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838224.218133:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838224.218140:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135102336:0@lo:38:kworker.0 00000100:00080000:2.0:1788838224.218160:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838224.218164:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838224.218168:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135102720:0@lo:38:kworker.0 00000100:00080000:2.0:1788838224.218181:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838224.218185:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838224.218188:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135102080:0@lo:38:kworker.0 00000100:00100000:0.0:1788838224.220668:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135102464 00000100:00100000:0.0:1788838224.220689:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135102464 00000100:00100000:0.0:1788838224.220776:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135102592 00000100:00100000:0.0:1788838224.220781:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135102592 00000100:00100000:0.0:1788838224.220836:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1788838224.220849:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135102464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838224.220853:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:2.0:1788838224.220864:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135102592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838224.222180:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00080000:3.0:1788838224.222252:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838224.222260:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838224.222264:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838224.235815:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135102464:12345-0@lo:400:kworker.0 Request processed in 14936us (21141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838224.235839:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1788838224.235981:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135102464:0@lo:400:kworker.0 00000100:00100000:2.0:1788838224.237120:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135102592:12345-0@lo:400:kworker.0 Request processed in 16249us (22383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838224.237134:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:3.0:1788838224.237474:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135102208:0@lo:400:kworker.0 00000100:00100000:0.0:1788838224.238550:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135102592:0@lo:400:kworker.0 00000100:00100000:0.0:1788838224.255042:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000400:00000100:0.0:1788838224.451571:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116444800 offset 0 length 224: 4 00000100:00100000:0.0:1788838224.451630:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838224.451675:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838224.451715:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116445184 00000100:00100000:0.0:1788838224.451727:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116445184 00000100:00100000:3.0:1788838224.452207:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116444928 00000100:00100000:3.0:1788838224.452218:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116444928 00000100:00100000:3.0:1788838224.452276:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1336 00000100:00100000:3.0:1788838224.452287:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116444928:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:3.0:1788838224.452319:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838224.452408:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116444928:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 120us (777us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838224.452447:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1336 00000100:00080000:3.0:1788838224.452473:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838224.452524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838224.452682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838224.453406:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116445056 00000100:00100000:1.0:1788838224.453428:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116445056 00000100:00100000:1.0:1788838224.453586:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1325 00000100:00100000:1.0:1788838224.453598:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2406:x1875729116445056:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838224.453690:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2406:x1875729116445056:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 95us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838224.453698:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1325 00000100:00080000:3.0:1788838224.457182:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838224.461224:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116445312 00000100:00100000:0.0:1788838224.461253:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116445312 00000100:00100000:0.0:1788838224.461397:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5965 00000100:00100000:0.0:1788838224.461412:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116445184:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:0.0:1788838224.461473:0:26214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9425 00000100:00080000:0.0:1788838224.461486:0:26214:0:(import.c:65:import_set_state_nolock()) ffff8ff63f7cd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788838224.461561:0:26214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:0.0:1788838224.461790:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+2:2403:x1875729116445184:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 381us (10113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838224.461826:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5965 00000100:00100000:0.0:1788838224.462169:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5966 00000100:00100000:0.0:1788838224.462181:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116445312:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:0.0:1788838224.462201:0:26214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc942c 00000100:00080000:0.0:1788838224.462207:0:26214:0:(import.c:65:import_set_state_nolock()) ffff8ff639650800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788838224.462241:0:26214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:0.0:1788838224.462332:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+2:2403:x1875729116445312:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 153us (9650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838224.462340:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5966 00010000:00010000:0.0:1788838224.464336:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838224.464352:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838224.471032:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838224.510509:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:2.0:1788838224.962872:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838225.281433:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838225.532910:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00000100:00100000:0.0:1788838225.789920:0:66263:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:0.0:1788838225.789941:0:66263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000020:01000004:0.0:1788838225.889481:0:92469:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788838225.889498:0:92469:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788838225.889500:0:92469:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788838225.889742:0:92469:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ff62ceaa000 00000020:01000004:0.0:1788838225.889766:0:92469:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788838225.889787:0:92469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788838225.889832:0:92469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ff503ca19b8) 00000020:00000080:0.0:1788838225.890030:0:92469:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788838225.980412:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00010000:00010000:2.0:1788838225.982227:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788838225.989626:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788838225.996828:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788838226.001705:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788838226.002585:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788838226.003092:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788838226.003420:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788838226.003777:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788838226.005710:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788838226.006583:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788838226.006917:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788838226.007198:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788838226.007600:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788838226.007900:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788838226.015013:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788838226.015950:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788838226.016223:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788838226.016459:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.017205:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.017502:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.017744:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.018077:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.018334:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.018585:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.018830:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.019118:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.019374:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.019609:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.020049:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.020294:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.020495:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.020693:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.021317:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.021623:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.021847:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.022164:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.022388:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.022614:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.022950:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.023218:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.023449:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.023691:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.023992:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.024510:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.026773:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788838226.027190:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.027566:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788838226.031097:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788838226.031683:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788838226.031975:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788838226.032782:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788838226.033387:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788838226.033635:0:92469:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788838226.034194:0:92469:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788838226.034406:0:92469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788838226.034414:0:92469:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788838226.034426:0:92469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc94b8 00000020:01000004:2.0:1788838226.034432:0:92469:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788838226.034444:0:92469:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788838226.034450:0:92469:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff62ceaa000 from MGS 00000020:01000004:2.0:1788838226.034453:0:92469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788838226.034463:0:92469:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ff61d0e3370) 00000020:00000080:2.0:1788838226.034475:0:92469:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1788838226.034547:0:92469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff62ceaa000 from MGS, refs=2 00080000:01000000:2.0:1788838226.034553:0:92469:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788838226.034558:0:92469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc94c6 00010000:00010000:2.0:1788838226.034669:0:92469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788838226.047531:0:92469:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788838226.056972:0:92474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788838226.057118:0:92469:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788838226.057182:0:92469:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788838226.057776:0:92469:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788838226.060291:0:92469:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788838226.060516:0:92469:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788838226.060535:0:92469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788838226.063065:0:92469:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788838226.063078:0:92469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788838226.065786:0:92469:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788838226.065830:0:92469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788838226.066504:0:92469:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788838226.066529:0:92469:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788838226.066530:0:92469:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788838226.066534:0:92469:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788838226.066540:0:92469:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 64, was 0): CONNECTING 00000100:00100000:0.0:1788838226.066545:0:92469:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:0.0:1788838226.301125:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135102848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838226.301222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838226.301337:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135102848 00000100:00100000:3.0:1788838226.301346:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135102848 00000100:00100000:3.0:1788838226.301411:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:3.0:1788838226.301422:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135102848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838226.301452:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838226.301507:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135102848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838226.301515:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00080000:0.0:1788838226.301648:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838226.301685:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135102848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838226.304430:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135102976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838226.304514:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838226.304641:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:2.0:1788838226.304701:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135102976 00000100:00100000:2.0:1788838226.304710:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135102976 00000100:00100000:2.0:1788838226.304780:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:2.0:1788838226.304789:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135102976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838226.304836:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838226.304892:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135102976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838226.304900:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:1.0:1788838226.305093:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135102976:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788838226.305212:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838226.560983:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:0.0:1788838227.005144:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838227.325027:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838227.580932:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00000100:00100000:0.0:1788838228.029028:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838228.029077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838228.029156:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1788838228.029224:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838228.029435:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116445440 00000100:00100000:1.0:1788838228.029446:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116445440 00000100:00100000:1.0:1788838228.029505:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1788838228.029514:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6411ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1875729116445440:12345-192.168.203.30@tcp:250:kworker.0 00010000:00080000:1.0:1788838228.029545:0:92475:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp t0 exp 0000000000000000 cur 3622 last 0 00000020:00000080:1.0:1788838228.029578:0:92475:0:(genops.c:1385:class_connect()) connect: client 2af93169-6705-472b-b7ff-fd7cc5c04782, cookie 0x88da08396ccc94cd 00000100:00080000:1.0:1788838228.029718:0:92475:0:(import.c:65:import_set_state_nolock()) ffff8ff50711b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838228.029792:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6411ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+5:2403:x1875729116445440:12345-192.168.203.30@tcp:250:kworker.0 Request processed in 276us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838228.029830:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1788838228.029992:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116445696 00000100:00100000:3.0:1788838228.029997:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116445696 00000100:00100000:3.0:1788838228.030039:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116445568 00000100:00100000:3.0:1788838228.030043:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116445568 00000100:00100000:3.0:1788838228.030058:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1326 00000100:00100000:3.0:1788838228.030065:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2405:x1875729116445696:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838228.030101:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2405:x1875729116445696:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838228.030107:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1326 00000100:00100000:3.0:1788838228.030122:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1337 00000100:00100000:3.0:1788838228.030127:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116445568:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:3.0:1788838228.030142:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838228.030179:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875729116445568:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 50us (1023us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838228.030186:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1337 00000100:00080000:3.0:1788838228.030203:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838228.349461:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838228.604937:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:2.0:1788838229.053094:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838229.055718:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838229.056559:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838229.056689:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116445824 00000100:00100000:2.0:1788838229.056708:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116445824 00000100:00100000:2.0:1788838229.056833:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1788838229.056846:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6411ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+5:2404:x1875729116445824:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838229.056933:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6411ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+5:2404:x1875729116445824:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 89us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838229.056957:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:0.0:1788838229.057027:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116446080 00000100:00100000:0.0:1788838229.057038:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116446080 00000100:00100000:0.0:1788838229.057110:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1327 00000100:00100000:0.0:1788838229.057121:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2404:x1875729116446080:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838229.057193:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2404:x1875729116446080:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838229.057201:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1327 00000100:00100000:1.0:1788838229.057439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838229.058458:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116445952 00000100:00100000:2.0:1788838229.058481:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116445952 00000100:00100000:2.0:1788838229.058539:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1338 00000100:00100000:2.0:1788838229.058547:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116445952:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:2.0:1788838229.058574:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838229.058628:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875729116445952:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 81us (1190us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838229.058635:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1338 00000100:00100000:0.0:1788838229.373055:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00080000:1.0:1788838229.373163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838229.373171:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788838229.373175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838229.373180:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838229.373210:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838229.373220:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3618 00000100:00080000:1.0:1788838229.373227:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838229.373236:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838229.374084:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff610ad1c00 x1875729135103104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838229.374166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838229.374171:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838229.374175:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838229.374179:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3618 00000100:00080000:1.0:1788838229.374182:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838229.374188:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838229.374209:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5048d0000 x1875729135103360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838229.374227:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838229.374231:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838229.374232:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838229.374236:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3618 00000100:00080000:1.0:1788838229.374239:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838229.374243:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838229.374257:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5048d3100 x1875729135103616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838229.374304:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838229.374308:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838229.374545:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838229.374551:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3618 00000100:00080000:1.0:1788838229.374554:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838229.374560:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838229.374577:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd6df80 x1875729135104000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838229.374623:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135103872:0@lo:400:kworker.0 00000100:00100000:0.0:1788838229.375122:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135103232:0@lo:400:kworker.0 00000100:00100000:0.0:1788838229.375172:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838229.375225:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838229.375232:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135103488:0@lo:400:kworker.0 00000100:00100000:0.0:1788838229.375255:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838229.375300:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135103232 00000100:00100000:2.0:1788838229.375561:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135103104:0@lo:38:kworker.0 00000100:00100000:2.0:1788838229.375603:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838229.375634:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135103360:0@lo:38:kworker.0 00000100:00100000:2.0:1788838229.375660:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838229.375678:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135103616:0@lo:38:kworker.0 00000100:00100000:2.0:1788838229.375703:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838229.375731:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135104000:0@lo:38:kworker.0 00000100:00100000:2.0:1788838229.375757:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838229.375822:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135103488 00000100:00100000:2.0:1788838229.375826:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135103488 00000100:00100000:0.0:1788838229.375990:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135103232 00000100:00100000:0.0:1788838229.376070:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135103104 00000100:00100000:0.0:1788838229.376074:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135103104 00000100:00100000:0.0:1788838229.376084:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135103360 00000100:00100000:0.0:1788838229.376087:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135103360 00000100:00100000:0.0:1788838229.376094:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135104000 00000100:00100000:0.0:1788838229.376096:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135104000 00000100:00100000:0.0:1788838229.376107:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1788838229.376119:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135103232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838229.376194:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135103232:12345-0@lo:400:kworker.0 Request processed in 77us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838229.376202:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1788838229.376225:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1788838229.376230:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135103104:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838229.376254:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838229.376292:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135103104:12345-0@lo:38:kworker.0 Request processed in 60us (688us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838229.376299:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1788838229.376323:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1788838229.376565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838229.376606:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838229.376617:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135103744:0@lo:400:kworker.0 00000100:00100000:1.0:1788838229.376652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838229.376691:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135103872 00000100:00100000:1.0:1788838229.376696:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135103872 00000100:00100000:1.0:1788838229.376732:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135103744 00000100:00100000:1.0:1788838229.376736:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135103744 00000100:00100000:1.0:1788838229.376762:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:1.0:1788838229.376770:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135103872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838229.377026:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1788838229.377033:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135103488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838229.377069:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135103488:12345-0@lo:400:kworker.0 Request processed in 36us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838229.377076:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1788838229.377103:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:2.0:1788838229.377108:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135104000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838229.377126:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838229.377153:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135104000:12345-0@lo:38:kworker.0 Request processed in 45us (1396us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838229.377160:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:2.0:1788838229.377185:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:2.0:1788838229.377192:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135103744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838229.377222:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135103744:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838229.377227:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00080000:2.0:1788838229.377284:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838229.377289:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838229.377293:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135103104:0@lo:38:kworker.0 00000100:00080000:2.0:1788838229.377304:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838229.377308:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838229.377310:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135104000:0@lo:38:kworker.0 00000100:00080000:3.0:1788838229.377590:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838229.377597:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838229.377600:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838229.377677:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135103616 00000100:00100000:3.0:1788838229.377683:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135103616 00000100:00100000:3.0:1788838229.377714:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4165 00000100:00100000:3.0:1788838229.377721:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135103616:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838229.377736:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838229.377777:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135103616:12345-0@lo:38:kworker.0 Request processed in 56us (2072us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838229.377784:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4165 00000100:00100000:3.0:1788838229.377862:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135103488:0@lo:400:kworker.0 00000100:00100000:3.0:1788838229.377878:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135103232:0@lo:400:kworker.0 00000100:00100000:3.0:1788838229.378065:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135103744:0@lo:400:kworker.0 00000100:00100000:3.0:1788838229.378079:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135103872:0@lo:400:kworker.0 00000100:00100000:0.0:1788838229.378227:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135103360:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838229.378242:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838229.378279:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135103360:12345-0@lo:38:kworker.0 Request processed in 1950us (2618us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838229.378286:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1788838229.378551:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135103872:12345-0@lo:400:kworker.0 Request processed in 1779us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838229.378561:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000100:00080000:2.0:1788838229.378663:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838229.378670:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838229.378675:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135103360:0@lo:38:kworker.0 00000100:00080000:2.0:1788838229.378685:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838229.378689:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838229.378692:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135103616:0@lo:38:kworker.0 00000100:00100000:1.0:1788838229.629130:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00000100:00100000:0.0:1788838229.697946:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838229.698580:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116446208 00000100:00100000:2.0:1788838229.698613:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116446208 00000100:00100000:2.0:1788838229.698689:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1788838229.698704:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6411ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+5:70927:x1875729116446208:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838229.698728:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838229.698759:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff600031600/0x88da08396ccc94d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce5f expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838229.698830:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600031600/0x88da08396ccc94d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce5f expref: 6 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838229.698846:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff600031600/0x88da08396ccc94d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce5f expref: 6 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838229.698857:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600031600, rc 0) 00000100:00100000:2.0:1788838229.698944:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6411ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70927:x1875729116446208:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 243us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838229.698951:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1788838229.705598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838229.705881:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116446336 00000100:00100000:1.0:1788838229.705897:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116446336 00000100:00100000:1.0:1788838229.705990:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1788838229.706005:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70927:x1875729116446336:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788838229.706373:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70927:x1875729116446336:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 Request processed in 371us (791us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838229.706404:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1788838229.730647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838229.731229:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116446464 00000100:00100000:1.0:1788838229.731248:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116446464 00000100:00100000:1.0:1788838229.731386:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:1.0:1788838229.731400:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70927:x1875729116446464:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838229.731425:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838229.731458:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712da00/0x88da08396ccc94db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce66 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838229.731511:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712da00/0x88da08396ccc94db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce66 expref: 7 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838229.731526:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712da00/0x88da08396ccc94db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce66 expref: 7 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838229.731536:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712da00, rc 0) 00000100:00100000:1.0:1788838229.731628:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+7:70927:x1875729116446464:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 230us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838229.731636:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1788838229.736746:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838229.736963:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116446592 00000100:00100000:2.0:1788838229.736977:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116446592 00000100:00100000:2.0:1788838229.737316:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1788838229.737330:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+7:70927:x1875729116446592:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788838229.738946:0:92478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788838229.739930:0:92476:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 121 20000000:01000000:3.0:1788838229.746330:0:92479:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788838229.746860:0:92479:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788838229.746865:0:92479:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788838229.746868:0:92479:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788838229.747858:0:92479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788838229.749397:0:92476:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788838229.749522:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116446592:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 12187us (12781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838229.749542:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1788838229.752672:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838229.752870:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116446720 00000100:00100000:1.0:1788838229.752885:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116446720 00000100:00100000:1.0:1788838229.755558:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1788838229.755590:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116446720:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838229.755846:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116446720:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 271us (3184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838229.755854:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1788838229.764067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838229.764556:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116446848 00000100:00100000:0.0:1788838229.764571:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116446848 00000100:00100000:0.0:1788838229.764641:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1788838229.764653:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116446848:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838229.764675:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838229.764713:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50b8e4000/0x88da08396ccc94e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce6d expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838229.764748:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50b8e4000/0x88da08396ccc94e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce6d expref: 9 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838229.764762:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50b8e4000/0x88da08396ccc94e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce6d expref: 9 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838229.764773:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50b8e4000, rc 0) 00000100:00100000:0.0:1788838229.764891:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116446848:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 239us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838229.764899:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1788838229.767995:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838229.768312:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116446976 00000100:00100000:1.0:1788838229.768326:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116446976 00000100:00100000:1.0:1788838229.768405:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1788838229.768418:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116446976:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838229.768653:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116446976:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 238us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838229.768662:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1788838229.771717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838229.772354:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116447104 00000100:00100000:2.0:1788838229.772369:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116447104 00000100:00100000:2.0:1788838229.772442:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1788838229.772453:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116447104:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838229.772680:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116447104:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 226us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838229.772696:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1788838229.778057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838229.778167:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116447232 00000100:00100000:0.0:1788838229.778181:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116447232 00000100:00100000:0.0:1788838229.778264:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1788838229.778277:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116447232:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838229.778320:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838229.778357:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50b8e5200/0x88da08396ccc94e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce74 expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838229.778402:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50b8e5200/0x88da08396ccc94e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce74 expref: 10 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838229.778418:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50b8e5200/0x88da08396ccc94e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce74 expref: 10 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838229.778430:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50b8e5200, rc 0) 00000100:00100000:0.0:1788838229.778524:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116447232:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 248us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838229.778532:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1788838229.782735:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838229.782844:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116447360 00000100:00100000:2.0:1788838229.782858:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116447360 00000100:00100000:2.0:1788838229.783322:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:2.0:1788838229.783335:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116447360:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838229.783510:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116447360:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 178us (791us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788838229.783519:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000001:00100000:2.0:1788838229.889274:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000020:00000080:2.0:1788838229.889286:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff509c65000/efc561ba-875e-4857-b79b-9bd7023bd57c 00000020:00000080:1.0:1788838229.893708:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff509c65000/efc561ba-875e-4857-b79b-9bd7023bd57c for lustre-OST0001 00000020:00000080:1.0:1788838229.894526:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff639650800 for lustre-OST0001 00000001:00100000:0.0:1788838229.897936:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000020:00000080:0.0:1788838229.897951:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff50d51f800/efc561ba-875e-4857-b79b-9bd7023bd57c 00000020:00000080:1.0:1788838229.899119:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d51f800/efc561ba-875e-4857-b79b-9bd7023bd57c for lustre-OST0000 00000020:00000080:1.0:1788838229.899242:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff63f7cd800 for lustre-OST0000 00010000:00010000:2.0:1788838230.077908:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838230.396952:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838230.652978:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:0.0:1788838231.101026:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838231.421004:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838231.422108:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135104128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838231.422212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838231.422468:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135104128 00000100:00100000:0.0:1788838231.422480:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135104128 00000100:00100000:0.0:1788838231.422555:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:0.0:1788838231.422567:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135104128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838231.422607:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00080000:2.0:1788838231.423050:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838231.423073:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135104256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838231.423114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838231.423162:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135104256 00000100:00100000:2.0:1788838231.423168:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135104256 00000100:00100000:2.0:1788838231.423199:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1788838231.423206:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135104256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838231.423227:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838231.423277:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135104256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838231.423285:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00080000:2.0:1788838231.423313:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838231.423359:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135104256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838231.425871:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135104128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3292us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838231.425888:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:1.0:1788838231.426626:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135104128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838231.676959:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:0.0:1788838232.126982:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838232.445406:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838232.701082:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:2.0:1788838233.149961:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838233.469138:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838233.725760:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00000100:00100000:2.0:1788838234.172520:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838234.172593:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838234.172744:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116447488 00000100:00100000:1.0:1788838234.172759:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116447488 00000100:00100000:1.0:1788838234.172875:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1788838234.172888:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116447488:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838234.172996:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116447488:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 110us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838234.173026:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1788838234.173264:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116447616 00000100:00100000:3.0:1788838234.173270:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116447616 00000100:00100000:3.0:1788838234.173317:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1342 00000100:00100000:3.0:1788838234.173323:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116447616:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:3.0:1788838234.173348:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838234.173380:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116447616:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 56us (787us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838234.173385:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1342 00010000:00010000:2.0:1788838234.174590:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838234.181009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838234.181207:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116447744 00000100:00100000:2.0:1788838234.181222:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116447744 00000100:00100000:2.0:1788838234.181339:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1330 00000100:00100000:2.0:1788838234.181353:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2405:x1875729116447744:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838234.181472:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2405:x1875729116447744:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 122us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.181480:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1330 00000100:00080000:0.0:1788838234.181960:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838234.493031:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838234.493045:0:63434:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788838234.493049:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838234.493054:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838234.493060:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838234.493072:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3623 00000100:00080000:3.0:1788838234.493078:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838234.493089:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838234.493541:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639541500 x1875729135104384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838234.493611:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838234.493617:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838234.493619:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838234.493625:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3623 00000100:00080000:3.0:1788838234.493629:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838234.493636:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838234.493653:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639541180 x1875729135104640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838234.493707:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838234.493710:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838234.493712:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838234.493717:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3623 00000100:00080000:3.0:1788838234.493720:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838234.493726:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838234.493742:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639540000 x1875729135104896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838234.493789:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838234.493793:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788838234.493795:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788838234.493864:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135104512:0@lo:400:kworker.0 00000100:00100000:1.0:1788838234.493975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838234.494025:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838234.494034:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135104768:0@lo:400:kworker.0 00000100:00100000:1.0:1788838234.494073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838234.494117:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135104512 00000100:00100000:1.0:1788838234.494125:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135104512 00000100:00100000:0.0:1788838234.494209:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788838234.494231:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135104768 00000100:00100000:0.0:1788838234.494236:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135104768 00000100:00100000:2.0:1788838234.494289:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838224/real 1788838224] req@ffff8ff50719c000 x1875729135101696/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838234 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838234.494305:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1788838234.494317:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ff50719c000 x1875729135101696/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838234 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838234.494320:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135104512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838234.494343:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135104384:0@lo:38:kworker.0 00000100:00100000:2.0:1788838234.494394:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838234.494402:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135104512:12345-0@lo:400:kworker.0 Request processed in 85us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838234.494412:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1788838234.494426:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135104640:0@lo:38:kworker.0 00000100:00100000:2.0:1788838234.494466:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.494488:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135104896:0@lo:38:kworker.0 00000100:00100000:0.0:1788838234.494495:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135104384 00000100:00100000:0.0:1788838234.494501:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135104384 00000100:00100000:0.0:1788838234.494515:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135104640 00000100:00100000:0.0:1788838234.494518:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135104640 00000100:00100000:2.0:1788838234.494522:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.494533:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1788838234.494542:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135104768:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788838234.494547:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838234.494565:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788838234.494588:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135101696:0@lo:250:kworker.0 00000100:00100000:0.0:1788838234.494592:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135104768:12345-0@lo:400:kworker.0 Request processed in 49us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.494601:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1788838234.494623:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1788838234.494628:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135104384:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788838234.494647:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00010000:00020000:0.0:1788838234.494651:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838234.494657:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135104640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838234.494671:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838234.494696:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135104384:12345-0@lo:38:kworker.0 Request processed in 65us (301us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838234.494705:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1788838234.494712:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135104640:12345-0@lo:38:kworker.0 Request processed in 56us (245us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838234.494720:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 10000000:01000000:0.0:1788838234.494730:0:92469:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788838234.494752:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50718e800/0x88da08396ccc9082 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9089 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.494765:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718e800/0x88da08396ccc9082 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9089 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.494773:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788838234.494788:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.494824:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50718e800/0x88da08396ccc9082 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9089 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.494846:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712c600/0x88da08396ccc8fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8fef expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.494854:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712c600/0x88da08396ccc8fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8fef expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.494860:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838234.494864:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.494869:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712c600/0x88da08396ccc8fe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8fef expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.494881:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9c00/0x88da08396ccc9004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc900b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.494888:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9c00/0x88da08396ccc9004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc900b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.494893:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838234.494898:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.494901:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9c00/0x88da08396ccc9004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc900b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.494912:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712d800/0x88da08396ccc902e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9035 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.494919:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712d800/0x88da08396ccc902e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9035 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.494936:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838234.494940:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.494945:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712d800/0x88da08396ccc902e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9035 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.494956:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50718e000/0x88da08396ccc903c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9043 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.494963:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718e000/0x88da08396ccc903c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9043 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.494969:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838234.494972:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.494975:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50718e000/0x88da08396ccc903c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9043 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.494984:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148e600/0x88da08396ccc9058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc905f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.494991:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148e600/0x88da08396ccc9058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc905f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.494996:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838234.495000:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.495003:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148e600/0x88da08396ccc9058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc905f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.495014:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396ccc9066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc906d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.495031:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396ccc9066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc906d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.495037:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838234.495041:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.495045:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396ccc9066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc906d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.495055:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50718f000/0x88da08396ccc9090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9097 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.495062:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718f000/0x88da08396ccc9090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9097 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.495067:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838234.495071:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.495075:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50718f000/0x88da08396ccc9090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9097 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.495088:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc8ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc8ffd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.495095:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc8ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc8ffd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.495101:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838234.495105:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.495108:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712c800/0x88da08396ccc8ff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc8ffd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.495133:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9019 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.495140:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9019 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.495145:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838234.495149:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.495153:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9019 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.495165:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148fc00/0x88da08396ccc9020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9027 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.495172:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148fc00/0x88da08396ccc9020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9027 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.495177:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838234.495180:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.495184:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148fc00/0x88da08396ccc9020 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9027 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.495193:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc904a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9051 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.495200:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc904a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9051 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.495206:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838234.495215:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.495220:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc904a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9051 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.495230:0:92469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50718f800/0x88da08396ccc9074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc907b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.495237:0:92469:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50718f800/0x88da08396ccc9074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc907b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.495242:0:92469:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788838234.495246:0:92469:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788838234.495249:0:92469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50718f800/0x88da08396ccc9074 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc907b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788838234.495266:0:92469:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 64, was 0): DISCONN 00000100:00080000:0.0:1788838234.495272:0:92469:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838234.495277:0:92469:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3618 00000100:00080000:0.0:1788838234.495282:0:92469:0:(import.c:589:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838234.495286:0:92469:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838234.495311:0:92469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50719c000 x1875729135105280/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838234.495327:0:92469:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1788838234.495353:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135105280:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788838234.495395:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788838234.495459:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838234.495464:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838234.495468:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135104384:0@lo:38:kworker.0 00000100:00080000:0.0:1788838234.495497:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838234.495506:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838234.495511:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135104640:0@lo:38:kworker.0 00000100:00100000:2.0:1788838234.495538:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135105280 00000100:00100000:2.0:1788838234.495546:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135105280 00000100:00100000:0.0:1788838234.495550:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135105152:0@lo:400:kworker.0 00000100:00100000:2.0:1788838234.495580:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788838234.495591:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1875729135105280:12345-0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788838234.495592:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788838234.495616:0:92475:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo t0 exp 0000000000000000 cur 3628 last 0 00000100:00100000:0.0:1788838234.495624:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838234.495634:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135105024:0@lo:400:kworker.0 00000020:00000080:2.0:1788838234.495655:0:92475:0:(genops.c:1385:class_connect()) connect: client 57943c9a-ca27-46d8-8845-5d2bce640e45, cookie 0x88da08396ccc94f0 00000100:00100000:0.0:1788838234.495665:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.495701:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135105152 00000100:00100000:0.0:1788838234.495705:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135105152 00000100:00100000:0.0:1788838234.495742:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135105024 00000100:00100000:0.0:1788838234.495745:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135105024 00000100:00100000:0.0:1788838234.495769:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646 00000100:00100000:0.0:1788838234.495776:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135105152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838234.495857:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135105152:12345-0@lo:400:kworker.0 Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.495864:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646 00000100:00100000:0.0:1788838234.495877:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647 00000100:00100000:0.0:1788838234.495883:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135105024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838234.495910:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135105024:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.495915:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647 00000100:00100000:0.0:1788838234.495960:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135105024:0@lo:400:kworker.0 00000100:00100000:0.0:1788838234.495969:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135105152:0@lo:400:kworker.0 00000100:00080000:0.0:1788838234.496114:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838234.496128:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838234.496131:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838234.496162:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135104768:0@lo:400:kworker.0 00000100:00100000:0.0:1788838234.496180:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135104512:0@lo:400:kworker.0 00000100:00100000:0.0:1788838234.496254:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135104896 00000100:00100000:0.0:1788838234.496259:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135104896 00000100:00100000:0.0:1788838234.496290:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4166 00000100:00100000:0.0:1788838234.496295:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135104896:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838234.496311:0:8471:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838234.496360:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135104896:12345-0@lo:38:kworker.0 Request processed in 62us (1838us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838234.496368:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4166 00000100:00080000:0.0:1788838234.496408:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838234.496413:0:92475:0:(import.c:65:import_set_state_nolock()) ffff8ff50d58e800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788838234.496413:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838234.496421:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135104896:0@lo:38:kworker.0 00000100:00100000:2.0:1788838234.496483:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:3642:x1875729135105280:12345-0@lo:250:mount.lustre.0 Request processed in 893us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.496492:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788838234.496510:0:3642:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 28 00000100:00080000:0.0:1788838234.496519:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1788838234.496528:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788838234.496534:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788838234.496537:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788838234.496540:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788838234.496563:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788838234.496573:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135105280:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1788838234.496587:0:92469:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1788838234.496601:0:92469:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000000:0.0:1788838234.496616:0:36:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.130@tcp 10000000:01000000:0.0:1788838234.496634:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1788838234.496638:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788838234.496641:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788838234.496644:0:92469:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788838234.496650:0:92469:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000004:0.0:1788838234.496652:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838234.496656:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838234.496657:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838234.496659:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838234.496661:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788838234.496663:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838234.496664:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788838234.496702:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788838234.496710:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788838234.496712:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788838234.496713:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788838234.496714:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838234.496716:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838234.496717:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838234.496718:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838234.496720:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788838234.496721:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838234.496722:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788838234.496735:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788838234.496739:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788838234.496741:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788838234.496742:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788838234.496743:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838234.496744:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838234.496746:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838234.496747:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838234.496748:0:36:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838234.496750:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838234.496751:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788838234.496769:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788838234.496832:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135105664:0@lo:253:kworker.0 00000100:00100000:0.0:1788838234.496868:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.496913:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135105664 00000100:00100000:0.0:1788838234.496918:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135105664 00000100:00100000:0.0:1788838234.496948:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788838234.496957:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+5:3643:x1875729135105664:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788838234.496985:0:92476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788838234.497007:0:92476:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000040:01000000:2.0:1788838234.497046:0:92469:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788838234.497077:0:92469:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788838234.497081:0:92469:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788838234.497082:0:92469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838234.497084:0:92469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838234.497085:0:92469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838234.497086:0:92469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838234.497092:0:92469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838234.497093:0:92469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838234.497096:0:92469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838234.497097:0:92469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838234.497098:0:92469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788838234.497101:0:92469:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788838234.497104:0:92469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788838234.497104:0:92469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838234.497106:0:92469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838234.497107:0:92469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838234.497108:0:92469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838234.497109:0:92469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838234.497110:0:92469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838234.497112:0:92469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838234.497113:0:92469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838234.497114:0:92469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788838234.497132:0:92469:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788838234.497132:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135105536:0@lo:253:kworker.0 00000100:00100000:2.0:1788838234.497145:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135105792:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788838234.497180:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.497193:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.497204:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838234.497212:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135105408:0@lo:253:kworker.0 00000100:00100000:2.0:1788838234.497223:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608b99240 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.497241:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135105536 00000100:00100000:0.0:1788838234.497246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.497247:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135105536 00000100:00100000:2.0:1788838234.497276:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135105792 00000100:00100000:2.0:1788838234.497279:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135105792 00000100:00100000:2.0:1788838234.497291:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135105408 00000100:00100000:2.0:1788838234.497292:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135105408 00000100:00100000:2.0:1788838234.497302:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788838234.497307:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6049b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3646:x1875729135105536:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788838234.497327:0:92477:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:3.0:1788838234.497592:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3623 00000100:00080000:3.0:1788838234.497597:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788838234.497605:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838234.497635:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff610ad1180 x1875729135105920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838234.498189:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135105920:0@lo:38:kworker.0 00000100:00100000:0.0:1788838234.498426:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.499054:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135105920 00000100:00100000:2.0:1788838234.499063:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135105920 00000100:00100000:2.0:1788838234.499123:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:2.0:1788838234.499131:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135105920:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838234.499158:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838234.499358:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135105920:12345-0@lo:38:kworker.0 Request processed in 225us (931us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838234.499367:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00080000:3.0:1788838234.501040:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838234.501053:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838234.501058:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135105920:0@lo:38:kworker.0 20000000:01000000:2.0:1788838234.506173:0:92477:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788838234.506350:0:92476:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788838234.506486:0:92476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788838234.506585:0:92478:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788838234.506592:0:92478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788838234.506620:0:92478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.506646:0:92478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff600031600/0x88da08396ccc94d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce5f expref: 9 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.506657:0:92478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.506714:0:92478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff600031600/0x88da08396ccc94d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce5f expref: 9 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.506734:0:92478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff600031600/0x88da08396ccc94d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce5f expref: 9 pid: 92476 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838234.506755:0:92478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92478:1875729135106048:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788838234.507080:0:92478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608b999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838234.513381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838234.513708:0:92478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92478:1875729135106048:192.168.203.30@tcp:104: 00010000:00010000:2.0:1788838234.513748:0:92478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838234.514073:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116447872 00000100:00100000:3.0:1788838234.514084:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116447872 00010000:00010000:3.0:1788838234.514142:0:6531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff600031600/0x88da08396ccc94d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce5f expref: 10 pid: 92476 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838234.514216:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2549 00000100:00100000:3.0:1788838234.514228:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116447872:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788838234.514249:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838234.514256:0:6531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff600031600/0x88da08396ccc94d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce5f expref: 10 pid: 92476 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514270:0:6531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff600031600/0x88da08396ccc94d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce5f expref: 10 pid: 92476 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514295:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600031600/0x88da08396ccc94d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce5f expref: 10 pid: 92476 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514320:0:6531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514330:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788838234.514348:0:6531:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007757429s 00010000:00010000:3.0:1788838234.514353:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514361:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514369:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514376:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514391:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838234.514396:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514406:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514442:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.514456:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838234.515859:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:2404:x1875729116447872:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1619us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838234.515875:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2549 00010000:00010000:2.0:1788838234.516144:0:92478:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.516185:0:92478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.516193:0:92478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600030800/0x88da08396ccc94f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838234.519113:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3643:x1875729135105664:12345-0@lo:253:kworker.0 Request processed in 22144us (22229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.519133:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788838234.519193:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788838234.519209:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6049b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+7:92469:x1875729135105792:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788838234.519268:0:92476:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788838234.519272:0:92476:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788838234.519275:0:92476:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788838234.519283:0:92476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:3.0:1788838234.519409:0:3643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788838234.519413:0:3643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788838234.519414:0:3643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838234.519416:0:3643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838234.519417:0:3643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838234.519419:0:3643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838234.519421:0:3643:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838234.519423:0:3643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838234.519425:0:3643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788838234.519441:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135105664:0@lo:253:kworker.0 20000000:01000000:2.0:1788838234.519588:0:92477:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788838234.519607:0:92477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788838234.519943:0:92478:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788838234.519949:0:92478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788838234.519977:0:92478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.519997:0:92478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788838234.521308:0:92478:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007757429s 00010000:00010000:3.0:1788838234.521318:0:92478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.521328:0:92478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.521337:0:92478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.521346:0:92478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.521354:0:92478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838234.521359:0:92478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.521369:0:92478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.521387:0:92478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.521396:0:92478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.521403:0:92478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc94fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838234.522124:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6049b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+7:3646:x1875729135105536:12345-0@lo:253:kworker.0 Request processed in 24806us (24934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.522137:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788838234.522196:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788838234.522212:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6049b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+6:3646:x1875729135105408:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788838234.522251:0:92477:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788838234.522271:0:92477:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:1.0:1788838234.524078:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788838234.524087:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788838234.524088:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838234.524090:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838234.524091:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838234.524095:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838234.524096:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838234.524098:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838234.524100:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788838234.524108:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135105536:0@lo:253:kworker.0 00000100:00100000:0.0:1788838234.525747:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6049b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+6:92469:x1875729135105792:12345-0@lo:253:mount.lustre.0 Request processed in 6533us (28542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.525765:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 20000000:01000000:1.0:1788838234.526081:0:92477:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788838234.526101:0:92477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788838234.526281:0:92478:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788838234.526305:0:92478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788838234.526335:0:92478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.526356:0:92478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788838234.526369:0:92478:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007757429s 00010000:00010000:3.0:1788838234.526376:0:92478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.526384:0:92478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.526392:0:92478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.526400:0:92478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.526407:0:92478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838234.526413:0:92478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.526422:0:92478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.526451:0:92478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.526461:0:92478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.526478:0:92478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9505 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838234.526630:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6049b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+5:3646:x1875729135105408:12345-0@lo:253:kworker.0 Request processed in 4421us (29380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838234.526649:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:01000004:0.0:1788838234.526771:0:3646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788838234.526775:0:3646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788838234.526776:0:3646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838234.526777:0:3646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838234.526779:0:3646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838234.526780:0:3646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838234.526781:0:3646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788838234.526784:0:3646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838234.526791:0:3646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788838234.526980:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135105408:0@lo:253:kworker.0 00000100:00100000:2.0:1788838234.527359:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135105792:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788838234.527373:0:92469:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788838234.527376:0:92469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788838234.527377:0:92469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838234.527378:0:92469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838234.527379:0:92469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838234.527380:0:92469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838234.527382:0:92469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838234.527383:0:92469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838234.527384:0:92469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838234.527386:0:92469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838234.527387:0:92469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788838234.527414:0:92469:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff62ceaa000 from lustre-MDT0000 10000000:01000000:2.0:1788838234.527491:0:92469:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788838234.527495:0:92469:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788838234.527516:0:92469:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ff62ceaa000 10000000:01000000:2.0:1788838234.527521:0:92469:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788838234.527527:0:92469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ff62ceaa000 10000000:01000000:2.0:1788838234.527529:0:92469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788838234.527533:0:92469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff62ceaa000 from 1 10000000:01000000:2.0:1788838234.527536:0:92469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788838234.527579:0:92469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.527589:0:92469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.527600:0:92469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838234.527625:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135106176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838234.527682:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.527783:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608b99780 going to sleep for 11 seconds 00000100:00100000:0.0:1788838234.528072:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135106176 00000100:00100000:0.0:1788838234.528080:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135106176 00000100:00100000:0.0:1788838234.528527:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788838234.528541:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:92469:x1875729135106176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838234.528561:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838234.528583:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50b8e4c00/0x88da08396ccc9513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc950c expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.528613:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50b8e4c00/0x88da08396ccc9513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc950c expref: 6 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.528625:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50b8e4c00/0x88da08396ccc9513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc950c expref: 6 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.528636:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50b8e4c00, rc 0) 00000100:00100000:0.0:1788838234.528786:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+6:92469:x1875729135106176:12345-0@lo:101:mount.lustre.0 Request processed in 247us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.528794:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788838234.528934:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135106176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838234.528954:0:92469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.528965:0:92469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838234.528984:0:92469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788838234.529047:0:92469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.529057:0:92469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838234.529065:0:92469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788838234.529072:0:92469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788838234.529078:0:92469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ff62ceaa000 10000000:01000000:1.0:1788838234.529082:0:92469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788838234.529086:0:92469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788838234.529088:0:92469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788838234.529116:0:92469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.529124:0:92469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.529133:0:92469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838234.529170:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135106304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788838234.529212:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838234.529244:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624ea6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838234.529263:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135106304 00000100:00100000:1.0:1788838234.529270:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135106304 00000100:00100000:1.0:1788838234.529349:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788838234.529358:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+6:92469:x1875729135106304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838234.529368:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838234.529383:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712c200/0x88da08396ccc9521 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc951a expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.529422:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712c200/0x88da08396ccc9521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc951a expref: 7 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.529454:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712c200/0x88da08396ccc9521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc951a expref: 7 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.529461:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c200, rc 0) 00000100:00100000:1.0:1788838234.529489:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+7:92469:x1875729135106304:12345-0@lo:101:mount.lustre.0 Request processed in 133us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838234.529495:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788838234.529552:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135106304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838234.529562:0:92469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.529570:0:92469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838234.529630:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135106432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838234.529662:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.529734:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135106432 00000100:00100000:2.0:1788838234.529739:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135106432 00000100:00100000:0.0:1788838234.529743:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50379b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.529760:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788838234.529767:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+7:92469:x1875729135106432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838234.530068:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:92469:x1875729135106432:12345-0@lo:501:mount.lustre.0 Request processed in 300us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.530077:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788838234.530092:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135106432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838234.530124:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135106560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838234.530172:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.530229:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50379b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838234.530266:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135106560 00000100:00100000:3.0:1788838234.530271:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135106560 00000100:00100000:3.0:1788838234.530334:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788838234.530342:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:92469:x1875729135106560:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838234.531141:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:92469:x1875729135106560:12345-0@lo:503:mount.lustre.0 Request processed in 795us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838234.531151:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788838234.531272:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135106560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788838234.531660:0:92481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92481:1875729135106688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838234.531700:0:92481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838234.531731:0:92481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.531759:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135106688 00000100:00100000:2.0:1788838234.531766:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135106688 00000100:00100000:2.0:1788838234.531827:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838234.531836:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:92481:x1875729135106688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838234.532419:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:92481:x1875729135106688:12345-0@lo:502:llog_process_th.0 Request processed in 581us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.532440:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788838234.532539:0:92481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92481:1875729135106688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788838234.532574:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838234.532587:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838234.532590:0:92481:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788838234.532596:0:92481:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788838234.532599:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788838234.532617:0:92481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ff6271c8000) 00000020:00000080:3.0:1788838234.532641:0:92481:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1788838234.532647:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788838234.532740:0:92481:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788838234.532747:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc952f 00000020:00000080:3.0:1788838234.533406:0:92481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788838234.533413:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838234.533418:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838234.533444:0:92481:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788838234.533448:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838234.533453:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838234.533455:0:92481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788838234.533458:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788838234.533469:0:92481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ff6271cb370) 00000020:00000080:3.0:1788838234.533487:0:92481:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1788838234.533491:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788838234.533493:0:92481:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788838234.533497:0:92481:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788838234.533504:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788838234.533567:0:92481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff62ceaa000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788838234.533581:0:92481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ff6271ccd28) 00000020:00000080:3.0:1788838234.533591:0:92481:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1788838234.533659:0:92481:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788838234.533666:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc9544 00000020:00000080:3.0:1788838234.533785:0:92481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788838234.533794:0:92481:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788838234.533846:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88da08396ccc954b 00080000:01000000:3.0:1788838234.533854:0:92481:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788838234.533858:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc9552 00010000:00010000:2.0:1788838234.680683:0:92481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788838234.682675:0:92481:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 115964116995 lx: 0 gen 22 00000001:00080000:2.0:1788838234.682758:0:92481:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: efc561ba-875e-4857-b79b-9bd7023bd57c idx: 2 lr: 0 srv lr: 115964116995 lx: 0 gen 24 00000001:00000004:2.0:1788838234.682785:0:92481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116995 00000001:00080000:2.0:1788838234.684745:0:92481:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788838234.684899:0:92481:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff608b99780: xid 1875729135092096, transno 115964116995, client gen 22, slot idx 1 00000020:00000080:2.0:1788838234.685857:0:92481:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ff61d0e0000) 00000020:00000080:2.0:1788838234.685896:0:92481:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788838234.686001:0:92481:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788838234.686022:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc956e 00000020:00000080:3.0:1788838234.686950:0:92481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788838234.716051:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88da08396ccc9575 00000020:00000080:0.0:1788838234.718419:0:92481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788838234.718450:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838234.718461:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.718464:0:92481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788838234.718467:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838234.718471:0:92481:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788838234.718473:0:92481:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838234.718474:0:92481:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838234.718476:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838234.718479:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.718480:0:92481:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838234.718483:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838234.718489:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.718491:0:92481:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788838234.718496:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788838234.718573:0:92481:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788838234.718596:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838234.718599:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.718601:0:92481:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788838234.718604:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838234.718608:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.718609:0:92481:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788838234.718612:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838234.718618:0:92481:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:0.0:1788838234.718654:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838234.718697:0:92481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ff503ca3370) 00000020:00000080:0.0:1788838234.718724:0:92481:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788838234.718733:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838234.718854:0:92481:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788838234.718862:0:92481:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788838234.718869:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc9583 00010000:00080000:0.0:1788838234.718922:0:92481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff619428000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788838234.731023:0:92481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1788838234.732654:0:92481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838234.732674:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788838234.732728:0:92481:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788838234.732761:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc958a 00000100:00080000:0.0:1788838234.732774:0:92481:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788838234.732780:0:92481:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ff619428000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838234.733281:0:92481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639540000 x1875729135106816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838234.733363:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135106816:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838234.733690:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838234.733837:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135106816 00000100:00100000:1.0:1788838234.733848:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135106816 00000100:00100000:1.0:1788838234.733919:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4167 00000100:00100000:1.0:1788838234.733929:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135106816:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788838234.733961:0:23765:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3628 last 0 00000020:00000080:1.0:1788838234.734005:0:23765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc9591 00000004:00100000:1.0:1788838234.734025:0:23765:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788838234.734179:0:92481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788838234.734278:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838234.734285:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.734287:0:92481:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788838234.734291:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838234.734294:0:92481:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788838234.734296:0:92481:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838234.734298:0:92481:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838234.734300:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838234.734302:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.734304:0:92481:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838234.734307:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788838234.734314:0:92481:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788838234.734328:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.734330:0:92481:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788838234.734334:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838234.734346:0:92481:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1788838234.734372:0:92481:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788838234.734375:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838234.734394:0:92481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ff503ca0000) 00000020:00000080:0.0:1788838234.734545:0:92481:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788838234.734553:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838234.734653:0:92481:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788838234.734660:0:92481:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788838234.734669:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc959f 00010000:00080000:0.0:1788838234.734710:0:92481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff50a587800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788838234.734978:0:92481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:1.0:1788838234.737210:0:23765:0:(import.c:65:import_set_state_nolock()) ffff8ff632f50800 : changing import state from RECOVER to FULL 00000040:01000000:0.0:1788838234.744315:0:92481:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788838234.744947:0:92481:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788838234.747206:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135106816:12345-0@lo:38:llog_process_th.0 Request processed in 13203us (13442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838234.747224:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4167 00000100:00100000:0.0:1788838234.749033:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00000100:00100000:3.0:1788838234.758706:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838234.758729:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1788838234.758741:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788838234.758748:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788838234.758753:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff619428000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788838234.758772:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135106816:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838234.760692:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838234.760742:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135106944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838234.760886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838234.760968:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135106944 00000100:00100000:3.0:1788838234.760977:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135106944 00000040:00080000:2.0:1788838234.761160:0:92481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788838234.761288:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4168 00000100:00100000:3.0:1788838234.761300:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135106944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838234.761348:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:3.0:1788838234.762606:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135106944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1299us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838234.762622:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4168 00000040:00080000:0.0:1788838234.763054:0:92481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000100:00100000:2.0:1788838234.763064:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135106944:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788838234.764594:0:92481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:2.0:1788838234.766682:0:92487:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1788838234.766692:0:92487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788838234.776605:0:92481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838234.776630:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788838234.776693:0:92481:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788838234.777016:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc95a6 00000100:00080000:0.0:1788838234.777031:0:92481:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788838234.777037:0:92481:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff50a587800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838234.777089:0:92481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639541880 x1875729135107072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838234.777123:0:92481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788838234.777211:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838234.777216:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.777218:0:92481:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788838234.777221:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788838234.777225:0:92481:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788838234.777243:0:92481:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838234.777245:0:92481:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788838234.777247:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788838234.777250:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.777251:0:92481:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788838234.777254:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788838234.777259:0:92481:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788838234.777263:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838234.777264:0:92481:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788838234.777268:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788838234.777272:0:92481:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1788838234.777305:0:92481:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788838234.777308:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838234.777324:0:92481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ff503ca4d28) 00000020:00000080:0.0:1788838234.777344:0:92481:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788838234.777351:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788838234.777561:0:92481:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788838234.777570:0:92481:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788838234.777578:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc95b4 00010000:00080000:0.0:1788838234.777620:0:92481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff5031c1000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1788838234.778421:0:92481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:3.0:1788838234.779551:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135107072:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788838234.779661:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1788838234.780056:0:92481:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788838234.780077:0:92481:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788838234.780251:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135107072 00000100:00100000:1.0:1788838234.780262:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135107072 00000100:00100000:1.0:1788838234.780302:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5967 00000100:00100000:1.0:1788838234.780312:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3642:x1875729135107072:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788838234.780352:0:26209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3628 last 0 00000020:00000080:1.0:1788838234.780386:0:26209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc95bb 00002000:00100000:1.0:1788838234.780404:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ff632f53000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788838234.780409:0:26209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788838234.780412:0:26209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788838234.780581:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788838234.780617:0:26209:0:(import.c:65:import_set_state_nolock()) ffff8ff632f52800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838234.780705:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135107072:12345-0@lo:8:llog_process_th.0 Request processed in 392us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838234.780714:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5967 00000100:00100000:3.0:1788838234.780885:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838234.780897:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788838234.780907:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788838234.780913:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788838234.780915:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff50a587800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788838234.780938:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788838234.780944:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135107072:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1788838234.781014:0:92487:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788838234.781086:0:92487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3628800287354ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788838234.781093:0:92487:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788838234.781348:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838234.781361:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135107200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838234.781418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.783258:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135107200 00000100:00100000:0.0:1788838234.783275:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135107200 00000100:00100000:0.0:1788838234.783367:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:0.0:1788838234.783378:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135107200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838234.783422:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00080000:1.0:1788838234.783695:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838234.784273:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135107200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 893us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.784285:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1788838234.786823:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135107200:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788838234.791034:0:92481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838234.791717:0:92481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:1.0:1788838234.792594:0:92481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000004:00080000:3.0:1788838234.796412:0:92470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1788838234.804525:0:92489:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:3.0:1788838234.804536:0:92489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788838234.805689:0:92481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838234.805709:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788838234.805764:0:92481:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788838234.805968:0:92481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc95c2 00000100:00080000:1.0:1788838234.805982:0:92481:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788838234.805988:0:92481:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ff5031c1000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838234.806343:0:92481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff503c3ca80 x1875729135107328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838234.806377:0:92481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788838234.806493:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838234.806512:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838234.806514:0:92481:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788838234.806518:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838234.806522:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838234.806524:0:92481:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788838234.806528:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788838234.806530:0:92481:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788838234.806534:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838234.806536:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838234.806538:0:92481:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788838234.806540:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838234.806542:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838234.806544:0:92481:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788838234.806548:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788838234.806595:0:92481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92481:1875729135107456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838234.806702:0:92481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.806769:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135107456 00000100:00100000:2.0:1788838234.806777:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135107456 00000100:00100000:2.0:1788838234.806850:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838234.806861:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:92481:x1875729135107456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838234.807006:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:92481:x1875729135107456:12345-0@lo:502:llog_process_th.0 Request processed in 145us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.807015:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788838234.807076:0:92481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60925f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.807103:0:92481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92481:1875729135107456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838234.807133:0:92481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838234.807138:0:92481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838234.807151:0:92481:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788838234.807156:0:92481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788838234.807233:0:92469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788838234.807277:0:92469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788838234.807294:0:92469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.807307:0:92469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838234.807317:0:92469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff62ceaa000 from 1 10000000:01000000:2.0:1788838234.807320:0:92469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788838234.807356:0:92469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.807364:0:92469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.807374:0:92469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838234.807389:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135107584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838234.807423:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.807455:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60925f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.807475:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135107584 00000100:00100000:2.0:1788838234.807480:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135107584 00000100:00100000:2.0:1788838234.807506:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788838234.807513:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:92469:x1875729135107584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838234.807524:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838234.807542:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff600030000/0x88da08396ccc95d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc95c9 expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.807570:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600030000/0x88da08396ccc95d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc95c9 expref: 9 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.807593:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff600030000/0x88da08396ccc95d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc95c9 expref: 9 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.807604:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030000, rc 0) 00000100:00100000:2.0:1788838234.807636:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:92469:x1875729135107584:12345-0@lo:101:mount.lustre.0 Request processed in 123us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.807642:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788838234.807675:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135107584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838234.807688:0:92469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.807697:0:92469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838234.808315:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135107712:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788838234.808368:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.808406:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60925f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.808443:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135107712 00000100:00100000:2.0:1788838234.808448:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135107712 00000100:00100000:2.0:1788838234.808481:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788838234.808490:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:92469:x1875729135107712:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788838234.808509:0:92476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788838234.808532:0:92476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788838234.808536:0:92476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788838234.808539:0:92476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788838234.808541:0:92476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 124 00000100:00100000:2.0:1788838234.808640:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:92469:x1875729135107712:12345-0@lo:256:mount.lustre.0 Request processed in 150us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.808648:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788838234.808695:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135107712:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788838234.811440:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135107328:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788838234.811560:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.811730:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135107328 00000100:00100000:0.0:1788838234.811740:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135107328 00000100:00100000:0.0:1788838234.811793:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5968 00000100:00100000:0.0:1788838234.811837:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3642:x1875729135107328:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788838234.811878:0:26217:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3628 last 0 00000020:00000080:0.0:1788838234.811915:0:26217:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc95d7 00002000:00100000:0.0:1788838234.811933:0:26217:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ff5031c7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788838234.811939:0:26217:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788838234.811942:0:26217:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788838234.812045:0:26217:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788838234.812077:0:26217:0:(import.c:65:import_set_state_nolock()) ffff8ff5031c2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838234.812155:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135107328:12345-0@lo:8:llog_process_th.0 Request processed in 306us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.812162:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5968 00000100:00100000:3.0:1788838234.812489:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788838234.812501:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788838234.812528:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788838234.812534:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788838234.812537:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5031c1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788838234.812558:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788838234.812564:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135107328:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788838234.812597:0:92489:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788838234.812685:0:92489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3628831887075ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788838234.812693:0:92489:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788838234.814566:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135107840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838234.814661:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788838234.817389:0:92470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:2.0:1788838234.817822:0:92469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788838234.817843:0:92469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.817860:0:92469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838234.817895:0:92469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff62ceaa000 from 1 10000000:01000000:2.0:1788838234.817898:0:92469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838234.821672:0:92469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.821693:0:92469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.821709:0:92469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838234.821741:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135107968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838234.822296:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.822396:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60925f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788838234.823416:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135107840 00000100:00100000:0.0:1788838234.823441:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135107840 00000100:00100000:0.0:1788838234.823535:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:0.0:1788838234.823548:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135107840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788838234.823592:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838234.823685:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135107840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (9023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.823692:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:0.0:1788838234.823768:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135107840:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788838234.823917:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838234.828846:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135107968 00000100:00100000:3.0:1788838234.828868:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135107968 00000100:00100000:3.0:1788838234.829071:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788838234.829086:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+9:92469:x1875729135107968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838234.829110:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838234.829137:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc95e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc95de expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.829187:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc95e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc95de expref: 10 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.829201:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc95e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc95de expref: 10 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838234.829212:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5200, rc 0) 00000100:00100000:3.0:1788838234.829320:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:92469:x1875729135107968:12345-0@lo:101:mount.lustre.0 Request processed in 237us (7025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838234.829328:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788838234.829484:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135107968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838234.829510:0:92469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.829522:0:92469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838234.829633:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135108096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838234.829679:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.836914:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505b6d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.839582:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135108096 00000100:00100000:2.0:1788838234.839606:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135108096 00000100:00100000:2.0:1788838234.839707:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788838234.839721:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:92469:x1875729135108096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838234.840038:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:92469:x1875729135108096:12345-0@lo:501:mount.lustre.0 Request processed in 319us (10357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.840047:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788838234.840364:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135108096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838234.840441:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135108224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838234.840504:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.840544:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135108224 00000100:00100000:0.0:1788838234.840550:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135108224 00000100:00100000:0.0:1788838234.840576:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788838234.840584:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:92469:x1875729135108224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838234.840680:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:92469:x1875729135108224:12345-0@lo:503:mount.lustre.0 Request processed in 96us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.840688:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788838234.840761:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505b6d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788838234.840777:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135108224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838234.842031:0:92491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92491:1875729135108352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838234.842116:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.842165:0:92491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60925f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788838234.842483:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135108352 00000100:00100000:0.0:1788838234.842492:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135108352 00000100:00100000:0.0:1788838234.842542:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788838234.842562:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:92491:x1875729135108352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838234.844448:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:92491:x1875729135108352:12345-0@lo:502:llog_process_th.0 Request processed in 1865us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.844464:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788838234.844682:0:92491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92491:1875729135108352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838234.844733:0:92491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838234.844745:0:92491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838234.844748:0:92491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788838234.844758:0:92491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff62ceaa000 00000020:00000080:2.0:1788838234.844762:0:92491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788838234.844773:0:92491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838234.844775:0:92491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838234.844777:0:92491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788838234.844779:0:92491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838234.844782:0:92491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838234.844783:0:92491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788838234.844786:0:92491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff62ceaa000 00000020:00000080:2.0:1788838234.844788:0:92491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788838234.844958:0:92491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92491:1875729135108480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838234.845022:0:92491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.845069:0:92491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff508ba49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838234.849331:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135108480 00000100:00100000:0.0:1788838234.849353:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135108480 00000100:00100000:0.0:1788838234.850446:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788838234.850467:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:92491:x1875729135108480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838234.850715:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:92491:x1875729135108480:12345-0@lo:502:llog_process_th.0 Request processed in 255us (5691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.850724:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788838234.856983:0:92491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92491:1875729135108480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788838234.857044:0:92491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838234.857057:0:92491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838234.857060:0:92491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788838234.857066:0:92491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788838234.857749:0:92469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788838234.857787:0:92469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838234.857875:0:92469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.857890:0:92469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.860717:0:92469:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788838234.860730:0:92469:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ff62ceaa000 10000000:01000000:0.0:1788838234.860735:0:92469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ff62ceaa000 10000000:01000000:0.0:1788838234.860741:0:92469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788838234.860752:0:92469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff62ceaa000 from 1 10000000:01000000:0.0:1788838234.860756:0:92469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788838234.861241:0:92469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.861256:0:92469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.861293:0:92469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838234.861326:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135108608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838234.861423:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.863098:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608b99240 going to sleep for 11 seconds 00000100:00100000:0.0:1788838234.863157:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135108608 00000100:00100000:0.0:1788838234.863170:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135108608 00000100:00100000:0.0:1788838234.863242:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788838234.863254:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:92469:x1875729135108608:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838234.863276:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838234.863302:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50b8e4600/0x88da08396ccc95f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc95ec expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.863338:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50b8e4600/0x88da08396ccc95f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc95ec expref: 11 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.863351:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50b8e4600/0x88da08396ccc95f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc95ec expref: 11 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.863362:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50b8e4600, rc 0) 00000100:00100000:2.0:1788838234.866004:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639543480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135108608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838234.866042:0:92469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.866059:0:92469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838234.866203:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135108736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838234.873333:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.873407:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff508ba4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838234.873750:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92469:x1875729135108608:12345-0@lo:101:mount.lustre.0 Request processed in 10493us (12322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.873762:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788838234.873849:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135108736 00000100:00100000:0.0:1788838234.873859:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135108736 00000100:00100000:0.0:1788838234.873900:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788838234.874683:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92469:x1875729135108736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838234.876078:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92469:x1875729135108736:12345-0@lo:501:mount.lustre.0 Request processed in 1397us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.876094:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788838234.876729:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135108736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838234.878044:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135108864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838234.878160:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.878212:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.878551:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135108864 00000100:00100000:2.0:1788838234.878561:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135108864 00000100:00100000:2.0:1788838234.878629:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788838234.878641:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92469:x1875729135108864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838234.878843:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92469:x1875729135108864:12345-0@lo:503:mount.lustre.0 Request processed in 204us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.878852:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788838234.881615:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135108864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838234.883583:0:92494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92494:1875729135108992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838234.883694:0:92494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.883759:0:92494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.886133:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135108992 00000100:00100000:2.0:1788838234.886162:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135108992 00000100:00100000:2.0:1788838234.886236:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788838234.886261:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92494:x1875729135108992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838234.886513:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92494:x1875729135108992:12345-0@lo:502:llog_process_th.0 Request processed in 266us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.886523:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788838234.886904:0:92494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92494:1875729135108992:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788838234.886994:0:92494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788838234.887014:0:92494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ff6395619b8) 00000020:00000080:1.0:1788838234.887046:0:92494:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788838234.887176:0:92494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff62ceaa000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788838234.887181:0:92494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff62ceaa000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788838234.887184:0:92494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff62ceaa000 4 00010000:00080000:1.0:1788838234.887240:0:92494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff640eeb800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788838234.895267:0:92494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788838234.897605:0:92494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788838234.897655:0:92494:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788838234.897671:0:92494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88da08396ccc9601 00000100:00080000:1.0:1788838234.897682:0:92494:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788838234.897687:0:92494:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff640eeb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838234.897725:0:92494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd6c000 x1875729135109120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838234.897764:0:92494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788838234.898442:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135109120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788838234.898518:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.899285:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135109120 00000100:00100000:0.0:1788838234.899302:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135109120 00000100:00100000:0.0:1788838234.899360:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1788838234.899370:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135109120:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838234.899622:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135109120:12345-0@lo:38:llog_process_th.0 Request processed in 251us (1102us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788838234.899632:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1788838234.899708:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838234.899722:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff640eeb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838234.899727:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788838234.899732:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135109120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788838234.900261:0:92494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92494:1875729135109248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838234.901711:0:92494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838234.901765:0:92494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838234.902188:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135109248 00000100:00100000:0.0:1788838234.902205:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135109248 00000100:00100000:0.0:1788838234.902750:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788838234.902767:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92494:x1875729135109248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838234.903051:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92494:x1875729135109248:12345-0@lo:502:llog_process_th.0 Request processed in 289us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.903064:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788838234.904551:0:92494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92494:1875729135109248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838234.905745:0:92494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92494:1875729135109376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838234.905851:0:92494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838234.905894:0:92494:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502558f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.906896:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135109376 00000100:00100000:2.0:1788838234.906909:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135109376 00000100:00100000:2.0:1788838234.906961:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788838234.906970:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92494:x1875729135109376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838234.907130:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92494:x1875729135109376:12345-0@lo:502:llog_process_th.0 Request processed in 159us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.907148:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788838234.907498:0:92494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:92494:1875729135109376:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788838234.907533:0:92494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788838234.908986:0:92469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788838234.909024:0:92469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838234.909045:0:92469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838234.909057:0:92469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788838234.909120:0:92469:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788838234.909123:0:92469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838234.909124:0:92469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838234.909125:0:92469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838234.909127:0:92469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838234.909128:0:92469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838234.909129:0:92469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838234.909131:0:92469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838234.909133:0:92469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838234.909134:0:92469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838234.909138:0:92469:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788838234.909140:0:92469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788838234.909141:0:92469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788838234.909142:0:92469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838234.909144:0:92469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838234.909145:0:92469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838234.909146:0:92469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838234.909147:0:92469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788838234.909148:0:92469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788838234.909149:0:92469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838234.909150:0:92469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788838234.909175:0:92469:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788838234.909193:0:92469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135109504:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788838234.909254:0:92469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.909298:0:92469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff508ba43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838234.909594:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135109504 00000100:00100000:3.0:1788838234.909602:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135109504 00000100:00100000:3.0:1788838234.909991:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788838234.910001:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92469:x1875729135109504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788838234.910028:0:92475:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788838234.910041:0:92475:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788838234.918346:0:92475:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788838234.918371:0:92475:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788838234.918543:0:92478:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788838234.918549:0:92478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788838234.918570:0:92478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.918589:0:92478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff600030000/0x88da08396ccc95d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc95c9 expref: 11 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.918598:0:92478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.918663:0:92478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff600030000/0x88da08396ccc95d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc95c9 expref: 11 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.918683:0:92478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff600030000/0x88da08396ccc95d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc95c9 expref: 11 pid: 92476 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838234.918699:0:92478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92478:1875729135109632:0@lo:104: 00000100:00100000:1.0:1788838234.918788:0:92478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838234.918945:0:92469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50364b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:92469:1875729135109504:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788838234.918966:0:92469:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788838234.918970:0:92469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788838234.918972:0:92469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788838234.918974:0:92469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838234.918975:0:92469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838234.918977:0:92469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838234.918979:0:92469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838234.918980:0:92469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838234.918982:0:92469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788838234.918984:0:92469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838234.918986:0:92469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788838234.919009:0:92469:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788838234.919303:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:92469:x1875729135109504:12345-0@lo:253:mount.lustre.0 Request processed in 9300us (10046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838234.919316:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788838234.919373:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135109632 00000100:00100000:3.0:1788838234.919382:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135109632 00000100:00100000:3.0:1788838234.919453:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788838234.919463:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+3:92478:x1875729135109632:12345-0@lo:104: 00010000:00010000:3.0:1788838234.919484:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838234.923402:0:92478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff601254cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788838234.925820:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788838234.925862:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+3:92478:x1875729135109632:12345-0@lo:104: Request processed in 6393us (7066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838234.925876:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00010000:0.0:1788838234.925991:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838234.926003:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.926016:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788838234.926022:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.926035:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838234.926045:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838234.926052:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838234.926124:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.926134:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838234.926176:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.926184:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc95c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc95d0 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.926205:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838234.926211:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838234.926216:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838234.926263:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135109760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838234.926338:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838234.927187:0:92478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92478:1875729135109632:0@lo:104: 00010000:00010000:1.0:1788838234.927212:0:92478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838234.927341:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135109760 00000100:00100000:0.0:1788838234.927354:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135109760 00010000:00010000:0.0:1788838234.927400:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff600030000/0x88da08396ccc95d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc95c9 expref: 11 pid: 92476 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838234.927457:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1788838234.927472:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50364b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:3643:x1875729135109760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838234.927492:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838234.927499:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff600030000/0x88da08396ccc95d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc95c9 expref: 11 pid: 92476 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927514:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff600030000/0x88da08396ccc95d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc95c9 expref: 11 pid: 92476 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927537:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600030000/0x88da08396ccc95d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc95c9 expref: 11 pid: 92476 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927561:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927587:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788838234.927607:0:7497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009058236s 00010000:00010000:0.0:1788838234.927612:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927621:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927628:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927634:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927641:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838234.927645:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927654:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927675:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838234.927686:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838234.927773:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50364b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:3643:x1875729135109760:12345-0@lo:103:ldlm_bl.0 Request processed in 304us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838234.927781:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1788838234.927936:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135109760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838234.928046:0:92478:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.928071:0:92478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838234.928078:0:92478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712d200/0x88da08396ccc9608 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788838234.941553:0:92469:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:0.0:1788838234.947794:0:92469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788838234.948063:0:92499:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:2.0:1788838234.948074:0:92499:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:0.0:1788838234.948456:0:92500:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788838234.948787:0:92469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788838234.949029:0:92500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838234.951537:0:92500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788838234.951616:0:92500:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788838234.952971:0:92501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc95880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92501:1875729135109888:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838234.953092:0:92501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.953173:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135109888 00000100:00100000:2.0:1788838234.953182:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135109888 00000100:00100000:2.0:1788838234.953239:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4169 00000100:00100000:2.0:1788838234.953248:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92501:x1875729135109888:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838234.953340:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92501:x1875729135109888:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.953350:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4169 00000100:00100000:2.0:1788838234.953379:0:92501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b501780 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.953421:0:92501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc95880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92501:1875729135109888:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788838234.953637:0:92501:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788838234.953668:0:92501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc95880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92501:1875729135110016:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838234.953703:0:92501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.953741:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135110016 00000100:00100000:2.0:1788838234.953746:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135110016 00000100:00100000:2.0:1788838234.953772:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4170 00000100:00100000:2.0:1788838234.953779:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92501:x1875729135110016:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838234.954539:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92501:x1875729135110016:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 756us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.954549:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4170 00000100:00100000:2.0:1788838234.954584:0:92501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff633234600 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.954608:0:92501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc95880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92501:1875729135110016:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838234.954700:0:92501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc95880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92501:1875729135110144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838234.954735:0:92501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838234.954765:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135110144 00000100:00100000:2.0:1788838234.954770:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135110144 00000100:00100000:2.0:1788838234.954829:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4171 00000100:00100000:2.0:1788838234.954836:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92501:x1875729135110144:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838234.954894:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92501:x1875729135110144:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838234.954901:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4171 00000040:01000000:3.0:1788838234.955869:0:92469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:2.0:1788838234.956865:0:92501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff633234600 going to sleep for 11 seconds 00000100:00100000:2.0:1788838234.956943:0:92501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc95880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92501:1875729135110144:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788838234.957051:0:92501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838234.957587:0:92469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788838234.958117:0:92469:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788838234.958133:0:92469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788838234.958217:0:92469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838234.966411:0:92469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788838234.969042:0:92501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788838234.969138:0:92501:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788838234.969654:0:92501:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788838234.971034:0:92469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788838234.971125:0:92469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788838234.971302:0:92469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788838234.972019:0:92469:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4f:0x0] (8/32) registered 00010000:00080000:2.0:1788838234.985603:0:92469:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964116995 00010000:00080000:1.0:1788838234.986522:0:92502:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92502 00010000:02000000:1.0:1788838234.986544:0:92502:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788838234.986547:0:92502:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788838234.986551:0:92502:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788838234.986718:0:92469:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788838234.986740:0:92469:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788838234.986764:0:92469:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788838234.986790:0:92469:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788838234.988252:0:92469:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838234.999820:0:92469:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788838235.199937:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838235.523696:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:2.0:1788838235.652834:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838235.653441:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116448000 00000100:00100000:3.0:1788838235.653458:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116448000 00000100:00100000:3.0:1788838235.653638:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:3.0:1788838235.653650:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116448000:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838235.653675:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838235.653702:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc960f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce7b expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838235.653742:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc960f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce7b expref: 10 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838235.653756:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc960f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce7b expref: 10 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838235.653768:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5e00, rc 0) 00000100:00100000:3.0:1788838235.654093:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116448000:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 443us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838235.654123:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:0.0:1788838235.682224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838235.682329:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116448128 00000100:00100000:3.0:1788838235.682343:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116448128 00000100:00100000:3.0:1788838235.682429:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:3.0:1788838235.682443:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116448128:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788838235.682483:0:92475:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788838235.682517:0:92475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788838235.682522:0:92475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788838235.682526:0:92475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788838235.682529:0:92475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788838235.682532:0:92475:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 125 00000100:00100000:3.0:1788838235.698640:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116448128:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 Request processed in 16183us (16416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838235.698660:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1788838235.715187:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838235.715342:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116448256 00000100:00100000:3.0:1788838235.715355:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116448256 00000100:00100000:3.0:1788838235.715416:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1347 00000100:00100000:3.0:1788838235.715451:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116448256:12345-192.168.203.30@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1788838235.715505:0:76060:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'efc561ba-875e-4857-b79b-9bd7023bd57c' at ffff8ff50d58c000, cookie 0x88da08396ccc9560 00010000:00080000:3.0:1788838235.715513:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp recovering/t0 exp ffff8ff50d58c000 cur 3629 last 1788838234 00010000:02000400:3.0:1788838235.715524:0:76060:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1788838235.715531:0:76060:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1788838235.715559:0:76060:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788838235.715755:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838235.715881:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116448256:12345-192.168.203.30@tcp:38:ll_cfg_requeue.0 Request processed in 431us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838235.715912:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1347 00000100:00100000:0.0:1788838235.724392:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838235.725113:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116448384 00000100:00100000:1.0:1788838235.725128:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116448384 00000100:00100000:1.0:1788838235.725209:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1348 00000100:00100000:1.0:1788838235.725222:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116448384:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788838235.725250:0:75504:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff639540000 x1875729116448384/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:136/0 lens 328/0 e 0 to 0 dl 1788838246 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838235.725271:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116448384:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 54us (896us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838235.725278:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1348 00010000:00080000:1.0:1788838235.725297:0:92502:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788838235.773485:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:2.0:1788838236.225057:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788838236.476906:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788838236.476918:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff62ceaa000 from 125 10000000:01000000:1.0:1788838236.476925:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788838236.476986:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.477000:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.477022:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.477055:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.477269:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.477331:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bff540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838236.477610:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135110272 00000100:00100000:0.0:1788838236.477621:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135110272 00000100:00100000:0.0:1788838236.478512:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788838236.478532:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:6544:x1875729135110272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838236.478557:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838236.478581:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50b8e4200/0x88da08396ccc961d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9616 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.478615:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50b8e4200/0x88da08396ccc961d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9616 expref: 11 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.478629:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50b8e4200/0x88da08396ccc961d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9616 expref: 11 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.478640:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50b8e4200, rc 0) 00000100:00100000:0.0:1788838236.478884:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135110272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 358us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838236.478996:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788838236.479221:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838236.479245:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.479256:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.479342:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.479389:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.479444:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bff540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.479507:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135110400 00000100:00100000:3.0:1788838236.479515:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135110400 00000100:00100000:3.0:1788838236.479557:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788838236.479566:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135110400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788838236.479588:0:92475:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788838236.479609:0:92475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788838236.479613:0:92475:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000100:00100000:3.0:1788838236.479722:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135110400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.479730:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788838236.480272:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788838236.480338:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788838236.480350:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.480372:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838236.480384:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788838236.480387:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff503592800 from 52 10000000:01000000:1.0:1788838236.480398:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838236.480441:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.480451:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.480461:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.480478:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.480517:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.480556:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5035ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838236.480614:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135110528 00000100:00100000:0.0:1788838236.480627:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135110528 00000100:00100000:0.0:1788838236.480829:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788838236.480842:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135110528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838236.480856:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838236.480873:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50b8e5600/0x88da08396ccc962b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9624 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.481027:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50b8e5600/0x88da08396ccc962b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9624 expref: 12 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.481042:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50b8e5600/0x88da08396ccc962b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9624 expref: 12 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.481052:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50b8e5600, rc 0) 00000100:00100000:3.0:1788838236.481190:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838236.481204:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.481213:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838236.481290:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.481320:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.481345:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.481360:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135110656 00000100:00100000:3.0:1788838236.481365:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135110656 00000100:00100000:3.0:1788838236.481392:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788838236.481398:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135110656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.481550:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135110656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.481567:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788838236.481603:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.481635:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.481778:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135110528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 938us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838236.481785:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788838236.482041:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.482075:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838236.482541:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135110784 00000100:00100000:0.0:1788838236.482549:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135110784 00000100:00100000:0.0:1788838236.482595:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788838236.482605:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135110784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.483250:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135110784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 642us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838236.483261:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788838236.485079:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838236.487465:0:92565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788838236.488032:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788838236.488071:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788838236.488087:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.488138:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838236.488149:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788838236.488152:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff503592800 from 122 10000000:01000000:0.0:1788838236.488156:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788838236.488207:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4400/0x88da08396ccc9632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.488216:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4400/0x88da08396ccc9632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.488230:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4400/0x88da08396ccc9632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838236.488264:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.488358:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838236.488428:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3480 going to sleep for 11 seconds 00000100:00100000:1.0:1788838236.489225:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135110912 00000100:00100000:1.0:1788838236.489237:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135110912 00000100:00100000:1.0:1788838236.489310:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788838236.489323:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135110912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838236.489343:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838236.489497:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712c000/0x88da08396ccc9639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9632 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.489533:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712c000/0x88da08396ccc9639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9632 expref: 13 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.489545:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712c000/0x88da08396ccc9639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9632 expref: 13 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.489555:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c000, rc 0) 00000100:00100000:1.0:1788838236.489632:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135110912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 312us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838236.489649:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788838236.490012:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135110912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838236.490034:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4400/0x88da08396ccc9632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9639 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.490046:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4400/0x88da08396ccc9632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9639 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.490187:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.490236:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.490386:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6193b83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.494880:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135111040 00000100:00100000:3.0:1788838236.494919:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135111040 00000100:00100000:3.0:1788838236.495002:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788838236.495021:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135111040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788838236.495061:0:92476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788838236.495080:0:92476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788838236.495085:0:92476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788838236.495088:0:92476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788838236.495092:0:92476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788838236.495094:0:92476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 125 00000100:00100000:3.0:1788838236.496228:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135111040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1207us (5984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.496242:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788838236.496436:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788838236.496548:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788838236.496562:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4400/0x88da08396ccc9632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9639 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.496573:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4400/0x88da08396ccc9632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9639 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838236.496584:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788838236.496635:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788838236.496639:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788838236.496699:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.496708:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.496735:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.496759:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.496835:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.496877:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549480 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.497206:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135111168 00000100:00100000:3.0:1788838236.497215:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135111168 00000100:00100000:3.0:1788838236.497276:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788838236.497286:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135111168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838236.497305:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838236.497322:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4200/0x88da08396ccc9647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9640 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.497359:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4200/0x88da08396ccc9647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9640 expref: 14 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.497372:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4200/0x88da08396ccc9647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9640 expref: 14 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.497382:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4200, rc 0) 00000100:00100000:3.0:1788838236.497437:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135111168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.497443:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788838236.497620:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838236.497637:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.497648:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.497742:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.497774:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.497829:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838236.498036:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135111296 00000100:00100000:0.0:1788838236.498042:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135111296 00000100:00100000:0.0:1788838236.498081:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788838236.498090:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135111296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.498281:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135111296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838236.498289:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788838236.498509:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.498551:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.498607:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.498635:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639549480 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.500001:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135111424 00000100:00100000:3.0:1788838236.500013:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135111424 00000100:00100000:3.0:1788838236.500075:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788838236.500086:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135111424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.506181:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135111424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6084us (7560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838236.506198:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788838236.506433:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838236.507698:0:92567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788838236.508304:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788838236.508338:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788838236.508425:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.508440:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838236.508452:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788838236.508455:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff503592800 from 1 10000000:01000000:1.0:1788838236.508458:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788838236.508507:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d000/0x88da08396ccc964e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.508515:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712d000/0x88da08396ccc964e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.508527:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712d000/0x88da08396ccc964e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.508558:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.508645:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.509845:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838236.510221:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135111552 00000100:00100000:2.0:1788838236.510233:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135111552 00000100:00100000:2.0:1788838236.510310:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788838236.510322:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135111552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838236.510344:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838236.510368:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff600031800/0x88da08396ccc9655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc964e expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.510407:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600031800/0x88da08396ccc9655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc964e expref: 15 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.510432:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff600031800/0x88da08396ccc9655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc964e expref: 15 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.510444:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600031800, rc 0) 00000100:00100000:2.0:1788838236.510528:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135111552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838236.510536:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788838236.510867:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838236.510891:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712d000/0x88da08396ccc964e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9655 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.510902:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712d000/0x88da08396ccc964e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9655 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838236.510924:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788838236.510930:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d000/0x88da08396ccc964e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9655 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.510938:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712d000/0x88da08396ccc964e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9655 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838236.510970:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788838236.510973:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff503592800 from 7 10000000:01000000:3.0:1788838236.510976:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838236.511006:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc965c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.511013:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc965c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.511022:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc965c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838236.511047:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.511092:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.511137:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5024ef480 going to sleep for 11 seconds 00000100:00100000:2.0:1788838236.511350:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135111680 00000100:00100000:2.0:1788838236.511356:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135111680 00000100:00100000:2.0:1788838236.511390:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788838236.511399:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135111680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838236.511411:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838236.511442:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff600030000/0x88da08396ccc9663 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc965c expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.511461:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600030000/0x88da08396ccc9663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc965c expref: 16 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.511471:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff600030000/0x88da08396ccc9663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc965c expref: 16 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.511479:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030000, rc 0) 00000100:00100000:2.0:1788838236.511526:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135111680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838236.511533:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788838236.511605:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838236.511618:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc965c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9663 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.511634:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc965c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9663 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838236.511721:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.511751:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838236.511782:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838236.511920:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135111808 00000100:00100000:2.0:1788838236.511926:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135111808 00000100:00100000:2.0:1788838236.511944:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788838236.511951:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135111808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838236.512094:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135111808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838236.512111:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788838236.513837:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.513915:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.514005:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838236.514056:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838236.514248:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135111936 00000100:00100000:2.0:1788838236.514257:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135111936 00000100:00100000:2.0:1788838236.514323:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788838236.514333:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135111936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838236.514491:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135111936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838236.514499:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788838236.514861:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135111936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838236.516468:0:92568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788838236.521013:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788838236.521066:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788838236.521083:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc965c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9663 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.521100:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc965c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9663 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838236.521301:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788838236.521306:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff63f7ce800 from 52 10000000:01000000:2.0:1788838236.521310:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788838236.521369:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.521380:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.521393:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838236.521440:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838236.521533:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838236.521588:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff627f0a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.524362:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135112064 00000100:00100000:3.0:1788838236.524382:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135112064 00000100:00100000:3.0:1788838236.524482:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788838236.524495:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135112064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838236.524517:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838236.524560:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc9671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc966a expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.524603:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc9671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc966a expref: 17 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.524617:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc9671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc966a expref: 17 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.524628:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4600, rc 0) 00000100:00100000:3.0:1788838236.525119:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135112064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 624us (3582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.525128:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788838236.532522:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838236.532563:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.532578:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.532920:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.533003:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.533053:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838236.533354:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135112192 00000100:00100000:0.0:1788838236.533372:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135112192 00000100:00100000:0.0:1788838236.533436:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788838236.533448:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135112192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.533622:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135112192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838236.533645:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788838236.534512:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.534571:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.534628:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.534791:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135112320 00000100:00100000:3.0:1788838236.534814:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135112320 00000100:00100000:3.0:1788838236.534861:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788838236.534869:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135112320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.535181:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.538276:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135112320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3161us (3402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.538295:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788838236.539731:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.541002:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788838236.541707:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838236.541725:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135112448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838236.541861:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838236.541921:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135112448 00000100:00100000:0.0:1788838236.541929:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135112448 00000100:00100000:0.0:1788838236.541995:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:0.0:1788838236.542006:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135112448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838236.542045:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838236.542098:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135112448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838236.542106:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00080000:0.0:1788838236.542132:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838236.542177:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135112448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838236.543137:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135112576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838236.543196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.543301:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135112576 00000100:00100000:3.0:1788838236.543308:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135112576 00000100:00100000:3.0:1788838236.543362:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:3.0:1788838236.543371:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135112576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838236.543400:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838236.543456:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135112576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.543465:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00080000:0.0:1788838236.544352:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838236.544426:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135112576:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788838236.545678:0:92570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788838236.546188:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788838236.546219:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788838236.546235:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.546250:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838236.546262:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788838236.546265:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788838236.546268:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788838236.546318:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.546326:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.546340:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838236.546369:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.546468:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.546518:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135112704 00000100:00100000:3.0:1788838236.546526:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135112704 00000100:00100000:3.0:1788838236.546582:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788838236.546593:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135112704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838236.546612:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838236.546629:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc967f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9678 expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.546698:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc967f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9678 expref: 18 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.546710:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc967f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9678 expref: 18 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.546720:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4e00, rc 0) 00000100:00100000:3.0:1788838236.546761:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135112704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.546767:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788838236.546981:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5024ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.547006:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838236.547024:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.547035:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838236.547104:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.547133:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.547156:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135112832 00000100:00100000:3.0:1788838236.547161:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135112832 00000100:00100000:3.0:1788838236.547186:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788838236.547193:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62c431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135112832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.547352:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62c431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135112832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.547371:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788838236.547397:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5024ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.547409:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.547449:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.547490:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.547511:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135112960 00000100:00100000:3.0:1788838236.547515:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135112960 00000100:00100000:3.0:1788838236.547538:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788838236.547544:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135112960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.547729:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5024ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.549516:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135112960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1961us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.549532:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788838236.549951:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135112960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838236.550986:0:92571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788838236.551188:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788838236.551219:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788838236.551233:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.551248:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838236.551259:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788838236.551262:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff63f7ce800 from 7 10000000:01000000:3.0:1788838236.551266:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838236.551315:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5a00/0x88da08396ccc9686 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.551340:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5a00/0x88da08396ccc9686 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.551353:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5a00/0x88da08396ccc9686 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838236.551381:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.551469:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.551525:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5024ef0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838236.551631:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135113088 00000100:00100000:2.0:1788838236.551641:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135113088 00000100:00100000:2.0:1788838236.551953:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788838236.551967:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135113088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838236.551987:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838236.552006:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff600030c00/0x88da08396ccc968d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9686 expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.552038:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600030c00/0x88da08396ccc968d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9686 expref: 19 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.552051:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff600030c00/0x88da08396ccc968d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9686 expref: 19 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.552071:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030c00, rc 0) 00000100:00100000:2.0:1788838236.552138:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135113088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838236.552145:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788838236.552346:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838236.552367:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5a00/0x88da08396ccc9686 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc968d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.552377:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5a00/0x88da08396ccc9686 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc968d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.552481:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.552520:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.553599:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.553827:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135113216 00000100:00100000:3.0:1788838236.553838:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135113216 00000100:00100000:3.0:1788838236.553891:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788838236.553902:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135113216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.554092:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135113216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.554101:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788838236.554219:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.554276:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.554336:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.554361:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.554401:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135113344 00000100:00100000:3.0:1788838236.554406:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135113344 00000100:00100000:3.0:1788838236.554448:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788838236.554455:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135113344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.554549:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135113344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.554556:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788838236.554691:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788838236.556589:0:92572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788838236.556841:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788838236.556873:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788838236.556910:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5a00/0x88da08396ccc9686 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc968d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.556924:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5a00/0x88da08396ccc9686 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc968d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838236.556936:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788838236.556940:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627f9a800 from 52 10000000:01000000:3.0:1788838236.556944:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788838236.556991:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.557000:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.557013:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838236.557043:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.557127:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.557160:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5024ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.557189:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135113472 00000100:00100000:3.0:1788838236.557196:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135113472 00000100:00100000:3.0:1788838236.557240:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788838236.557249:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135113472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838236.557266:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838236.557282:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc969b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9694 expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.557310:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc969b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9694 expref: 20 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.557329:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc969b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9694 expref: 20 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.557339:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4000, rc 0) 00000100:00100000:3.0:1788838236.557376:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135113472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.557383:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788838236.557440:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838236.557456:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.557465:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838236.557519:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.557541:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838236.557552:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5024ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.557562:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135113600 00000100:00100000:3.0:1788838236.557564:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135113600 00000100:00100000:3.0:1788838236.557579:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788838236.557584:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6411ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135113600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838236.558222:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6411ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135113600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 632us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.558232:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788838236.558788:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.558980:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.559042:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.559085:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838236.559130:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135113728 00000100:00100000:2.0:1788838236.559136:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135113728 00000100:00100000:2.0:1788838236.559181:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788838236.559189:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6411ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135113728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838236.559316:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6411ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135113728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838236.559323:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788838236.559465:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838236.561400:0:92573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788838236.562287:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788838236.562339:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838236.562355:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.562388:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838236.562399:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788838236.562403:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788838236.562406:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788838236.562466:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.562474:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.562486:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.562519:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.562610:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.563488:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838236.563567:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135113856 00000100:00100000:3.0:1788838236.563578:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135113856 00000100:00100000:3.0:1788838236.563981:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788838236.563995:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6411ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135113856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838236.564016:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838236.564039:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc96a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc96a2 expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.564073:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc96a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc96a2 expref: 21 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.564086:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc96a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc96a2 expref: 21 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838236.564097:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4400, rc 0) 00000100:00100000:3.0:1788838236.564174:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6411ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135113856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838236.564181:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788838236.564396:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838236.564427:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.564438:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.564530:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.564569:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.567289:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838236.567599:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135113984 00000100:00100000:2.0:1788838236.567612:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135113984 00000100:00100000:2.0:1788838236.568014:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788838236.568028:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135113984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838236.568395:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135113984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (3824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838236.568405:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788838236.571637:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135113984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.571736:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.574836:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.574918:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838236.575686:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135114112 00000100:00100000:0.0:1788838236.575704:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135114112 00000100:00100000:1.0:1788838236.576143:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788838236.576157:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135114112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.580076:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135114112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3909us (5245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838236.580095:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788838236.580299:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838236.583386:0:92575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788838236.583695:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788838236.583724:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788838236.583748:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.583762:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838236.583772:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788838236.583775:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff627f9a800 from 7 10000000:01000000:0.0:1788838236.583779:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788838236.583862:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5c00/0x88da08396ccc96b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.583872:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5c00/0x88da08396ccc96b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.583886:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5c00/0x88da08396ccc96b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838236.583920:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.584018:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838236.584069:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838236.584357:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135114240 00000100:00100000:1.0:1788838236.584367:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135114240 00000100:00100000:1.0:1788838236.584437:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788838236.584449:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135114240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838236.584467:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838236.584485:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712c600/0x88da08396ccc96b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc96b0 expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.584516:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712c600/0x88da08396ccc96b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc96b0 expref: 22 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.584528:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712c600/0x88da08396ccc96b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc96b0 expref: 22 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.584538:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c600, rc 0) 00000100:00100000:1.0:1788838236.584598:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135114240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838236.584605:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788838236.584775:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838236.584792:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5c00/0x88da08396ccc96b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96b7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.584912:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5c00/0x88da08396ccc96b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc96b7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.584991:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.585027:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.585054:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788838236.585097:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135114368 00000100:00100000:0.0:1788838236.585103:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135114368 00000100:00100000:0.0:1788838236.585141:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788838236.585149:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135114368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.585283:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135114368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838236.585290:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788838236.585693:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.585736:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.585974:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838236.586029:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788838236.589688:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135114496 00000100:00100000:0.0:1788838236.589716:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135114496 00000100:00100000:0.0:1788838236.589792:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788838236.589824:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135114496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.590041:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135114496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (4244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838236.590049:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788838236.590130:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838236.594954:0:92577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788838236.595576:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788838236.595607:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838236.595623:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5c00/0x88da08396ccc96b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96b7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.595636:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5c00/0x88da08396ccc96b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96b7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838236.595647:0:6544:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788838236.595661:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ff610244d28 from 1 10000000:01000000:0.0:1788838236.595664:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788838236.595722:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5400/0x88da08396ccc96be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.595730:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5400/0x88da08396ccc96be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.595743:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5400/0x88da08396ccc96be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838236.595774:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.595886:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838236.595960:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3480 going to sleep for 11 seconds 00000100:00100000:1.0:1788838236.596939:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135114624 00000100:00100000:1.0:1788838236.596957:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135114624 00000100:00100000:1.0:1788838236.597041:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788838236.597054:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135114624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838236.597076:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838236.597102:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712d800/0x88da08396ccc96c5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc96be expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.597137:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712d800/0x88da08396ccc96c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc96be expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.597159:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712d800/0x88da08396ccc96c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc96be expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838236.597186:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d800, rc 0) 00000100:00100000:1.0:1788838236.597268:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135114624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838236.597276:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788838236.597591:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838236.597617:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5400/0x88da08396ccc96be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96c5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.597631:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5400/0x88da08396ccc96be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc96c5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838236.597668:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788838236.597675:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5400/0x88da08396ccc96be lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96c5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.597684:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5400/0x88da08396ccc96be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96c5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838236.597695:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788838236.597698:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ff610244d28 from 1 10000000:01000000:0.0:1788838236.597701:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788838236.597729:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.597737:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.597747:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838236.597770:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.597846:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838236.597889:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788838236.598030:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135114752 00000100:00100000:2.0:1788838236.598036:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135114752 00000100:00100000:2.0:1788838236.598086:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788838236.598096:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135114752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838236.598107:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838236.598118:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff600030200/0x88da08396ccc96d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc96cc expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.598147:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff600030200/0x88da08396ccc96d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc96cc expref: 24 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.598171:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff600030200/0x88da08396ccc96d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc96cc expref: 24 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838236.598180:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030200, rc 0) 00000100:00100000:2.0:1788838236.598223:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135114752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838236.598231:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788838236.599370:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838236.599399:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.599424:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838236.599525:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838236.599584:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838236.599633:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3480 going to sleep for 11 seconds 00000100:00100000:1.0:1788838236.599758:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135114880 00000100:00100000:1.0:1788838236.599766:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135114880 00000100:00100000:1.0:1788838236.599832:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788838236.599842:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135114880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838236.599959:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135114880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (374us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838236.599968:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788838236.600068:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135114880:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788838236.600109:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788838236.600117:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838236.600126:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838236.801309:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:2.0:1788838237.247195:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838237.564975:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838237.822418:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00010000:00010000:0.0:1788838238.269138:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838238.590755:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838238.847480:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00000100:00100000:0.0:1788838239.301132:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838239.301251:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1788838239.301274:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838239.301290:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116448512 00000100:00100000:0.0:1788838239.301298:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116448512 00000100:00100000:0.0:1788838239.301349:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:0.0:1788838239.301360:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116448512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838239.301456:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116448512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 96us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838239.301464:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:0.0:1788838239.301501:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116448640 00000100:00100000:0.0:1788838239.301504:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116448640 00000100:00100000:0.0:1788838239.301541:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1333 00000100:00100000:0.0:1788838239.301548:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2404:x1875729116448640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838239.301580:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2404:x1875729116448640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838239.301587:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1333 00000100:00080000:0.0:1788838239.301610:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838239.613903:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788838239.868920:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 0 seconds 00000001:02000400:3.0:1788838239.887929:0:92753:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788838240.128084:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135115008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838240.128371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788838240.128463:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838240.128468:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838240.128472:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838240.128477:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3628 00000100:00080000:0.0:1788838240.128481:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838240.128486:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838240.128506:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637f8ed80 x1875729135115264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838240.128527:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838240.128530:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838240.128532:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838240.128542:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3628 00000100:00080000:0.0:1788838240.128545:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838240.128548:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838240.128561:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637f8c380 x1875729135115520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838240.128583:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838240.128586:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838240.128588:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838240.128592:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3628 00000100:00080000:0.0:1788838240.128594:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838240.128598:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838240.128610:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639c5d880 x1875729135115776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838240.128628:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838240.128631:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838240.128632:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838240.128635:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3628 00000100:00080000:0.0:1788838240.128637:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838240.128640:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838240.128650:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639c5f800 x1875729135116160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838240.128667:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788838240.128670:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838240.128671:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff640eeb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838240.128683:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff640eeb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838240.128695:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639c5df80 x1875729135116544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838240.128720:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135115136:0@lo:400:kworker.0 00000100:00100000:0.0:1788838240.128753:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838240.128782:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135116032:0@lo:400:kworker.0 00000100:00100000:0.0:1788838240.128835:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838240.128859:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788838240.128866:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135115392:0@lo:400:kworker.0 00000100:00100000:1.0:1788838240.128983:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135115008 00000100:00100000:1.0:1788838240.128991:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135115008 00000100:00100000:1.0:1788838240.129039:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4172 00000100:00100000:1.0:1788838240.129047:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135115008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838240.129078:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:2.0:1788838240.130285:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135115136 00000100:00100000:2.0:1788838240.130296:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135115136 00000100:00100000:1.0:1788838240.130337:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135115008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1288us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.130339:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788838240.130351:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135115136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838240.130352:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4172 00000100:00100000:2.0:1788838240.130415:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135115136:12345-0@lo:400:kworker.0 Request processed in 67us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.130422:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788838240.131305:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135116032 00000100:00100000:2.0:1788838240.131313:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135116032 00000100:00100000:2.0:1788838240.131354:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00100000:2.0:1788838240.131361:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135116032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838240.131424:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135116032:12345-0@lo:400:kworker.0 Request processed in 63us (2588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.131430:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00000100:00100000:2.0:1788838240.131462:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135115904:0@lo:400:kworker.0 00000100:00100000:2.0:1788838240.131496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.131536:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135115648:0@lo:400:kworker.0 00000100:00100000:2.0:1788838240.131546:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135115008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838240.131574:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135115904 00000100:00100000:2.0:1788838240.131577:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135115904 00000100:00100000:1.0:1788838240.131585:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838240.131604:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00000100:00100000:2.0:1788838240.131611:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135115904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838240.131625:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135116416:0@lo:400:kworker.0 00000100:00100000:2.0:1788838240.131650:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135115904:12345-0@lo:400:kworker.0 Request processed in 39us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.131657:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00000100:00100000:1.0:1788838240.131661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.131695:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135115264:0@lo:38:kworker.0 00000100:00100000:1.0:1788838240.131718:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.131735:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135115520:0@lo:38:kworker.0 00000100:00100000:1.0:1788838240.131754:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.131773:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135115776:0@lo:38:kworker.0 00000100:00100000:1.0:1788838240.131831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.131848:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135116160:0@lo:38:kworker.0 00000100:00100000:1.0:1788838240.131881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.131901:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135116544:0@lo:38:kworker.0 00000100:00100000:1.0:1788838240.131929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.131974:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135115648 00000100:00100000:1.0:1788838240.131978:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135115648 00000100:00100000:1.0:1788838240.132004:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135115264 00000100:00100000:1.0:1788838240.132007:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135115264 00000100:00100000:1.0:1788838240.132016:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135115520 00000100:00100000:1.0:1788838240.132019:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135115520 00000100:00100000:1.0:1788838240.132026:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135116160 00000100:00100000:1.0:1788838240.132027:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135116160 00000100:00100000:1.0:1788838240.132033:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135116544 00000100:00100000:1.0:1788838240.132036:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135116544 00000100:00100000:1.0:1788838240.132044:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1788838240.132051:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135115648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838240.132086:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135115648:12345-0@lo:400:kworker.0 Request processed in 36us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838240.132091:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1788838240.132128:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1788838240.132132:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135115264:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788838240.132154:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3634 last 0 00000020:00000080:1.0:1788838240.132186:0:76060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88da08396ccc96da 00000004:00100000:1.0:1788838240.132200:0:76060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788838240.132338:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff640eed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838240.132377:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875729135115264:12345-0@lo:38:kworker.0 Request processed in 244us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838240.132384:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1788838240.132979:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838240.132998:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135116288:0@lo:400:kworker.0 00000100:00100000:0.0:1788838240.133020:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.133261:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135115392 00000100:00100000:1.0:1788838240.133267:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135115392 00000100:00100000:1.0:1788838240.133294:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:1.0:1788838240.133299:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135115392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838240.133338:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135115392:12345-0@lo:400:kworker.0 Request processed in 38us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838240.133345:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:1.0:1788838240.133358:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1788838240.133362:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135115520:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788838240.133379:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3634 last 0 00000020:00000080:1.0:1788838240.133415:0:76060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88da08396ccc96e1 00000004:00100000:1.0:1788838240.133425:0:76060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788838240.133447:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff610297000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838240.133479:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875729135115520:12345-0@lo:38:kworker.0 Request processed in 115us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838240.133485:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1788838240.133498:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:1.0:1788838240.133510:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135116160:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788838240.133524:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3634 last 0 00000020:00000080:1.0:1788838240.133547:0:76060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x88da08396ccc96e8 00000004:00100000:1.0:1788838240.133554:0:76060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788838240.133567:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff5052d0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838240.133595:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875729135116160:12345-0@lo:38:kworker.0 Request processed in 84us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838240.133600:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:1.0:1788838240.133614:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1788838240.133618:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135116544:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788838240.133631:0:76060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3634 last 0 00000020:00000080:1.0:1788838240.133652:0:76060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88da08396ccc96ef 00000004:00100000:1.0:1788838240.133658:0:76060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788838240.133670:0:76060:0:(import.c:65:import_set_state_nolock()) ffff8ff5052d6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838240.133699:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729135116544:12345-0@lo:38:kworker.0 Request processed in 80us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838240.133705:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1788838240.133736:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135115776 00000100:00100000:1.0:1788838240.133741:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135115776 00000100:00100000:1.0:1788838240.133765:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4173 00000100:00100000:1.0:1788838240.133770:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135115776:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788838240.133783:0:37907:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8ff50d58f000, cookie 0x88da08396ccc9559 00010000:00080000:1.0:1788838240.133787:0:37907:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378651 exp ffff8ff50d58f000 cur 3634 last 1788838234 00000004:00100000:1.0:1788838240.133813:0:37907:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788838240.133829:0:37907:0:(import.c:65:import_set_state_nolock()) ffff8ff5052d5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838240.133880:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135115776:12345-0@lo:38:kworker.0 Request processed in 109us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838240.133886:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4173 00000100:00100000:1.0:1788838240.133929:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135115648:0@lo:400:kworker.0 00010000:00080000:1.0:1788838240.133950:0:92502:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788838240.133955:0:92502:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 115964116996 00000020:00080000:1.0:1788838240.133960:0:92502:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838240.133963:0:92502:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116996 00000020:00080000:1.0:1788838240.133966:0:92502:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838240.133968:0:92502:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116996 00010000:00080000:1.0:1788838240.133987:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff637f8ed80 x1875729135115264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838240.134000:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00100000:2.0:1788838240.134778:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135116416 00000100:00100000:2.0:1788838240.134786:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135116416 00000100:00100000:2.0:1788838240.134844:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:2.0:1788838240.134852:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135116416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838240.134912:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135116416:12345-0@lo:400:kworker.0 Request processed in 61us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.134918:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00100000:2.0:1788838240.134965:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135116416:0@lo:400:kworker.0 00000100:00100000:2.0:1788838240.135003:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135115904:0@lo:400:kworker.0 00000100:00080000:1.0:1788838240.137902:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8ff637f8ed80 x1875729135115264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838265 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838240.137916:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788838240.137921:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788838240.137925:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788838240.137930:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135115264:0@lo:38:kworker.0 00010000:00080000:1.0:1788838240.137962:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff637f8c380 x1875729135115520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838240.137978:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:1.0:1788838240.138728:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8ff637f8c380 x1875729135115520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838265 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838240.138737:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788838240.138749:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788838240.138754:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788838240.138759:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135115520:0@lo:38:kworker.0 00000100:00080000:1.0:1788838240.138782:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:1.0:1788838240.138790:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788838240.138794:0:3642:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1788838240.138821:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000100:00080000:1.0:1788838240.138824:0:3642:0:(recover.c:53:ptlrpc_replay_next()) import ffff8ff6061da800 from lustre-MDT0000_UUID committed 115964116995 last 0 00000100:00080000:1.0:1788838240.138828:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788838240.139952:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135115136:0@lo:400:kworker.0 00000100:00100000:0.0:1788838240.139970:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135116032:0@lo:400:kworker.0 00000100:00100000:0.0:1788838240.139999:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135115392:0@lo:400:kworker.0 00000100:00080000:0.0:1788838240.140020:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838240.140025:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838240.140028:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838240.140047:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135116288 00000100:00100000:0.0:1788838240.140054:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135116288 00000100:00100000:0.0:1788838240.140123:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:0.0:1788838240.140133:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135116288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838240.140209:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135116288:12345-0@lo:400:kworker.0 Request processed in 77us (7187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838240.140218:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00080000:0.0:1788838240.140402:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838240.140448:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135116288:0@lo:400:kworker.0 00000100:00100000:1.0:1788838240.144417:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135115776:0@lo:38:kworker.0 00010000:00080000:1.0:1788838240.144459:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff639c5f800 x1875729135116160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838240.144479:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00010000:00080000:2.0:1788838240.144787:0:92768:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1788838240.144793:0:92768:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788838240.144814:0:92768:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1788838240.145818:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8ff639c5f800 x1875729135116160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838265 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838240.145829:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788838240.145834:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788838240.145838:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1788838240.145843:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001b299fe4): req@ffff8ff50719c700 x1875729135101312/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838240.145864:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135116160:0@lo:38:kworker.0 00010000:00080000:1.0:1788838240.145891:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff639c5df80 x1875729135116544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838240.145903:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:1.0:1788838240.145919:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788838240.145923:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788838240.145926:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff640eeb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788838240.145931:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135116544:0@lo:38:kworker.0 00000100:00100000:1.0:1788838240.146052:0:66262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.146085:0:66262:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503ede840 going to sleep for 11 seconds 00000100:00080000:2.0:1788838240.147595:0:92768:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788838240.148362:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135116672:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788838240.148432:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838240.148482:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135116672 00000100:00100000:3.0:1788838240.148488:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135116672 00000100:00100000:3.0:1788838240.148530:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4174 00000100:00100000:3.0:1788838240.148538:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135116672:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788838240.148558:0:23765:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff5059a9500 x1875729135116672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:141/0 lens 224/0 e 0 to 0 dl 1788838251 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838240.148571:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135116672:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 35us (139us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838240.148591:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4174 00000020:00080000:3.0:1788838240.148608:0:92502:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838240.148612:0:92502:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964116996 00010000:00080000:3.0:1788838240.148615:0:92502:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788838240.148617:0:92502:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838240.148623:0:92502:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838240.148626:0:92502:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838240.148633:0:92502:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff639540000 x1875729116448384/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:136/0 lens 328/0 e 0 to 0 dl 1788838246 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788838240.148649:0:92502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838240.148674:0:92502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4a00/0x88da08396ccc96f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce35 expref: -99 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.148696:0:92502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4a00/0x88da08396ccc96f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 7 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.148788:0:92502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4a00/0x88da08396ccc96f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 7 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.148819:0:92502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4a00, rc 0) 00010000:00080000:3.0:1788838240.149071:0:92502:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788838240.149084:0:92502:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:1.0:1788838240.149220:0:66260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135101312 00000100:00100000:1.0:1788838240.149226:0:66260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135101312 00000100:00100000:1.0:1788838240.149328:0:66260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788838240.149336:0:66260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66262:x1875729135101312:12345-0@lo:700:mdt_seqm_0000.0 00010000:00080000:1.0:1788838240.149348:0:66260:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8ff62bd6c700 x1875729135101312/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:141/0 lens 264/0 e 0 to 0 dl 1788838251 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838240.154223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838240.154255:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116448768 00000100:00100000:3.0:1788838240.154264:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116448768 00000100:00100000:3.0:1788838240.154317:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1336 00000100:00100000:3.0:1788838240.154327:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116448768:12345-192.168.203.30@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1788838240.154362:0:76060:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff5059aaa00 x1875729116448768/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:141/0 lens 224/0 e 0 to 0 dl 1788838251 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838240.154378:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116448768:12345-192.168.203.30@tcp:400:ptlrpcd_rcv.0 Request processed in 54us (165us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838240.154385:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1336 00010000:00080000:3.0:1788838240.154413:0:92502:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788838240.154524:0:92502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 40000000:02000000:2.0:1788838240.157512:0:66260:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000001:00100000:3.0:1788838240.164132:0:92470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000001:00100000:3.0:1788838240.164143:0:92470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788838240.164185:0:92502:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788838240.164246:0:92502:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788838240.164260:0:92502:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8ff5059a9500 x1875729135116672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:141/0 lens 224/0 e 0 to 0 dl 1788838251 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788838240.164363:0:92502:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.30@tcp: req@ffff8ff5059aaa00 x1875729116448768/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:141/0 lens 224/0 e 0 to 0 dl 1788838251 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838240.164423:0:92502:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:2.0:1788838240.176613:0:66260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66262:x1875729135101312:12345-0@lo:700:mdt_seqm_0000.0 Request processed in 27272us (30556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.176653:0:66260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788838240.176713:0:66262:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c700 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-lwp-MDT0001_UUID:66262:1875729135101312:0@lo:700:mdt_seqm_0000.0 40000000:02000000:2.0:1788838240.176728:0:66262:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000100:00080000:3.0:1788838240.186586:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788838240.187017:0:3642:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8ff62bc94e00 x1875729135116672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838256 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838240.187030:0:3642:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8ff62bc94e00 x1875729135116672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838256 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838240.187038:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788838240.187064:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788838240.187081:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006f82ebd9): req@ffff8ff505ac6300 x1875729135098624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838240.187120:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f6c159ae): req@ffff8ff63956a680 x1875729135096576/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838224 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838240.187133:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135116672:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788838240.193155:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135116800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838240.199278:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838240.199361:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135116800 00000100:00100000:2.0:1788838240.199369:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135116800 00000100:00100000:2.0:1788838240.199475:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4175 00000100:00100000:2.0:1788838240.199485:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135116800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838240.199522:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1788838240.199569:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135116800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.199577:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4175 00000100:00100000:2.0:1788838240.199624:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135116800:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788838240.200967:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788838240.201055:0:66262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71015:x1875729116441856:12345-192.168.203.30@tcp:700:cp.0 Request processed in 20847839us (20847942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.201066:0:66262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:2.0:1788838240.205093:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838240.205142:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116449024 00000100:00100000:2.0:1788838240.205151:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116449024 00000100:00100000:2.0:1788838240.205198:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1353 00000100:00100000:2.0:1788838240.205208:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71015:x1875729116449024:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1788838240.205229:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838240.205254:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9e00/0x88da08396ccc96fd lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce82 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.205350:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8600/0x88da08396ccc9704 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.205359:0:66255:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8600/0x88da08396ccc9704 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.205369:0:66255:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8600/0x88da08396ccc9704 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838240.205425:0:66255:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66255:1875729135116928:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1788838240.205474:0:66255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838240.205506:0:66255:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838240.211371:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135116928 00000100:00100000:3.0:1788838240.211387:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135116928 00000100:00100000:3.0:1788838240.211461:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4176 00000100:00100000:3.0:1788838240.211471:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66255:x1875729135116928:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1788838240.211492:0:23765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838240.211513:0:23765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc970b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9704 expref: -99 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.211542:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc970b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9704 expref: 7 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.211555:0:23765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc970b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9704 expref: 7 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.211563:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:3.0:1788838240.211566:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838240.211570:0:23765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5c00, rc 0) 00000100:00100000:1.0:1788838240.218499:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838240.218630:0:75683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.218630:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135096576 00000100:00100000:1.0:1788838240.218640:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135096576 00000100:00100000:2.0:1788838240.218664:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611bf4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838240.218687:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66255:x1875729135116928:12345-0@lo:101:mdt00_002.0 Request processed in 7213us (13208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838240.218687:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135098624 00000100:00100000:1.0:1788838240.218693:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135098624 00000100:00100000:2.0:1788838240.218694:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4177 00000100:00100000:3.0:1788838240.218706:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4176 00000100:00100000:2.0:1788838240.218712:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3644:x1875729135096576:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838240.218718:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4178 00000100:00100000:1.0:1788838240.218728:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75683:x1875729135098624:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788838240.218766:0:66255:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66255:1875729135116928:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1788838240.218788:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8600/0x88da08396ccc9704 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc970b expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.218834:0:66255:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8600/0x88da08396ccc9704 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc970b expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788838240.218858:0:66255:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788838240.218866:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8600/0x88da08396ccc9704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc970b expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.218874:0:66255:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8600/0x88da08396ccc9704 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc970b expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.218938:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.218950:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.218962:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.218978:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.218985:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.218991:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838240.219132:0:66255:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66255:1875729135117056:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788838240.219178:0:66255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838240.219196:0:66255:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff605757900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838240.219210:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135117056 00000100:00100000:3.0:1788838240.219214:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135117056 00000100:00100000:3.0:1788838240.219233:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4179 00000100:00100000:3.0:1788838240.219240:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66255:x1875729135117056:12345-0@lo:1000:mdt00_002.0 00000004:00000024:2.0:1788838240.221896:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445076992 avail 1298837504 00000100:00100000:2.0:1788838240.221954:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3644:x1875729135096576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3244us (3461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.221965:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4177 00000100:00100000:2.0:1788838240.222032:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135096576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838240.222086:0:75683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac6300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135098624:0@lo:1000:osp_up0-1.0 00000004:00000080:2.0:1788838240.222997:0:92502:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f5187b5be10 00100000:10000000:2.0:1788838240.223012:0:92502:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:1.0:1788838240.224476:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75683:x1875729135098624:12345-0@lo:1000:osp_up0-1.0 Request processed in 5742us (5839us total) trans 120259084289 rc 0/0 00000100:00100000:1.0:1788838240.224493:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4178 00000004:00080000:2.0:1788838240.224980:0:92490:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:2.0:1788838240.225036:0:92490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc97800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92490:1875729135117184:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788838240.225095:0:92490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838240.225126:0:92490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788838240.225364:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135117184 00000100:00100000:3.0:1788838240.225371:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135117184 00000100:00100000:3.0:1788838240.225422:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5969 00000100:00100000:3.0:1788838240.225432:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:92490:x1875729135117184:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788838240.225463:0:8462:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -62 00002000:02000040:3.0:1788838240.225469:0:8462:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:865) 00000004:00080000:1.0:1788838240.226793:0:92488:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x322:0x0] 00000100:00100000:1.0:1788838240.226849:0:92488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92488:1875729135117312:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788838240.226906:0:92488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838240.226944:0:92488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788838240.227003:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135117312 00000100:00100000:1.0:1788838240.227009:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135117312 00000100:00100000:1.0:1788838240.227059:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5970 00000100:00100000:1.0:1788838240.227067:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:92488:x1875729135117312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788838240.227105:0:8460:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -63 00002000:02000040:1.0:1788838240.227110:0:8460:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:803 to 0x280000401:865) 00000100:00100000:2.0:1788838240.229263:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66255:x1875729135117056:12345-0@lo:1000:mdt00_002.0 Request processed in 10014us (10075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.229289:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4179 00002000:00010000:3.0:1788838240.241979:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.241993:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc9720 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242012:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x361:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.242017:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x361:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.242024:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc9720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242042:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc9720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242053:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc9720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242080:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc9720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242098:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838240.242199:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.242204:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9727 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242213:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x360:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.242216:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x360:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.242220:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242228:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242236:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9727 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242243:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242255:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838240.242287:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.242292:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc972e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242305:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35f:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.242308:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.242313:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc972e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242321:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc972e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242330:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc972e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242338:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc972e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242354:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788838240.242495:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.242500:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9735 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242508:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35e:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.242511:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.242515:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242524:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.242542:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9735 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.243886:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.243916:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788838240.243983:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838240.243993:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc9720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.244005:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838240.244007:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.244014:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc973c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244017:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc9720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244029:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35d:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.244035:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838240.244036:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc9720 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244041:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc973c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244061:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc973c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244066:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc9720 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244071:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc973c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244080:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da522494/0x88da08396ccc9720 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244084:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc973c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244121:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788838240.244124:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838240.244132:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.244158:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838240.244160:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.244166:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9743 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244168:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9727 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244182:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35c:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.244189:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838240.244193:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9727 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244195:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244215:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244224:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9727 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244225:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244244:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5c5525c/0x88da08396ccc9727 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244246:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244266:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788838240.244273:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838240.244279:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc972e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244289:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.244294:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc972e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244305:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc972e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244317:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc972e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244335:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006357e6af/0x88da08396ccc972e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244352:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838240.244357:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244380:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.244384:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9735 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244403:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9735 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244413:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9735 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244420:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc36dc0d/0x88da08396ccc9735 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244433:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838240.244436:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc973c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244442:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.244451:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc973c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244459:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc973c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244469:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc973c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244475:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f02997c/0x88da08396ccc973c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244487:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838240.244490:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244496:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.244499:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244506:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9743 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244516:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9743 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244523:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000242be36c/0x88da08396ccc9743 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.244544:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838240.244545:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838240.244547:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838240.244761:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.244766:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc974a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244773:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35b:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.244780:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.244784:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc974a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244793:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc974a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244815:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc974a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244821:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc974a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244834:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838240.244870:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.244874:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc9751 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244881:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35a:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.244883:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.244887:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc9751 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244894:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc9751 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244901:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc9751 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244912:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc9751 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244919:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838240.244951:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.244955:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9758 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244961:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x359:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.244964:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x359:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.244967:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244974:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244981:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244987:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.244993:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788838240.245019:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.245023:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc975f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245034:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x358:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.245036:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.245039:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc975f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245047:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc975f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245053:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc975f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245059:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc975f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245066:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788838240.245095:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.245099:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9766 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245105:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x357:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.245107:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x357:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.245110:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245117:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245133:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9766 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245139:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245146:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788838240.245177:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.245181:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc976d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245188:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x356:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.245191:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.245195:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc976d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245204:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc976d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245211:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc976d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245219:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc976d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245236:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788838240.245268:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.245273:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9774 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245281:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x355:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.245284:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x355:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.245288:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245297:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245304:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245312:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245320:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788838240.245348:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.245352:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc977b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245360:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x354:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.245368:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x354:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.245373:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc977b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245383:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc977b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245383:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788838240.245402:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc974a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245412:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.245416:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc974a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245425:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc974a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245439:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc974a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245446:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e7bc6b8/0x88da08396ccc974a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245463:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788838240.245467:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc9751 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245473:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.245483:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc9751 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245500:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc9751 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245501:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc977b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245523:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc977b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245527:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc9751 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245535:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788838240.245539:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d557da4f/0x88da08396ccc9751 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245554:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788838240.245558:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245565:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.245569:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.245577:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838240.245578:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9758 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245587:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9782 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245595:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9758 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245598:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x353:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.245605:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x353:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.245614:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245615:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000225dd361/0x88da08396ccc9758 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245625:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245640:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245643:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838240.245649:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc975f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245664:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245665:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.245671:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc975f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245679:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788838240.245683:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc975f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245707:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc975f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.245714:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.245720:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9789 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245723:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a230b97a/0x88da08396ccc975f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245734:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x352:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.245738:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838240.245742:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788838240.245743:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9789 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245749:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245762:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9789 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245763:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.245768:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9766 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245780:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9789 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245792:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245821:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9766 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245826:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788838240.245840:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9766 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245849:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008178cdca/0x88da08396ccc9766 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.245866:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838240.245866:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838240.245873:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc976d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245876:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc9790 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245890:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x351:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:2.0:1788838240.245894:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.245896:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x351:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838240.245899:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc976d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245902:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc9790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245920:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc976d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.245924:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc9790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245942:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc976d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245952:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b3b037d/0x88da08396ccc976d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245980:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838240.245984:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.245990:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.245993:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246000:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246013:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9774 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246021:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003efb8d3f/0x88da08396ccc9774 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246033:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838240.246036:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc977b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246041:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.246044:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc977b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246062:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc977b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246075:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc977b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246083:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062d7dfb4/0x88da08396ccc977b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246096:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838240.246099:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc9790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246100:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246121:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc9790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246122:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.246129:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246134:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788838240.246143:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9782 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246154:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9782 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246164:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086fcecf0/0x88da08396ccc9782 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.246175:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.246185:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9797 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246195:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x350:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:2.0:1788838240.246196:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838240.246200:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x350:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838240.246203:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246206:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246226:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cae00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.246230:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246232:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246250:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9789 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246267:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246274:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9789 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246277:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246293:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a895c7c/0x88da08396ccc9789 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246296:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788838240.246313:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838240.246317:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc9790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246324:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.246328:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc9790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.246337:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838240.246347:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc9790 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246358:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc9790 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246366:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf54a8bd/0x88da08396ccc9790 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246378:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838240.246381:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246400:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.246403:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246411:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9797 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246421:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9797 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246428:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018df10cf/0x88da08396ccc9797 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.246451:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838240.246453:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838240.246455:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.246601:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc979e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246610:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34f:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.246613:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.246617:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc979e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246626:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc979e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246634:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc979e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246642:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc979e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246666:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838240.246704:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.246708:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc97a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246715:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34e:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.246717:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.246720:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc97a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246727:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc97a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246734:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc97a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246740:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc97a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246746:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838240.246773:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.246778:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc97ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246784:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34d:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.246791:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.246794:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc97ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246822:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc97ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246828:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc97ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246834:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc97ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246841:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788838240.246874:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.246878:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc97b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246884:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34c:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.246887:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.246890:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc97b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246897:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc97b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246903:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc97b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246914:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc97b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246921:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788838240.246950:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.246954:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc97ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246961:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34b:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.246963:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.246966:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc97ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246973:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc97ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246980:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc97ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246986:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc97ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.246992:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788838240.247017:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.247021:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f225263/0x88da08396ccc97c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247033:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34a:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.247035:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.247040:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f225263/0x88da08396ccc97c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247048:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f225263/0x88da08396ccc97c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247055:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788838240.247056:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f225263/0x88da08396ccc97c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247064:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc979e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247066:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f225263/0x88da08396ccc97c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247087:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.247089:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788838240.247093:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc979e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247104:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc979e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247118:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc979e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.247124:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838240.247127:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096290704/0x88da08396ccc979e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247131:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000930dc0c1/0x88da08396ccc97c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247145:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x349:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.247148:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x349:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.247151:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000930dc0c1/0x88da08396ccc97c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247154:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838240.247161:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc97a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247164:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000930dc0c1/0x88da08396ccc97c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247178:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.247190:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc97a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247198:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc97a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247210:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc97a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247217:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080a62a27/0x88da08396ccc97a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247230:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838240.247236:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc97ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247241:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000930dc0c1/0x88da08396ccc97c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247247:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cbe00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838240.247253:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc97ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247256:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000930dc0c1/0x88da08396ccc97c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247273:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc97ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247276:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788838240.247290:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc97ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247299:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000975438d1/0x88da08396ccc97ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.247316:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838240.247320:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788838240.247323:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc358ab5/0x88da08396ccc97cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247325:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc97b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247343:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x348:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:2.0:1788838240.247345:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.247349:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x348:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838240.247351:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc97b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247356:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc358ab5/0x88da08396ccc97cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247368:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc97b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247372:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc358ab5/0x88da08396ccc97cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247402:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc97b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247405:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc358ab5/0x88da08396ccc97cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247410:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838240.247420:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc97ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247423:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4592350/0x88da08396ccc97b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247427:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc358ab5/0x88da08396ccc97cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247445:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.247452:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc97ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247456:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838240.247463:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f225263/0x88da08396ccc97c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247480:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc97ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247481:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.247482:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788838240.247488:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f225263/0x88da08396ccc97c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247505:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc97ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.247521:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838240.247530:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f225263/0x88da08396ccc97c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247532:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046e1109e/0x88da08396ccc97d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247532:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d8fd5d/0x88da08396ccc97ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247558:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x347:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:2.0:1788838240.247561:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f225263/0x88da08396ccc97c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247562:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x347:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.247571:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046e1109e/0x88da08396ccc97d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247576:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f225263/0x88da08396ccc97c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247581:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838240.247586:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046e1109e/0x88da08396ccc97d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247588:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000930dc0c1/0x88da08396ccc97c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247602:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838240.247611:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc358ab5/0x88da08396ccc97cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247612:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046e1109e/0x88da08396ccc97d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247612:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.247620:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000930dc0c1/0x88da08396ccc97c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247633:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cbc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.247638:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046e1109e/0x88da08396ccc97d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247640:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc358ab5/0x88da08396ccc97cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247661:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838240.247665:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc358ab5/0x88da08396ccc97cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247672:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000930dc0c1/0x88da08396ccc97c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247679:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc358ab5/0x88da08396ccc97cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247690:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc358ab5/0x88da08396ccc97cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247690:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000930dc0c1/0x88da08396ccc97c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.247696:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.247707:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089b3e448/0x88da08396ccc97dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247714:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000930dc0c1/0x88da08396ccc97c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247724:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x346:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.247739:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x346:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.247745:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089b3e448/0x88da08396ccc97dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247755:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838240.247756:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089b3e448/0x88da08396ccc97dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247756:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838240.247760:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.247762:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046e1109e/0x88da08396ccc97d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.247765:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.247774:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089b3e448/0x88da08396ccc97dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247778:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cba00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.247784:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046e1109e/0x88da08396ccc97d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247786:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089b3e448/0x88da08396ccc97dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247845:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.247865:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046e1109e/0x88da08396ccc97d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247877:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046e1109e/0x88da08396ccc97d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.247881:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.247889:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046e1109e/0x88da08396ccc97d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247891:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067782214/0x88da08396ccc97e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247906:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x345:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.247913:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x345:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.247921:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067782214/0x88da08396ccc97e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247929:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838240.247933:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067782214/0x88da08396ccc97e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247934:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089b3e448/0x88da08396ccc97dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247951:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067782214/0x88da08396ccc97e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247953:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.247957:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089b3e448/0x88da08396ccc97dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247979:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067782214/0x88da08396ccc97e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.247980:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089b3e448/0x88da08396ccc97dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.247999:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.248004:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089b3e448/0x88da08396ccc97dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248014:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089b3e448/0x88da08396ccc97dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248028:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.248032:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067782214/0x88da08396ccc97e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838240.248038:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.248039:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.248046:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067782214/0x88da08396ccc97e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248047:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5945a17/0x88da08396ccc97eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248067:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x344:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.248072:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x344:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.248080:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5945a17/0x88da08396ccc97eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248085:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067782214/0x88da08396ccc97e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248093:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5945a17/0x88da08396ccc97eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248103:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5945a17/0x88da08396ccc97eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248111:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5945a17/0x88da08396ccc97eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248118:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838240.248145:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.248150:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc97f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248162:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x343:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.248165:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.248169:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc97f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248178:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc97f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248186:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc97f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248193:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc97f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248201:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838240.248232:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.248236:0:8462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc97f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248243:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x342:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.248246:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.248250:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc97f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248259:0:8462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc97f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248276:0:8462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc97f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248283:0:8462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc97f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248290:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788838240.248438:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067782214/0x88da08396ccc97e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248448:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067782214/0x88da08396ccc97e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248464:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838240.248468:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5945a17/0x88da08396ccc97eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248476:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3caa00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.248480:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5945a17/0x88da08396ccc97eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248489:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5945a17/0x88da08396ccc97eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248502:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5945a17/0x88da08396ccc97eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248511:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5945a17/0x88da08396ccc97eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788838240.248522:0:8462:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00010000:00010000:0.0:1788838240.248540:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838240.248544:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc97f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248550:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.248554:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc97f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838240.248615:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:92490:x1875729135117184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23181us (23517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838240.248624:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5969 00010000:00010000:3.0:1788838240.248658:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838240.248663:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc97f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248669:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc97f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248670:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.248677:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc97f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248690:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc97f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248691:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc97f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248709:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccc97f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.248712:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc97f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248729:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.248733:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.248735:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000846565a0/0x88da08396ccc97f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.248736:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.248755:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.248758:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.248760:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838240.248879:0:92490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc97800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92490:1875729135117184:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788838240.248897:0:92490:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x361:0x0] from OST, last_created [0x2c0000401:0x361:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:2.0:1788838240.248969:0:92490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc97b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92490:1875729135117568:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788838240.249011:0:92490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838240.249038:0:92490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788838240.249053:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135117440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838240.249083:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838240.249110:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838240.249134:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135117568 00000100:00100000:2.0:1788838240.249143:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135117568 00000100:00100000:2.0:1788838240.249183:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5971 00000100:00100000:2.0:1788838240.249192:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:92490:x1875729135117568:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788838240.249228:0:26210:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 866 00000100:00100000:3.0:1788838240.249340:0:66255:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66255:1875729135117056:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788838240.249889:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135117440 00000100:00100000:2.0:1788838240.249896:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135117440 00000100:00100000:2.0:1788838240.249931:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:2.0:1788838240.249941:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875729135117440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838240.249960:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838240.250017:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875729135117440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838240.250026:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:2.0:1788838240.250072:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135117440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788838240.250248:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788838240.258595:0:66255:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x471:0x0], count =401 00000004:00080000:1.0:1788838240.258607:0:66255:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x471:0x0]+401 in llog 00000004:00080000:1.0:1788838240.258627:0:66255:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x602:0x0], index 1: 0 00010000:00010000:1.0:1788838240.258936:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50712ce00/0x88da08396ccc9800 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.258954:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50712ce00/0x88da08396ccc9800 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.258967:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50712ce00/0x88da08396ccc9800 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259010:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259018:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259025:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259032:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259039:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838240.259044:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259060:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259075:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:1.0:1788838240.259079:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838240.259084:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259090:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a5000/0x88da08396ccc9712 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838240.259106:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4b9fd09 reply state 000000008fd61965 transno 77309411444 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259117:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259124:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xb1bed465 (ffff8ff6055e2900) 00010000:00010000:1.0:1788838240.259127:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838240.259129:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788838240.259167:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9e00/0x88da08396ccc96fd lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce82 expref: 10 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259185:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50712ce00/0x88da08396ccc9800 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce82 expref: 9 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.259194:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff8ff612676a00) 00010000:00010000:1.0:1788838240.259196:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838240.259199:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712ce00, rc 0) 00000001:00100000:0.0:1788838240.259315:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788838240.259346:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.259354:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a276fff/0x88da08396ccc980e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259367:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x361:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.259379:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x361:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.259385:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a276fff/0x88da08396ccc980e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259412:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a276fff/0x88da08396ccc980e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259421:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a276fff/0x88da08396ccc980e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259429:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a276fff/0x88da08396ccc980e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259445:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.259463:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.259468:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a276fff/0x88da08396ccc980e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259475:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e4e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.259479:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a276fff/0x88da08396ccc980e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259487:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a276fff/0x88da08396ccc980e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259501:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a276fff/0x88da08396ccc980e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259519:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a276fff/0x88da08396ccc980e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259537:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.259538:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.259540:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.259751:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.259758:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa60902e/0x88da08396ccc9815 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259767:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x360:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.259770:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x360:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.259774:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa60902e/0x88da08396ccc9815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259784:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa60902e/0x88da08396ccc9815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259792:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa60902e/0x88da08396ccc9815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.259816:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa60902e/0x88da08396ccc9815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838240.259892:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71015:x1875729116449024:12345-192.168.203.30@tcp:101:cp.0 Request processed in 54682us (54807us total) trans 77309411444 rc 0/0 00000100:00100000:1.0:1788838240.259901:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1353 00010000:00010000:0.0:1788838240.259989:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788838240.261028:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:92490:x1875729135117568:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11833us (12012us total) trans 4294969454 rc 0/0 00000100:00100000:3.0:1788838240.261039:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5971 00010000:00010000:3.0:1788838240.261198:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838240.261207:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa60902e/0x88da08396ccc9815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.261220:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e4a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.261225:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa60902e/0x88da08396ccc9815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.261237:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa60902e/0x88da08396ccc9815 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.261259:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa60902e/0x88da08396ccc9815 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838240.261299:0:92490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc97b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92490:1875729135117568:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788838240.261322:0:92490:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x361:0x0]-[0x2c0000401:0x381:0x0] 00010000:00010000:3.0:1788838240.261339:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa60902e/0x88da08396ccc9815 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.261362:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.261365:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.261368:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.263491:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.263503:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a904a03/0x88da08396ccc981c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263521:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35f:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.263527:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.263533:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a904a03/0x88da08396ccc981c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263549:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a904a03/0x88da08396ccc981c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263559:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a904a03/0x88da08396ccc981c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263568:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a904a03/0x88da08396ccc981c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263591:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838240.263623:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838240.263632:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a904a03/0x88da08396ccc981c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.263641:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e5800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.263646:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a904a03/0x88da08396ccc981c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838240.263653:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.263656:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a904a03/0x88da08396ccc981c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263661:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000556e88e5/0x88da08396ccc9823 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263676:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35e:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.263680:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838240.263684:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a904a03/0x88da08396ccc981c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263685:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000556e88e5/0x88da08396ccc9823 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.263694:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a904a03/0x88da08396ccc981c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263710:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000556e88e5/0x88da08396ccc9823 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263720:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000556e88e5/0x88da08396ccc9823 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.263722:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.263725:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.263728:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.263732:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000556e88e5/0x88da08396ccc9823 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263750:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838240.263757:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838240.263764:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000556e88e5/0x88da08396ccc9823 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.263772:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e5e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.263777:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000556e88e5/0x88da08396ccc9823 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.263785:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000556e88e5/0x88da08396ccc9823 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838240.263795:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.263823:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0582162/0x88da08396ccc982a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.263827:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000556e88e5/0x88da08396ccc9823 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263834:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35d:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.263842:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000556e88e5/0x88da08396ccc9823 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263842:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.263851:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0582162/0x88da08396ccc982a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.263859:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.263862:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0582162/0x88da08396ccc982a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.263863:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.263867:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.263878:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0582162/0x88da08396ccc982a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263898:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0582162/0x88da08396ccc982a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263917:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.263926:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.263931:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0582162/0x88da08396ccc982a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263939:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e5000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.263942:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0582162/0x88da08396ccc982a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263950:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0582162/0x88da08396ccc982a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263961:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0582162/0x88da08396ccc982a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263969:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0582162/0x88da08396ccc982a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.263981:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.263983:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.263984:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.264023:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.264034:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc9831 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264042:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35c:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.264045:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.264049:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc9831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264057:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc9831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264066:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc9831 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264072:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc9831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264091:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838240.264124:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.264130:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc9838 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264138:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35b:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.264141:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.264144:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc9838 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264164:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc9838 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264178:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc9838 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264180:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838240.264189:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc9831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264190:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc9838 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264212:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3caa00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.264218:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc9831 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264225:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838240.264241:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc9831 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264255:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc9831 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838240.264263:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.264264:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5945a17/0x88da08396ccc9831 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264271:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc983f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264279:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35a:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.264286:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.264295:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc983f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264306:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.264306:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc983f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264312:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc9838 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264319:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc983f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264325:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.264331:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc9838 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264333:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc983f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264355:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc9838 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264381:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc9838 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264385:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838240.264409:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067782214/0x88da08396ccc9838 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838240.264434:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.264439:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.264442:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc9846 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264444:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc983f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264465:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.264465:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x359:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.264471:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc983f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264472:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x359:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.264480:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc9846 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264487:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc983f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264494:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc9846 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264502:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc983f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264505:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc9846 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264521:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b3e448/0x88da08396ccc983f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264524:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc9846 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264545:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.264546:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788838240.264550:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc9846 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264554:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.264561:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cba00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.264564:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc9846 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264584:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc9846 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838240.264590:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838240.264596:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc9846 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264597:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc984d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264616:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396ccc9846 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.264630:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.264631:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x358:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:3.0:1788838240.264633:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.264635:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.264642:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.264642:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.264650:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc984d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264661:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc984d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264668:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc984d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264676:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc984d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264687:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.264694:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.264698:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc984d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264705:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.264709:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc984d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264716:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc984d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264727:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc984d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.264728:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.264747:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000930dc0c1/0x88da08396ccc984d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264761:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.264763:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.264765:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.264818:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.264823:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396ccc9854 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264831:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x357:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.264834:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x357:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.264837:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396ccc9854 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264847:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396ccc9854 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264855:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396ccc9854 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264862:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396ccc9854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264875:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838240.264919:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.264927:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc4e25d2/0x88da08396ccc985b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264934:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x356:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.264936:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.264940:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc4e25d2/0x88da08396ccc985b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264947:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc4e25d2/0x88da08396ccc985b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264953:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc4e25d2/0x88da08396ccc985b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264959:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc4e25d2/0x88da08396ccc985b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.264971:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838240.265005:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.265009:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1094e1/0x88da08396ccc9862 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265016:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x355:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.265018:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x355:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.265021:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f1094e1/0x88da08396ccc9862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265029:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f1094e1/0x88da08396ccc9862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265040:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1094e1/0x88da08396ccc9862 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265047:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f1094e1/0x88da08396ccc9862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265058:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788838240.265064:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838240.265067:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396ccc9854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265073:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.265076:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396ccc9854 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265083:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396ccc9854 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265092:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396ccc9854 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265098:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396ccc9854 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265109:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838240.265116:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc4e25d2/0x88da08396ccc985b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265121:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91c400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.265124:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc4e25d2/0x88da08396ccc985b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265130:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc4e25d2/0x88da08396ccc985b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265138:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc4e25d2/0x88da08396ccc985b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265143:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc4e25d2/0x88da08396ccc985b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265153:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.265155:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f1094e1/0x88da08396ccc9862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265160:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91c200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.265162:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1094e1/0x88da08396ccc9862 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265167:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1094e1/0x88da08396ccc9862 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265183:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f1094e1/0x88da08396ccc9862 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265189:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f1094e1/0x88da08396ccc9862 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265199:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.265201:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.265202:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.265235:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.265239:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d54b5b6a/0x88da08396ccc9869 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265246:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x354:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.265248:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x354:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.265252:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d54b5b6a/0x88da08396ccc9869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265259:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d54b5b6a/0x88da08396ccc9869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265265:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d54b5b6a/0x88da08396ccc9869 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265271:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d54b5b6a/0x88da08396ccc9869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265290:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.265296:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.265299:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d54b5b6a/0x88da08396ccc9869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265305:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91d800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.265308:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d54b5b6a/0x88da08396ccc9869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265314:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d54b5b6a/0x88da08396ccc9869 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265323:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d54b5b6a/0x88da08396ccc9869 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265330:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d54b5b6a/0x88da08396ccc9869 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.265358:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.265476:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.265478:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.265480:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.265519:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.265525:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4e9f21a/0x88da08396ccc9870 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265534:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x353:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.265542:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x353:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.265547:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4e9f21a/0x88da08396ccc9870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265556:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4e9f21a/0x88da08396ccc9870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265565:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4e9f21a/0x88da08396ccc9870 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265572:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4e9f21a/0x88da08396ccc9870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265586:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.265593:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.265597:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4e9f21a/0x88da08396ccc9870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265604:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91dc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.265608:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4e9f21a/0x88da08396ccc9870 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265616:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4e9f21a/0x88da08396ccc9870 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265625:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4e9f21a/0x88da08396ccc9870 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265642:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4e9f21a/0x88da08396ccc9870 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265654:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.265656:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.265658:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.265693:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.265698:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b65b4738/0x88da08396ccc9877 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265706:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x352:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.265709:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.265713:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65b4738/0x88da08396ccc9877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265721:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b65b4738/0x88da08396ccc9877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265729:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b65b4738/0x88da08396ccc9877 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265736:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b65b4738/0x88da08396ccc9877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265754:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838240.265784:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.265794:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037104887/0x88da08396ccc987e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265824:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x351:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.265827:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x351:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.265832:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037104887/0x88da08396ccc987e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265842:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037104887/0x88da08396ccc987e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265850:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037104887/0x88da08396ccc987e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.265859:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.265859:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037104887/0x88da08396ccc987e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.265873:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b65b4738/0x88da08396ccc9877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265875:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.265885:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838240.265886:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91c800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.265890:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037104887/0x88da08396ccc987e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.265893:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65b4738/0x88da08396ccc9877 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265908:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91c000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838240.265913:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65b4738/0x88da08396ccc9877 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265913:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037104887/0x88da08396ccc987e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265938:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037104887/0x88da08396ccc987e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.265943:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b65b4738/0x88da08396ccc9877 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.265963:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b65b4738/0x88da08396ccc9877 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265968:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037104887/0x88da08396ccc987e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.265978:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037104887/0x88da08396ccc987e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.265984:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838240.265987:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838240.265990:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.265996:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.266000:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.266002:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.266040:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.266044:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9891efa/0x88da08396ccc9885 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266051:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x350:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.266054:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x350:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.266058:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9891efa/0x88da08396ccc9885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266067:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9891efa/0x88da08396ccc9885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266075:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9891efa/0x88da08396ccc9885 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266082:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9891efa/0x88da08396ccc9885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266108:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838240.266717:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.266725:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1938e1/0x88da08396ccc988c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266735:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34f:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.266738:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.266742:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1938e1/0x88da08396ccc988c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266752:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc1938e1/0x88da08396ccc988c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266760:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc1938e1/0x88da08396ccc988c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266768:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc1938e1/0x88da08396ccc988c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266785:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838240.266793:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838240.266812:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9891efa/0x88da08396ccc9885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266820:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91de00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.266829:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9891efa/0x88da08396ccc9885 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266838:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9891efa/0x88da08396ccc9885 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266850:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9891efa/0x88da08396ccc9885 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266857:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9891efa/0x88da08396ccc9885 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266870:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.266873:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc1938e1/0x88da08396ccc988c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266879:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91c600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.266883:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1938e1/0x88da08396ccc988c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266890:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc1938e1/0x88da08396ccc988c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266897:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc1938e1/0x88da08396ccc988c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266904:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc1938e1/0x88da08396ccc988c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266919:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.266921:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.266923:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.266967:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.266972:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1e0d51f/0x88da08396ccc9893 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266979:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34e:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.266982:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.266986:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e0d51f/0x88da08396ccc9893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.266995:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1e0d51f/0x88da08396ccc9893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267003:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1e0d51f/0x88da08396ccc9893 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267011:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1e0d51f/0x88da08396ccc9893 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267021:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.267027:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.267030:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1e0d51f/0x88da08396ccc9893 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267046:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91d000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.267049:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1e0d51f/0x88da08396ccc9893 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267055:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1e0d51f/0x88da08396ccc9893 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267064:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1e0d51f/0x88da08396ccc9893 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267070:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1e0d51f/0x88da08396ccc9893 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267080:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.267081:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.267082:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.267116:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.267120:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d07e016/0x88da08396ccc989a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267127:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34d:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.267129:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.267132:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d07e016/0x88da08396ccc989a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267139:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d07e016/0x88da08396ccc989a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267151:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d07e016/0x88da08396ccc989a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.267157:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d07e016/0x88da08396ccc989a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.267236:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838240.267894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838240.267936:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116449152 00000100:00100000:3.0:1788838240.267946:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116449152 00000100:00100000:3.0:1788838240.267988:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5972 00000100:00100000:3.0:1788838240.267997:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff641349850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2403:x1875729116449152:12345-192.168.203.30@tcp:8:cp.0 00010000:00080000:3.0:1788838240.268034:0:26218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp t0 exp 0000000000000000 cur 3634 last 0 00000020:00000080:3.0:1788838240.268065:0:26218:0:(genops.c:1385:class_connect()) connect: client efc561ba-875e-4857-b79b-9bd7023bd57c, cookie 0x88da08396ccc98a1 00002000:00100000:3.0:1788838240.268078:0:26218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli efc561ba-875e-4857-b79b-9bd7023bd57c/ffff8ff62c81a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788838240.268090:0:26218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788838240.268147:0:26218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788838240.268176:0:26218:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838240.268252:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff641349850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116449152:12345-192.168.203.30@tcp:8:cp.0 Request processed in 254us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838240.268260:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5972 00010000:00010000:0.0:1788838240.269265:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.269281:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.269289:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d07e016/0x88da08396ccc989a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269299:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91da00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.269304:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d07e016/0x88da08396ccc989a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269400:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d07e016/0x88da08396ccc989a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269419:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d07e016/0x88da08396ccc989a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269425:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d07e016/0x88da08396ccc989a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269446:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.269453:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.269454:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.269548:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.269553:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049729557/0x88da08396ccc98a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269563:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34c:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.269567:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.269572:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049729557/0x88da08396ccc98a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269582:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049729557/0x88da08396ccc98a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269589:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049729557/0x88da08396ccc98a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269595:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049729557/0x88da08396ccc98a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269607:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.269613:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.269617:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049729557/0x88da08396ccc98a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269623:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91d400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.269625:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049729557/0x88da08396ccc98a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269641:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049729557/0x88da08396ccc98a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269650:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049729557/0x88da08396ccc98a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269656:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049729557/0x88da08396ccc98a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269667:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.269668:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.269669:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838240.269704:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.269708:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7e5f045/0x88da08396ccc98af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269715:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34b:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.269717:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.269721:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e5f045/0x88da08396ccc98af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269728:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7e5f045/0x88da08396ccc98af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269734:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7e5f045/0x88da08396ccc98af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269745:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e5f045/0x88da08396ccc98af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269759:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838240.269791:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.269795:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a076a751/0x88da08396ccc98b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269816:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34a:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.269818:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.269822:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a076a751/0x88da08396ccc98b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269829:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a076a751/0x88da08396ccc98b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269836:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a076a751/0x88da08396ccc98b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269842:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a076a751/0x88da08396ccc98b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269854:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788838240.269860:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838240.269864:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7e5f045/0x88da08396ccc98af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269875:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91ca00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.269878:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e5f045/0x88da08396ccc98af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269885:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e5f045/0x88da08396ccc98af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269894:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7e5f045/0x88da08396ccc98af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269900:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7e5f045/0x88da08396ccc98af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269914:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.269918:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a076a751/0x88da08396ccc98b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269925:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91d200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.269928:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a076a751/0x88da08396ccc98b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.269932:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.269936:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a076a751/0x88da08396ccc98b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.269947:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a076a751/0x88da08396ccc98b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788838240.270442:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788838240.270457:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838240.271139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838240.271240:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116449280 00000100:00100000:1.0:1788838240.271249:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116449280 00000100:00100000:1.0:1788838240.271303:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5973 00000100:00100000:1.0:1788838240.271313:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+6:0:x1875729116449280:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:1.0:1788838240.271329:0:8657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838240.271348:0:8657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc98bd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce89 expref: -99 pid: 8657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838240.271370:0:8657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x602:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838240.271400:0:8657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:1.0:1788838240.271405:0:8657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838240.271414:0:8657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc98bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce89 expref: 7 pid: 8657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.271430:0:8657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc98bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce89 expref: 7 pid: 8657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.271443:0:8657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d200, rc 0) 00010000:00010000:0.0:1788838240.271474:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a076a751/0x88da08396ccc98b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271497:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.271499:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.271503:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838240.271504:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:0:x1875729116449280:12345-192.168.203.30@tcp:101:cp.0 Request processed in 190us (368us total) trans 0 rc 0/0 00000100:00080000:0.0:1788838240.271512:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838240.271514:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5973 00002000:00010000:0.0:1788838240.271595:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.271602:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009404f4c4/0x88da08396ccc98c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271611:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x349:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.271614:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x349:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.271618:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009404f4c4/0x88da08396ccc98c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271628:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009404f4c4/0x88da08396ccc98c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271637:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009404f4c4/0x88da08396ccc98c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271644:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009404f4c4/0x88da08396ccc98c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271666:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838240.271711:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.271716:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d097dbe/0x88da08396ccc98cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271723:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x348:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.271726:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x348:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.271730:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d097dbe/0x88da08396ccc98cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271738:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d097dbe/0x88da08396ccc98cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271745:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d097dbe/0x88da08396ccc98cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271751:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d097dbe/0x88da08396ccc98cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271769:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838240.271811:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.271815:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000559646ff/0x88da08396ccc98d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271822:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x347:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.271825:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x347:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.271828:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000559646ff/0x88da08396ccc98d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271846:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000559646ff/0x88da08396ccc98d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271853:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000559646ff/0x88da08396ccc98d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271859:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000559646ff/0x88da08396ccc98d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271868:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788838240.271913:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838240.271918:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f722e6f/0x88da08396ccc98d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271925:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x346:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:0.0:1788838240.271928:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x346:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838240.271932:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f722e6f/0x88da08396ccc98d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271940:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f722e6f/0x88da08396ccc98d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.271943:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788838240.271950:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f722e6f/0x88da08396ccc98d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.271953:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009404f4c4/0x88da08396ccc98c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.271969:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91ce00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.271975:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009404f4c4/0x88da08396ccc98c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.271978:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f722e6f/0x88da08396ccc98d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.271994:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009404f4c4/0x88da08396ccc98c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.272000:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788838240.272011:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788838240.272012:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009404f4c4/0x88da08396ccc98c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.272016:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d097dbe/0x88da08396ccc98cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.272019:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009404f4c4/0x88da08396ccc98c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.272035:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91cc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.272039:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d097dbe/0x88da08396ccc98cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.272043:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838240.272049:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000559646ff/0x88da08396ccc98d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.272052:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d097dbe/0x88da08396ccc98cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.272056:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b91d600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.272065:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000559646ff/0x88da08396ccc98d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.272068:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d097dbe/0x88da08396ccc98cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.272074:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000559646ff/0x88da08396ccc98d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.272084:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d097dbe/0x88da08396ccc98cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.272089:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000559646ff/0x88da08396ccc98d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.272099:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000559646ff/0x88da08396ccc98d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.272108:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838240.272111:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.272114:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.272114:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f722e6f/0x88da08396ccc98d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.272117:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.272135:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.272139:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f722e6f/0x88da08396ccc98d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.272148:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f722e6f/0x88da08396ccc98d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.272188:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838240.272194:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838240.273227:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838240.273235:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccc98e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273260:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x345:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:1.0:1788838240.273264:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x345:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838240.273268:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccc98e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273279:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccc98e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273287:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccc98e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273295:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccc98e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273310:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838240.273366:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838240.273371:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccc98e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273379:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x344:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:1.0:1788838240.273382:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x344:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838240.273386:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccc98e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.273446:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f722e6f/0x88da08396ccc98d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.273455:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f722e6f/0x88da08396ccc98d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.273472:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.273475:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccc98e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.273483:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712ca00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.273487:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccc98e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.273496:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccc98e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.273504:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccc98e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.273527:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccc98e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.273540:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.273542:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.273544:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838240.273587:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccc98e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273609:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccc98e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273617:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccc98e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273641:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838240.273690:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838240.273695:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc98ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273702:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x343:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:1.0:1788838240.273706:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838240.273710:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc98ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273820:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc98ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273828:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc98ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273834:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc98ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.273861:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788838240.273971:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838240.273978:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccc98e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.273986:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.273989:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccc98e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.273997:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccc98e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.274010:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccc98e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.274025:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccc98e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.274043:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838240.274046:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc98ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.274053:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838240.274056:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc98ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.274064:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc98ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.274074:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc98ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.274080:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b710050e/0x88da08396ccc98ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.274092:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.274094:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838240.274095:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838240.274182:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838240.274234:0:8460:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838240.274241:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ddc9a8b/0x88da08396ccc98f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.274250:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x342:0x0].0x0 since=3634s v=(0 0) 00010000:00010000:1.0:1788838240.274253:0:8460:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838240.274258:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ddc9a8b/0x88da08396ccc98f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.274269:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ddc9a8b/0x88da08396ccc98f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.274278:0:8460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ddc9a8b/0x88da08396ccc98f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.274287:0:8460:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ddc9a8b/0x88da08396ccc98f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.274299:0:8460:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838240.274579:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838240.274586:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ddc9a8b/0x88da08396ccc98f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.274597:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148f600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838240.274601:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ddc9a8b/0x88da08396ccc98f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788838240.274605:0:8460:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:802 00010000:00010000:0.0:1788838240.274614:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ddc9a8b/0x88da08396ccc98f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.274627:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ddc9a8b/0x88da08396ccc98f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.274635:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ddc9a8b/0x88da08396ccc98f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838240.274649:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.274651:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.274653:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838240.274664:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838240.274698:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:92488:x1875729135117312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 47628us (47788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838240.274709:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5970 00000100:00100000:2.0:1788838240.274726:0:92488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92488:1875729135117312:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788838240.274744:0:92488:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x361:0x0] from OST, last_created [0x280000401:0x361:0x0]last_used is [0x280000401:0x322:0x0] 00000100:00100000:0.0:1788838240.274835:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135117696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838240.274885:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838240.275293:0:92488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92488:1875729135117824:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788838240.275321:0:92488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838240.275338:0:92488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838240.276045:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135117824 00000100:00100000:3.0:1788838240.276054:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135117824 00000100:00100000:3.0:1788838240.276176:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5974 00000100:00100000:3.0:1788838240.276196:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:92488:x1875729135117824:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788838240.276235:0:26208:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 866 00000100:00100000:2.0:1788838240.276355:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838240.276383:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116449408 00000100:00100000:2.0:1788838240.276403:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116449408 00000100:00100000:2.0:1788838240.276437:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5975 00000100:00100000:2.0:1788838240.276446:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71015:x1875729116449408:12345-192.168.203.30@tcp:101:cp.0 00010000:00010000:2.0:1788838240.276458:0:26212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838240.276475:0:26212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce90 expref: -99 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.276502:0:26212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc98bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce89 expref: 8 pid: 8657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.276512:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838240.276516:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838240.276521:0:26212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 8 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.276548:0:26212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc98bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce89 expref: 8 pid: 8657 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838240.276576:0:26212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc98bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce89 expref: 8 pid: 8657 timeout: 3734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838240.276589:0:26212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:26212:1875729135117952:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788838240.276654:0:26212:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838240.276848:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135117696 00000100:00100000:0.0:1788838240.276853:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135117696 00000100:00100000:0.0:1788838240.276884:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:0.0:1788838240.276891:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135117696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838240.276904:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 896 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838240.276948:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135117696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838240.276956:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:0.0:1788838240.276997:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135117696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838240.280703:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:92488:x1875729135117824:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4500us (5372us total) trans 4294969455 rc 0/0 00000100:00100000:3.0:1788838240.280718:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5974 00000100:00100000:2.0:1788838240.280782:0:92488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92488:1875729135117824:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788838240.280817:0:92488:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x361:0x0]-[0x280000401:0x381:0x0] 00000100:00100000:3.0:1788838240.286108:0:26212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:26212:1875729135117952:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788838240.286141:0:26212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 8 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838240.286161:0:26212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9600, rc 0) 00000100:00100000:3.0:1788838240.286215:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71015:x1875729116449408:12345-192.168.203.30@tcp:101:cp.0 Request processed in 9771us (9863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838240.286224:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5975 00000100:00100000:2.0:1788838240.293103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838240.295228:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116449536 00000100:00100000:1.0:1788838240.295244:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116449536 00010000:00010000:1.0:1788838240.295289:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc98bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce89 expref: 8 pid: 8657 timeout: 3734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838240.295349:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2551 00000100:00100000:1.0:1788838240.295360:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2404:x1875729116449536:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838240.295375:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838240.295409:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc98bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce89 expref: 8 pid: 8657 timeout: 3734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.295428:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc98bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce89 expref: 8 pid: 8657 timeout: 3734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.295455:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b89c550/0x88da08396ccc98bd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce89 expref: 8 pid: 8657 timeout: 3734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.295476:0:6532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838240.295481:0:6532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838240.295490:0:6532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 7 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.295499:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 7 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838240.295535:0:6532:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 7 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838240.295561:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6532:1875729135118080:192.168.203.30@tcp:105: 00000100:00100000:1.0:1788838240.295645:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788838240.303230:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6532:1875729135118080:192.168.203.30@tcp:105: 00010000:00010000:1.0:1788838240.303257:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838240.303323:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116449536:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 7964us (10228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838240.303334:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2551 00000100:00100000:0.0:1788838240.306430:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838240.306548:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116449792 00000100:00100000:3.0:1788838240.306558:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116449792 00000100:00100000:3.0:1788838240.306607:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:3.0:1788838240.306616:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71015:x1875729116449792:12345-192.168.203.30@tcp:35:cp.0 00000001:00080000:3.0:1788838240.306843:0:66256:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 77309411445 00000100:00100000:3.0:1788838240.306947:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+12:71015:x1875729116449792:12345-192.168.203.30@tcp:35:cp.0 Request processed in 331us (527us total) trans 77309411446 rc 0/0 00000100:00100000:3.0:1788838240.306954:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 233 00000020:00080000:3.0:1788838240.306958:0:66256:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788838240.318065:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788838241.165636:0:92807:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788838241.165986:0:92807:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788838241.341460:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838241.343377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838241.343425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838241.343451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838241.343476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838241.343507:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116450048 00000100:00100000:0.0:1788838241.343517:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116450048 00000100:00100000:0.0:1788838241.343568:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116450176 00000100:00100000:0.0:1788838241.343572:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116450176 00000100:00100000:0.0:1788838241.343604:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1337 00000100:00100000:0.0:1788838241.343613:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116450048:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838241.343684:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116450048:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838241.343692:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1337 00000100:00100000:0.0:1788838241.343722:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1338 00000100:00100000:0.0:1788838241.343728:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2405:x1875729116450176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838241.343758:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2405:x1875729116450176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838241.343765:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1338 00000100:00100000:0.0:1788838241.343783:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116450304 00000100:00100000:0.0:1788838241.343786:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116450304 00000100:00100000:0.0:1788838241.343830:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2652 00000100:00100000:0.0:1788838241.343838:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116450304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838241.343933:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116450304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 95us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838241.343940:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2652 00000100:00100000:0.0:1788838241.343960:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116449920 00000100:00100000:0.0:1788838241.343963:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116449920 00000100:00100000:0.0:1788838241.343995:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:0.0:1788838241.344002:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116449920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838241.344028:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116449920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838241.344035:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00080000:0.0:1788838241.344067:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838241.661694:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135118208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838241.661764:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838241.661977:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838241.661987:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135118336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838241.662015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838241.662046:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135118208 00000100:00100000:1.0:1788838241.662054:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135118208 00000100:00100000:1.0:1788838241.662096:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135118336 00000100:00100000:1.0:1788838241.662099:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135118336 00000100:00100000:1.0:1788838241.662115:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:1.0:1788838241.662123:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135118208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838241.662144:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838241.662186:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135118208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838241.662193:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:1.0:1788838241.662208:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:1.0:1788838241.662214:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135118336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838241.662225:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838241.662251:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135118336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838241.663199:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:1.0:1788838241.663258:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135118336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838241.667092:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135118208:0@lo:13:osp-pre-0-1.0 00000020:00000004:1.0:1788838242.112306:0:92857:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838242.112565:0:92857:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788838242.351824:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838242.351891:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116450432 00000100:00100000:2.0:1788838242.351902:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116450432 00000100:00100000:2.0:1788838242.351979:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1354 00000100:00100000:2.0:1788838242.351990:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71282:x1875729116450432:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1788838242.352010:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838242.352033:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce97 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838242.352527:0:66253:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 445us 00000100:00080000:0.0:1788838242.355531:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788838242.366445:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838242.375619:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.375642:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.375661:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.375675:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9911 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.375681:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.375687:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838242.375840:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66253:1875729135118464:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788838242.376509:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838242.376539:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff605757900 going to sleep for 11 seconds 00000100:00100000:2.0:1788838242.376559:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135118464 00000100:00100000:2.0:1788838242.376565:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135118464 00000100:00100000:2.0:1788838242.376603:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4180 00000100:00100000:2.0:1788838242.376610:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66253:x1875729135118464:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788838242.376677:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66253:x1875729135118464:12345-0@lo:1000:mdt00_000.0 Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838242.376684:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4180 00000100:00100000:2.0:1788838242.378090:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66253:1875729135118464:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788838242.378146:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9918 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378163:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9918 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378187:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9918 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838242.378227:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9918 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378242:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378249:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378256:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378262:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378268:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838242.378273:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378279:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378292:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:2.0:1788838242.378295:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838242.378299:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378305:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc990a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378325:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378331:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9911 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378337:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378342:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838242.378345:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378351:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9911 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378359:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8ff624400a00) 00010000:00010000:2.0:1788838242.378361:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838242.378363:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9911 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378368:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9911 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378413:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce97 expref: 9 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378424:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9918 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce97 expref: 8 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.378440:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff624400200) 00010000:00010000:2.0:1788838242.378443:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788838242.378445:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8200, rc 0) 00000100:00100000:2.0:1788838242.378511:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71282:x1875729116450432:12345-192.168.203.30@tcp:101:rm.0 Request processed in 26523us (26713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838242.378518:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1354 00000100:00100000:0.0:1788838242.383094:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838242.383185:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116450560 00000100:00100000:2.0:1788838242.383195:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116450560 00000100:00100000:2.0:1788838242.383343:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1355 00000100:00100000:2.0:1788838242.383354:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+12:71282:x1875729116450560:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1788838242.383385:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838242.383406:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9400/0x88da08396ccc991f lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ce9e expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.383463:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9926 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.383477:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9926 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.383487:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9926 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838242.383530:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00000004:00200000:2.0:1788838242.383533:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788838242.383566:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9400/0x88da08396ccc991f lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce9e expref: 14 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.383595:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9926 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce9e expref: 13 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.383603:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:2.0:1788838242.383606:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788838242.383609:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8c00, rc 0) 00000100:00100000:2.0:1788838242.383665:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+13:71282:x1875729116450560:12345-192.168.203.30@tcp:101:rm.0 Request processed in 313us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838242.383672:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1355 00000100:00100000:0.0:1788838242.386564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838242.386677:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116450816 00000100:00100000:3.0:1788838242.386687:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116450816 00000100:00100000:3.0:1788838242.386774:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1356 00000100:00100000:3.0:1788838242.386792:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+13:71282:x1875729116450816:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1788838242.386832:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838242.386865:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528800/0x88da08396ccc992d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cea5 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838242.386965:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00010000:00010000:3.0:1788838242.387060:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528800/0x88da08396ccc992d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cea5 expref: 15 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.387087:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff627601500) 00010000:00010000:3.0:1788838242.387091:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788838242.387096:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528800/0x88da08396ccc992d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cea5 expref: 15 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.387117:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528800, rc 0) 00000100:00100000:3.0:1788838242.387498:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+14:71282:x1875729116450816:12345-192.168.203.30@tcp:101:rm.0 Request processed in 388us (622us total) trans 77309411447 rc 301/301 00000100:00100000:3.0:1788838242.387506:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1356 00000100:00100000:1.0:1788838242.392524:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838242.392638:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116450944 00000100:00100000:3.0:1788838242.392649:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116450944 00000100:00100000:3.0:1788838242.392736:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:3.0:1788838242.392749:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502466050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+14:71282:x1875729116450944:12345-192.168.203.30@tcp:37:rm.0 00000100:00100000:3.0:1788838242.396760:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502466050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+14:71282:x1875729116450944:12345-192.168.203.30@tcp:37:rm.0 Request processed in 4004us (4236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838242.396774:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:1.0:1788838242.400218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838242.400503:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116451200 00000100:00100000:0.0:1788838242.400515:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116451200 00000100:00100000:0.0:1788838242.400599:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:0.0:1788838242.400610:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+14:71282:x1875729116451200:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:0.0:1788838242.400872:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+15:71282:x1875729116451200:12345-192.168.203.30@tcp:35:rm.0 Request processed in 262us (660us total) trans 77309411448 rc 0/0 00000100:00100000:0.0:1788838242.400880:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:1.0:1788838242.406245:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838242.406443:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116451456 00000100:00100000:2.0:1788838242.406453:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116451456 00000100:00100000:2.0:1788838242.406515:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1357 00000100:00100000:2.0:1788838242.406525:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+15:71282:x1875729116451456:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1788838242.406550:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838242.406572:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8000/0x88da08396ccc993b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ceac expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.406677:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9942 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.406692:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9942 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.406704:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9942 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838242.406715:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00010000:00010000:2.0:1788838242.406871:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8000/0x88da08396ccc993b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceac expref: 18 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.406894:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9942 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceac expref: 17 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.406904:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:2.0:1788838242.406907:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788838242.406910:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9a00, rc 0) 00000100:00100000:2.0:1788838242.406966:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+17:71282:x1875729116451456:12345-192.168.203.30@tcp:101:rm.0 Request processed in 443us (729us total) trans 77309411449 rc 0/0 00000100:00100000:2.0:1788838242.406973:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1357 00000100:00100000:2.0:1788838242.418416:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838242.418530:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116451584 00000100:00100000:0.0:1788838242.418542:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116451584 00000100:00100000:0.0:1788838242.418601:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1358 00000100:00100000:0.0:1788838242.418613:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+17:71282:x1875729116451584:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1788838242.418639:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838242.418660:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626e00/0x88da08396ccc9950 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ceb3 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.418727:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626c00/0x88da08396ccc9957 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.418740:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626c00/0x88da08396ccc9957 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.418751:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626c00/0x88da08396ccc9957 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838242.418848:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1788838242.418860:0:66254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788838242.418882:0:66254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626c00/0x88da08396ccc9957 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.418910:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626e00/0x88da08396ccc9950 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceb3 expref: 19 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.418943:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626c00/0x88da08396ccc9957 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceb3 expref: 18 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.418952:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:0.0:1788838242.418955:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788838242.418958:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626c00, rc 0) 00000100:00100000:0.0:1788838242.419013:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+18:71282:x1875729116451584:12345-192.168.203.30@tcp:101:rm.0 Request processed in 403us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838242.419020:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1358 00000100:00100000:1.0:1788838242.423156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838242.423254:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116451840 00000100:00100000:0.0:1788838242.423273:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116451840 00000100:00100000:0.0:1788838242.423333:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1359 00000100:00100000:0.0:1788838242.423344:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+18:71282:x1875729116451840:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1788838242.423366:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838242.423398:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc995e lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ceba expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838242.423515:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00010000:00010000:0.0:1788838242.423624:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc995e lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceba expref: 20 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.423639:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:0.0:1788838242.423642:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838242.423648:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc995e lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceba expref: 20 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.423682:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627600, rc 0) 00000100:00100000:0.0:1788838242.423749:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+19:71282:x1875729116451840:12345-192.168.203.30@tcp:101:rm.0 Request processed in 406us (602us total) trans 77309411450 rc 301/301 00000100:00100000:0.0:1788838242.423757:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1359 00000100:00100000:1.0:1788838242.432106:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838242.432230:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116451968 00000100:00100000:3.0:1788838242.432252:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116451968 00000100:00100000:3.0:1788838242.432318:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 236 00000100:00100000:3.0:1788838242.432329:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+19:71282:x1875729116451968:12345-192.168.203.30@tcp:37:rm.0 00000100:00100000:3.0:1788838242.437909:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+19:71282:x1875729116451968:12345-192.168.203.30@tcp:37:rm.0 Request processed in 5570us (5800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838242.437924:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 236 00000100:00100000:0.0:1788838242.446052:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838242.446304:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116452224 00000100:00100000:2.0:1788838242.446314:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116452224 00000100:00100000:2.0:1788838242.446382:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:2.0:1788838242.446393:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+19:71282:x1875729116452224:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:2.0:1788838242.446613:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+20:71282:x1875729116452224:12345-192.168.203.30@tcp:35:rm.0 Request processed in 221us (569us total) trans 77309411451 rc 0/0 00000100:00100000:2.0:1788838242.446621:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:1.0:1788838242.455113:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838242.455362:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116452480 00000100:00100000:2.0:1788838242.455373:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116452480 00000100:00100000:2.0:1788838242.455436:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1360 00000100:00100000:2.0:1788838242.455445:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+20:71282:x1875729116452480:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1788838242.455469:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838242.455499:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8000/0x88da08396ccc996c lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cec1 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.455626:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9973 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.455640:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9973 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.455652:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9973 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838242.455662:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00010000:00010000:2.0:1788838242.455752:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8000/0x88da08396ccc996c lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec1 expref: 23 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.455769:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9973 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec1 expref: 22 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.455778:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:2.0:1788838242.455781:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788838242.455784:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9e00, rc 0) 00000100:00100000:2.0:1788838242.456174:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+22:71282:x1875729116452480:12345-192.168.203.30@tcp:101:rm.0 Request processed in 728us (1067us total) trans 77309411452 rc 0/0 00000100:00100000:2.0:1788838242.456182:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1360 00000100:00100000:1.0:1788838242.460346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838242.460495:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116452608 00000100:00100000:0.0:1788838242.460506:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116452608 00000100:00100000:0.0:1788838242.460563:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1361 00000100:00100000:0.0:1788838242.460573:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71282:x1875729116452608:12345-192.168.203.30@tcp:41:rm.0 00000004:00000024:0.0:1788838242.460626:0:66254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382958080 00000100:00100000:0.0:1788838242.460698:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71282:x1875729116452608:12345-192.168.203.30@tcp:41:rm.0 Request processed in 125us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838242.460705:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1361 00000100:00100000:1.0:1788838242.463640:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838242.463725:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116452864 00000100:00100000:0.0:1788838242.463733:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116452864 00000100:00100000:0.0:1788838242.463786:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1362 00000100:00100000:0.0:1788838242.463826:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+22:71282:x1875729116452864:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:0.0:1788838242.463891:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788838242.463918:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50712ce00/0x88da08396ccc9800 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce82 expref: 22 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.463939:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff8ff612676a00) 00010000:00010000:0.0:1788838242.463958:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626c00/0x88da08396ccc9957 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceb3 expref: 21 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.463983:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:0.0:1788838242.463987:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838242.464008:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9981 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464020:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9981 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464029:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9981 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464040:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464049:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464055:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464155:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc998f lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464164:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc998f lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464172:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc998f lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788838242.464401:0:75504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4a:0x0].2, 64 off8320 00000004:00080000:0.0:1788838242.464410:0:75504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3636483612168ns, next at 3637483609973ns, rc = 0 00010000:00010000:0.0:1788838242.464459:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464468:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464476:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464483:0:75504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464489:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464495:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464511:0:75504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838242.464528:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc998f lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464534:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc998f lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464540:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc998f lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464546:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838242.464550:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc998f lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464558:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc998f lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464573:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff8ff608f3c200) 00010000:00010000:0.0:1788838242.464576:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788838242.464580:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc998f lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464586:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc998f lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464600:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9981 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464606:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9981 lrc: 2/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464612:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9981 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464617:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838242.464620:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9981 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464625:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9981 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464631:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:0.0:1788838242.464634:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838242.464636:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9981 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464642:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9981 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838242.464659:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2099b06 reply state 00000000c47838b3 transno 77309411453 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464669:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.464675:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xb1bed465 (ffff8ff6055e2900) 00010000:00010000:0.0:1788838242.464677:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838242.464680:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838242.464752:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+22:71282:x1875729116452864:12345-192.168.203.30@tcp:36:rm.0 Request processed in 956us (1119us total) trans 77309411453 rc 0/0 00000100:00100000:0.0:1788838242.464760:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1362 00000100:00100000:2.0:1788838242.468185:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838242.468250:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116453120 00000100:00100000:3.0:1788838242.468268:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116453120 00000100:00100000:3.0:1788838242.468318:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:3.0:1788838242.468326:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+22:71282:x1875729116453120:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:3.0:1788838242.468538:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+23:71282:x1875729116453120:12345-192.168.203.30@tcp:35:rm.0 Request processed in 212us (362us total) trans 77309411454 rc 0/0 00000100:00100000:3.0:1788838242.468546:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 238 00010000:00010000:1.0:1788838242.468692:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838242.468701:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.468711:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838242.468716:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.468725:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.468741:0:63563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff8ff608f3c200) 00010000:00010000:1.0:1788838242.468744:0:63563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788838242.468749:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 1/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.468773:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9996 lrc: 0/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.468794:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838242.468834:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838242.468836:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838242.471925:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838242.472074:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116453376 00000100:00100000:1.0:1788838242.472084:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116453376 00000100:00100000:1.0:1788838242.472143:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1363 00000100:00100000:1.0:1788838242.472154:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+23:71282:x1875729116453376:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:1.0:1788838242.472210:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788838242.472235:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9973 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec1 expref: 23 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472269:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4800/0x88da08396ccc9480 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce4a expref: 22 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472281:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff6055e2b00) 00010000:00010000:1.0:1788838242.472296:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9926 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce9e expref: 21 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472305:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:1.0:1788838242.472308:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838242.472326:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472338:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472359:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472373:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472390:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472396:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472473:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f800/0x88da08396ccc99ab lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472481:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f800/0x88da08396ccc99ab lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472488:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f800/0x88da08396ccc99ab lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838242.472715:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00010000:00010000:1.0:1788838242.472731:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f800/0x88da08396ccc99ab lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472739:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f800/0x88da08396ccc99ab lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472747:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f800/0x88da08396ccc99ab lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472754:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148f800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838242.472764:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f800/0x88da08396ccc99ab lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472773:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f800/0x88da08396ccc99ab lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472789:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8ff612676d00) 00010000:00010000:1.0:1788838242.472792:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788838242.472921:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f800/0x88da08396ccc99ab lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472929:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f800/0x88da08396ccc99ab lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472950:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472958:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472964:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472970:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472976:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148fc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838242.472979:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.472985:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.473005:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:1.0:1788838242.473007:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838242.473010:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.473016:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148fc00/0x88da08396ccc999d lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838242.473025:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d64d0a2a reply state 00000000375e0063 transno 77309411455 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.473034:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.473041:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xf7117594 (ffff8ff612676b00) 00010000:00010000:1.0:1788838242.473043:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838242.473046:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838242.473113:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+22:71282:x1875729116453376:12345-192.168.203.30@tcp:36:rm.0 Request processed in 960us (1200us total) trans 77309411455 rc 0/0 00000100:00100000:1.0:1788838242.473121:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1363 00000100:00100000:0.0:1788838242.476913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838242.477007:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116453760 00000100:00100000:1.0:1788838242.477018:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116453760 00000100:00100000:1.0:1788838242.477081:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:1.0:1788838242.477092:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+22:71282:x1875729116453760:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:1.0:1788838242.477315:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+23:71282:x1875729116453760:12345-192.168.203.30@tcp:35:rm.0 Request processed in 224us (410us total) trans 77309411456 rc 0/0 00000100:00100000:1.0:1788838242.477323:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:2.0:1788838242.482009:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838242.482134:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116453504 00000100:00100000:1.0:1788838242.482157:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116453504 00000100:00100000:1.0:1788838242.482220:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 728 00000100:00100000:1.0:1788838242.482231:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2404:x1875729116453504:12345-192.168.203.30@tcp:103:rm.0 00010000:00010000:1.0:1788838242.482247:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838242.482281:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9918 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce97 expref: 8 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.482299:0:26219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff624400200) 00010000:00010000:1.0:1788838242.482308:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838242.482353:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116453504:12345-192.168.203.30@tcp:103:rm.0 Request processed in 124us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838242.482360:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 728 00000100:00100000:2.0:1788838242.484003:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838242.484134:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116454016 00000100:00100000:0.0:1788838242.484143:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116454016 00000100:00100000:0.0:1788838242.484196:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1364 00000100:00100000:0.0:1788838242.484206:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+23:71282:x1875729116454016:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:0.0:1788838242.484271:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788838242.484295:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9a00/0x88da08396ccc9942 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceac expref: 23 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.484317:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff600030400/0x88da08396ccc9464 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xd:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce43 expref: 22 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.484328:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff61254ce00) 00010000:00010000:0.0:1788838242.484337:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838242.484389:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.484411:0:66254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.484422:0:66254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838242.484443:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135118592:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1788838242.484495:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838242.484527:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476600 going to sleep for 11 seconds 00000100:00100000:1.0:1788838242.485027:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135118592 00000100:00100000:1.0:1788838242.485034:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135118592 00000100:00100000:1.0:1788838242.485081:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4181 00000100:00100000:1.0:1788838242.485088:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66254:x1875729135118592:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788838242.485101:0:37907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838242.485115:0:37907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc99b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc99b2 expref: -99 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.485139:0:37907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4a00/0x88da08396ccc96f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 6 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.485149:0:37907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc99b9 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc99b2 expref: 9 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.485173:0:37907:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4a00/0x88da08396ccc96f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 6 pid: 92502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.485197:0:37907:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4a00/0x88da08396ccc96f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 6 pid: 92502 timeout: 3736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838242.485209:0:37907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:37907:1875729135118720:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788838242.485279:0:37907:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838242.489540:0:37907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:37907:1875729135118720:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788838242.489584:0:37907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc99b9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc99b2 expref: 9 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.489596:0:37907:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:1.0:1788838242.489598:0:37907:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838242.489601:0:37907:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc99b9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc99b2 expref: 9 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.489611:0:37907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e600, rc 0) 00000100:00100000:1.0:1788838242.489671:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66254:x1875729135118592:12345-0@lo:101:mdt00_001.0 Request processed in 4583us (5175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838242.489680:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4181 00000100:00100000:0.0:1788838242.489918:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135118592:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788838242.489936:0:66254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.489946:0:66254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838242.500759:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838242.501108:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116454144 00000100:00100000:1.0:1788838242.501128:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116454144 00010000:00010000:1.0:1788838242.501174:0:10364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4a00/0x88da08396ccc96f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 7 pid: 92502 timeout: 3736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838242.501218:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2552 00000100:00100000:1.0:1788838242.501228:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116454144:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838242.501250:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838242.501266:0:10364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4a00/0x88da08396ccc96f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 7 pid: 92502 timeout: 3736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.501281:0:10364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4a00/0x88da08396ccc96f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 7 pid: 92502 timeout: 3736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.501302:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4a00/0x88da08396ccc96f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce35 expref: 7 pid: 92502 timeout: 3736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.501318:0:10364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:1.0:1788838242.501325:0:10364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc99b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc99b2 expref: 8 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.501336:0:10364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc99b9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x88da08396ccc99b2 expref: 8 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.501345:0:10364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc99b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x88da08396ccc99b2 expref: 8 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.501387:0:10364:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc99b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc99b2 expref: 8 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838242.501400:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10364:1875729135118848:0@lo:105: 00000100:00100000:1.0:1788838242.501450:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838242.501737:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838242.503253:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135118848 00000100:00100000:2.0:1788838242.503278:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135118848 00000100:00100000:2.0:1788838242.503339:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788838242.503349:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10364:x1875729135118848:12345-0@lo:105: 00010000:00010000:2.0:1788838242.503364:0:6530:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.503384:0:6530:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.503394:0:6530:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.503402:0:6530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.503410:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.503419:0:6530:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.503453:0:6530:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8ff504626200) 00000100:00100000:2.0:1788838242.503542:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:10364:x1875729135118848:12345-0@lo:105: Request processed in 193us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838242.503550:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788838242.503596:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:10364:1875729135118848:0@lo:105: 00010000:00010000:2.0:1788838242.503616:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838242.503675:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2405:x1875729116454144:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 2447us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838242.503685:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2552 00010000:00010000:1.0:1788838242.504109:0:66254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.504137:0:66254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788838242.504158:0:66254:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788838242.504198:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.504206:0:66254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838242.504217:0:66254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838242.504234:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135118976:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1788838242.504656:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838242.504693:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838242.504749:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135118976 00000100:00100000:0.0:1788838242.504756:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135118976 00000100:00100000:0.0:1788838242.504819:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4182 00000100:00100000:0.0:1788838242.504828:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66254:x1875729135118976:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788838242.504846:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838242.504878:0:8472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc99c7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc99c0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.504905:0:8472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc99c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc99c0 expref: 10 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.504934:0:8472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc99c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc99c0 expref: 10 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.504944:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8ff608f3c100) 00010000:00010000:0.0:1788838242.504946:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838242.504949:0:8472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626800, rc 0) 00000100:00100000:0.0:1788838242.504991:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66254:x1875729135118976:12345-0@lo:101:mdt00_001.0 Request processed in 165us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838242.504997:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4182 00000100:00100000:0.0:1788838242.505034:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135118976:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788838242.505050:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc99c7 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.505059:0:66254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc99c7 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838242.505078:0:66254:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1788838242.505115:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135119104:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788838242.505155:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838242.505173:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476180 going to sleep for 11 seconds 00000100:00100000:0.0:1788838242.505189:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135119104 00000100:00100000:0.0:1788838242.505192:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135119104 00000100:00100000:0.0:1788838242.505218:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4183 00000100:00100000:0.0:1788838242.505224:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66254:x1875729135119104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788838242.505292:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66254:x1875729135119104:12345-0@lo:1000:mdt00_001.0 Request processed in 68us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838242.505304:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4183 00000100:00100000:0.0:1788838242.505334:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135119104:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788838242.505369:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135119232:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788838242.505405:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838242.505419:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476180 going to sleep for 11 seconds 00000100:00100000:0.0:1788838242.505430:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135119232 00000100:00100000:0.0:1788838242.505433:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135119232 00000100:00100000:0.0:1788838242.505453:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4184 00000100:00100000:0.0:1788838242.505459:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66254:x1875729135119232:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788838242.505562:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66254:x1875729135119232:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (156us total) trans 0 rc 1/1 00000100:00100000:0.0:1788838242.505569:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4184 00000100:00100000:0.0:1788838242.505596:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135119232:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788838242.505639:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.505648:0:66254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.505657:0:66254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838242.505669:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135119360:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1788838242.505693:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838242.505707:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476600 going to sleep for 11 seconds 00000100:00100000:0.0:1788838242.505719:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135119360 00000100:00100000:0.0:1788838242.505722:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135119360 00000100:00100000:0.0:1788838242.505753:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4185 00000100:00100000:0.0:1788838242.505759:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66254:x1875729135119360:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788838242.505767:0:37907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838242.505780:0:37907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc99d5 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc99ce expref: -99 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.505817:0:37907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc99d5 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc99ce expref: 11 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.505829:0:37907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc99d5 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc99ce expref: 11 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.505836:0:37907:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff608f3ca00) 00010000:00010000:0.0:1788838242.505839:0:37907:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788838242.505841:0:37907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627e00, rc 0) 00000100:00100000:0.0:1788838242.505868:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135119360:12345-0@lo:101:mdt00_001.0 Request processed in 109us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838242.505874:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4185 00000100:00100000:0.0:1788838242.505897:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135119360:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788838242.505907:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.505916:0:66254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.505937:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626600/0x88da08396ccc99dc lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.506429:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626600/0x88da08396ccc99dc lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838242.506438:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626600/0x88da08396ccc99dc lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788838242.506759:0:66254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].6, 432 off41304 00000040:00080000:0.0:1788838242.506842:0:66254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].5, 512 off39864 00000004:00080000:0.0:1788838242.506848:0:66254:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8ff503476600 with version 14 00000004:00080000:1.0:1788838242.507009:0:75683:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8ff626ae9780 version 14 rpc_version 14 00000020:00100000:1.0:1788838242.507037:0:75683:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788838242.507047:0:75683:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8ff61d27d180 x1875729135119616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838242.507065:0:75683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27d180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135119616:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788838242.507120:0:75683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838242.507146:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049e73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838242.507288:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135119616 00000100:00100000:0.0:1788838242.507294:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135119616 00000100:00100000:0.0:1788838242.507366:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4186 00000100:00100000:0.0:1788838242.507384:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75683:x1875729135119616:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788838242.512010:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75683:x1875729135119616:12345-0@lo:1000:osp_up0-1.0 Request processed in 4627us (4881us total) trans 120259084290 rc 0/0 00000100:00100000:0.0:1788838242.512026:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4186 00000100:00100000:2.0:1788838242.512171:0:75683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27d180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135119616:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1788838242.512242:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xd:0x0]: returning size 4096 00010000:00010000:3.0:1788838242.512275:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626600/0x88da08396ccc99dc lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512285:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626600/0x88da08396ccc99dc lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512294:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626600/0x88da08396ccc99dc lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512300:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838242.512304:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626600/0x88da08396ccc99dc lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512311:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626600/0x88da08396ccc99dc lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512347:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff608f3c400) 00010000:00010000:3.0:1788838242.512350:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838242.512359:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626600/0x88da08396ccc99dc lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512365:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626600/0x88da08396ccc99dc lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512394:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512406:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512413:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512435:0:66254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788838242.512448:0:66254:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788838242.512454:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512461:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512467:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512481:0:66254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1788838242.512493:0:66254:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788838242.512499:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc99c7 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838242.512506:0:66254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc99c7 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838242.512572:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+22:71282:x1875729116454016:12345-192.168.203.30@tcp:36:rm.0 Request processed in 28366us (28574us total) trans 77309411457 rc 0/0 00000100:00100000:3.0:1788838242.512580:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1364 00010000:00010000:2.0:1788838242.512725:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838242.512732:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.512740:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626000 already unused, calling callback (ffffffffc19f7ee0) 00010000:00010000:2.0:1788838242.512745:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838242.512753:0:6534:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.512783:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.512790:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838242.512843:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 1/0,0 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.512862:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626000/0x88da08396ccc99ce lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc99d5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.512878:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838242.512882:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.512900:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626200 already unused, calling callback (ffffffffc19f7ee0) 00010000:00010000:2.0:1788838242.512904:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838242.512911:0:6534:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.512928:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.512933:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838242.512947:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.512954:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626200/0x88da08396ccc99b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc99b9 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.512964:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838242.512966:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838242.512968:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838242.513184:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135119744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838242.513236:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838242.513283:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838242.513290:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135119872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838242.513311:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838242.513448:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135119744 00000100:00100000:2.0:1788838242.513456:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135119744 00000100:00100000:2.0:1788838242.513500:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135119872 00000100:00100000:2.0:1788838242.513503:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135119872 00000100:00100000:2.0:1788838242.513524:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1788838242.513532:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3643:x1875729135119744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838242.513545:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838242.513564:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc99d5 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc99ce expref: 13 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.513584:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0x0 (ffff8ff608f3ca00) 00010000:00010000:2.0:1788838242.513592:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838242.513629:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3643:x1875729135119744:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838242.513636:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1788838242.513649:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1788838242.513655:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3643:x1875729135119872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838242.513662:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838242.513672:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc99b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc99b2 expref: 11 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838242.513682:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:2.0:1788838242.513686:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838242.513705:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3643:x1875729135119872:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838242.513711:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1788838242.513741:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135119872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838242.513750:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135119744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838242.514607:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838243.391434:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838244.413147:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838245.246635:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838245.246661:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135120000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838245.246738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838245.246788:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135120128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838245.246838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838245.246841:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135120384:0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.246859:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135120640:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.246880:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838245.246908:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135120896:0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.246909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838245.246936:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135121152:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.246942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838245.246967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838245.246979:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135121408:0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.246992:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135121664:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.247024:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838245.247029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838245.247060:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788838245.247061:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788838245.247075:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135120512:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.247075:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135120256:0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.247097:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838245.247116:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135121024:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.247128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838245.247142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838245.247167:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135120768:0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.247170:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135121536:0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.247208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838245.247216:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838245.247241:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135121280:0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.247250:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135121152 00000100:00100000:2.0:1788838245.247259:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135121152 00000100:00100000:0.0:1788838245.247266:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838245.247296:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135120000 00000100:00100000:0.0:1788838245.247301:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135120000 00000100:00100000:2.0:1788838245.247312:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135121408 00000100:00100000:2.0:1788838245.247317:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135121408 00000100:00100000:0.0:1788838245.247333:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135120896 00000100:00100000:0.0:1788838245.247338:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135120896 00000100:00100000:2.0:1788838245.247364:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135121024 00000100:00100000:2.0:1788838245.247369:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135121024 00000100:00100000:0.0:1788838245.247383:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4187 00000100:00100000:0.0:1788838245.247394:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135120000:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838245.247397:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135121536 00000100:00100000:2.0:1788838245.247402:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135121536 00000100:00100000:2.0:1788838245.247424:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653 00000004:00000024:0.0:1788838245.247431:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445441536 avail 1299202048 00000100:00100000:2.0:1788838245.247433:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135121152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.247492:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135121152:12345-0@lo:400:kworker.0 Request processed in 60us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.247495:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135120000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838245.247504:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653 00000100:00100000:0.0:1788838245.247509:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4187 00000100:00100000:2.0:1788838245.247528:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1788838245.247535:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4188 00000100:00100000:2.0:1788838245.247538:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135121408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.247548:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3644:x1875729135120896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.247598:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135121408:12345-0@lo:400:kworker.0 Request processed in 62us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.247602:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3644:x1875729135120896:12345-0@lo:400:kworker.0 Request processed in 56us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838245.247609:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1788838245.247616:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4188 00000100:00100000:2.0:1788838245.247630:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:2.0:1788838245.247641:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135121024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.247643:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135120384 00000100:00100000:0.0:1788838245.247648:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135120384 00000100:00100000:0.0:1788838245.247675:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135120640 00000100:00100000:2.0:1788838245.247677:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135121024:12345-0@lo:400:kworker.0 Request processed in 39us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.247679:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135120640 00000100:00100000:2.0:1788838245.247687:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1788838245.247697:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135121664 00000100:00100000:0.0:1788838245.247701:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135121664 00000100:00100000:2.0:1788838245.247706:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:2.0:1788838245.247716:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135121536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.247717:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135120512 00000100:00100000:0.0:1788838245.247728:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135120512 00000100:00100000:2.0:1788838245.247747:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135121536:12345-0@lo:400:kworker.0 Request processed in 32us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.247747:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135120768 00000100:00100000:0.0:1788838245.247752:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135120768 00000100:00100000:2.0:1788838245.247757:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:0.0:1788838245.247773:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135121280 00000100:00100000:0.0:1788838245.247777:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135121280 00000100:00100000:2.0:1788838245.247793:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1788838245.247826:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135120384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.247854:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135120384:12345-0@lo:400:kworker.0 Request processed in 31us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838245.253259:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135120128 00000100:00100000:1.0:1788838245.253268:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135120128 00000100:00100000:1.0:1788838245.253318:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:1.0:1788838245.253327:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135120128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838245.253384:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838245.253458:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135120128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (6620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838245.253466:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00100000:0.0:1788838245.254098:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1788838245.254114:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135120640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.254170:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135120640:12345-0@lo:400:kworker.0 Request processed in 62us (7262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.254177:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1788838245.254201:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1788838245.254208:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135121664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.254238:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135121664:12345-0@lo:400:kworker.0 Request processed in 31us (7211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.254244:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1788838245.254255:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1788838245.254262:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135120512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.254292:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135120512:12345-0@lo:400:kworker.0 Request processed in 30us (7194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.254298:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1788838245.254309:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1788838245.254314:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135120768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.254339:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135120768:12345-0@lo:400:kworker.0 Request processed in 25us (7136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.254345:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1788838245.254354:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1788838245.254373:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135121280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.254411:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135121280:12345-0@lo:400:kworker.0 Request processed in 39us (7146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.254418:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1788838245.254464:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135120256 00000100:00100000:0.0:1788838245.254470:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135120256 00000100:00100000:0.0:1788838245.254503:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788838245.254509:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135120256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.254538:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135120256:12345-0@lo:400:kworker.0 Request processed in 29us (7411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.254544:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788838245.254786:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135121792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838245.256580:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838245.256648:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135121792 00000100:00100000:0.0:1788838245.256656:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135121792 00000100:00100000:0.0:1788838245.256846:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4189 00000100:00100000:0.0:1788838245.256855:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3643:x1875729135121792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838245.256889:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:0.0:1788838245.256936:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3643:x1875729135121792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.256942:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4189 00000100:00100000:0.0:1788838245.258710:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135121792:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788838245.259266:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838245.259273:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838245.259277:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838245.259280:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838245.259320:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135120512:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259353:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135121024:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135121536:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259477:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135121664:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259492:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135120128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838245.259503:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135120640:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259515:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135121152:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259528:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135120000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838245.259605:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135120256:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259617:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135120768:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259629:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135121280:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259640:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135120384:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259649:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135120896:0@lo:400:kworker.0 00000100:00100000:0.0:1788838245.259659:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135121408:0@lo:400:kworker.0 00000100:00100000:2.0:1788838245.261316:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00010000:00010000:2.0:1788838245.439433:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838245.758187:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838245.758210:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135121920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838245.758278:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838245.760573:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135121920 00000100:00100000:3.0:1788838245.760590:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135121920 00000100:00100000:3.0:1788838245.760654:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1788838245.760665:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135121920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838245.760697:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838245.760888:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135121920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 225us (2609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838245.760897:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1788838245.760959:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135121920:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788838245.763206:0:92470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00010000:00010000:2.0:1788838245.763228:0:75678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x88da08396ccc99c7 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838245.763243:0:75678:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x88da08396ccc99c7 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763282:0:75678:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc99c7 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763295:0:75678:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838245.763327:0:75678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff60148fc00/0x88da08396ccc99c0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc99c7 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788838245.763344:0:75678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411457 is committed 00000004:00080000:2.0:1788838245.763373:0:75678:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 2 committed 00010000:00010000:2.0:1788838245.763409:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763417:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763423:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763429:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838245.763433:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763439:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763451:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xb1bed465 (ffff8ff6055e2900) 00010000:00010000:2.0:1788838245.763453:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838245.763457:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763463:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff503f10a00/0x88da08396ccc9719 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763490:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763495:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763501:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763507:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838245.763510:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763516:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763653:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xb1bed465 (ffff8ff6055e2900) 00010000:00010000:2.0:1788838245.763656:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838245.763660:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763667:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626400/0x88da08396ccc9988 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838245.763676:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1788838245.763688:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763697:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763704:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838245.763706:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135122048:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1788838245.763776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788838245.763821:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148f600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838245.763824:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763948:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763958:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xd:0x0].0xf7117594 (ffff8ff612676b00) 00010000:00010000:2.0:1788838245.763960:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838245.763963:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.763968:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff60148f600/0x88da08396ccc99a4 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xd:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838245.764347:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135122048 00000100:00100000:2.0:1788838245.764434:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135122176:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1788838245.764473:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838245.764512:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135122176 00000100:00100000:2.0:1788838245.764595:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135122176 00000100:00100000:2.0:1788838245.764643:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5976 00000100:00100000:2.0:1788838245.764651:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135122176:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1788838245.764676:0:26218:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:1538 count 1 00010000:00010000:2.0:1788838245.764699:0:26218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838245.764996:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135122048 00000100:00100000:0.0:1788838245.765036:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1788838245.765044:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3646:x1875729135122048:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1788838245.765064:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838245.765084:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc99c7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc99c0 expref: 8 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838245.765098:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8ff608f3c100) 00010000:00010000:0.0:1788838245.765107:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838245.765150:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135122048:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 106us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.765156:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00010000:00010000:2.0:1788838245.765446:0:26218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 6 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.765469:0:26218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x602:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1788838245.765474:0:26218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788838245.765478:0:26218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.765508:0:26218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 6 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.765600:0:26218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 6 pid: 26212 timeout: 3739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838245.765616:0:26218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:26218:1875729135122304:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788838245.765690:0:26218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff605757cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838245.765968:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135122048:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1788838245.772670:0:26218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:26218:1875729135122304:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788838245.772681:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:3.0:1788838245.772728:0:26218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838245.773219:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116454272 00000100:00100000:0.0:1788838245.773228:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116454272 00010000:00010000:0.0:1788838245.773287:0:6533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 7 pid: 26212 timeout: 3739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788838245.773312:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838245.773318:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2553 00000100:00100000:0.0:1788838245.773328:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116454272:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838245.773341:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838245.773346:0:6533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 7 pid: 26212 timeout: 3739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838245.773371:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 7 pid: 26212 timeout: 3739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838245.773395:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8a0e6b1/0x88da08396ccc98fc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce90 expref: 7 pid: 26212 timeout: 3739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838245.773424:0:6533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788838245.773428:0:6533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788838245.773432:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838245.773441:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838245.773469:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838245.773516:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2404:x1875729116454272:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 189us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838245.773523:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2553 00010000:00010000:2.0:1788838245.773826:0:26218:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.773850:0:26218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.773860:0:26218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.773881:0:26218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.773902:0:26218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788838245.774091:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+6:3646:x1875729135122176:12345-0@lo:6:osp-syn-1-1.0 Request processed in 9439us (9615us total) trans 4294969455 rc 0/0 00000100:00100000:2.0:1788838245.774101:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5976 00010000:00010000:2.0:1788838245.774126:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838245.774133:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.774142:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838245.774146:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.774157:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.774175:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.774183:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4ce354d/0x88da08396ccc99e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838245.774208:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838245.774217:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838245.774219:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788838245.774274:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ff50f38dc00/2, rc 0, transno 4294969455 00000100:00100000:2.0:1788838245.774281:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135122176:0@lo:6:osp-syn-1-1.0 00000001:00080000:1.0:1788838245.774632:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969455 is committed 00000001:00100000:1.0:1788838245.778129:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000001:00080000:1.0:1788838245.778144:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969454 is committed 00010000:00010000:0.0:1788838246.461101:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838246.468881:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838246.468921:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838246.468946:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838246.468972:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116454656 00000100:00100000:0.0:1788838246.468982:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116454656 00000100:00100000:0.0:1788838246.469034:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116454528 00000100:00100000:0.0:1788838246.469038:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116454528 00000100:00100000:0.0:1788838246.469080:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1345 00000100:00100000:0.0:1788838246.469090:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2405:x1875729116454656:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838246.469163:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2405:x1875729116454656:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838246.469170:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1345 00000100:00100000:0.0:1788838246.469198:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1346 00000100:00100000:0.0:1788838246.469205:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2405:x1875729116454528:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838246.469379:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2405:x1875729116454528:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 173us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838246.469386:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1346 00000100:00080000:0.0:1788838246.469410:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838246.469414:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838246.469642:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116454400 00000100:00100000:1.0:1788838246.469646:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116454400 00000100:00100000:1.0:1788838246.469685:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:1.0:1788838246.469703:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6049b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116454400:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838246.469737:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6049b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116454400:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 46us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838246.469745:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:3.0:1788838246.781484:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135122432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838246.781563:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838246.782249:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838246.782260:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135122560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838246.782294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838246.782680:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135122432 00000100:00100000:0.0:1788838246.782689:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135122432 00000100:00100000:0.0:1788838246.782737:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135122560 00000100:00100000:0.0:1788838246.782741:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135122560 00000100:00100000:0.0:1788838246.782766:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:0.0:1788838246.782775:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135122432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838246.782820:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838246.782870:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135122432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838246.782877:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:0.0:1788838246.782903:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:0.0:1788838246.782910:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135122560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838246.782920:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838246.782952:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135122560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838246.782957:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1788838246.783735:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135122560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838246.783763:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135122432:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788838247.485100:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838248.509084:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838249.533661:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838250.365175:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135122688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838250.365256:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365290:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135123200:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365343:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365361:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135123712:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365400:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135124224:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365418:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365441:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788838250.365447:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135122816:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365474:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365500:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135123328:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365537:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135123840:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365571:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135124352:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365590:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365617:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135122944:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365639:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365654:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135123456:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365676:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365691:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135123968:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365712:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365729:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788838250.365734:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135123072:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.365754:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.365770:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135123584:0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.366000:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135123200 00000100:00100000:3.0:1788838250.366008:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135123200 00000100:00100000:3.0:1788838250.366059:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135123328 00000100:00100000:3.0:1788838250.366062:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135123328 00000100:00100000:3.0:1788838250.366077:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135123840 00000100:00100000:3.0:1788838250.366080:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135123840 00000100:00100000:3.0:1788838250.366092:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135124352 00000100:00100000:3.0:1788838250.366094:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135124352 00000100:00100000:3.0:1788838250.366103:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135122944 00000100:00100000:3.0:1788838250.366106:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135122944 00000100:00100000:3.0:1788838250.366117:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135123072 00000100:00100000:3.0:1788838250.366119:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135123072 00000100:00100000:3.0:1788838250.366133:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:3.0:1788838250.366140:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135123200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.366193:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135123200:12345-0@lo:400:kworker.0 Request processed in 53us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.366210:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:3.0:1788838250.366234:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1788838250.366241:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135123328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.366270:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135123328:12345-0@lo:400:kworker.0 Request processed in 30us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.366276:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1788838250.366287:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1788838250.366292:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135123840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.366318:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135123840:12345-0@lo:400:kworker.0 Request processed in 25us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.366333:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1788838250.366345:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1788838250.366350:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135124352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.366376:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135124352:12345-0@lo:400:kworker.0 Request processed in 26us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.366382:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1788838250.366393:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1788838250.366398:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135122944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.366422:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135122944:12345-0@lo:400:kworker.0 Request processed in 24us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.366427:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1788838250.366438:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1788838250.366444:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135123072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.366468:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135123072:12345-0@lo:400:kworker.0 Request processed in 25us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.366473:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1788838250.366535:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135122816 00000100:00100000:3.0:1788838250.366539:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135122816 00000100:00100000:3.0:1788838250.366563:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788838250.366569:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6049b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135122816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.366596:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6049b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135122816:12345-0@lo:400:kworker.0 Request processed in 28us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.366601:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788838250.366627:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135123712 00000100:00100000:3.0:1788838250.366630:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135123712 00000100:00100000:3.0:1788838250.366654:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135124224 00000100:00100000:3.0:1788838250.366657:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135124224 00000100:00100000:3.0:1788838250.366673:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:3.0:1788838250.366677:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135123712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.366702:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3645:x1875729135123712:12345-0@lo:400:kworker.0 Request processed in 25us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.366707:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:3.0:1788838250.366716:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:3.0:1788838250.366720:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135124224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.366742:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135124224:12345-0@lo:400:kworker.0 Request processed in 22us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.366748:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:3.0:1788838250.366766:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135122688 00000100:00100000:3.0:1788838250.366770:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135122688 00000100:00100000:3.0:1788838250.366793:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:0.0:1788838250.368130:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.368178:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135124096:0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.368311:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135122688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838250.368354:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838250.368719:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135122688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 416us (3461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.368738:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:3.0:1788838250.368770:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135124608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838250.368823:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838250.368846:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838250.368853:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135124480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838250.368875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838250.368912:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135123584 00000100:00100000:3.0:1788838250.368918:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135123584 00000100:00100000:3.0:1788838250.368952:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1788838250.368959:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135123584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.368989:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135123584:12345-0@lo:400:kworker.0 Request processed in 31us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.368995:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00080000:3.0:1788838250.369041:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838250.369044:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838250.369047:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838250.369049:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838250.369063:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135123456 00000100:00100000:3.0:1788838250.369067:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135123456 00000100:00100000:3.0:1788838250.369083:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135123968 00000100:00100000:3.0:1788838250.369086:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135123968 00000100:00100000:3.0:1788838250.369097:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135124608 00000100:00100000:3.0:1788838250.369099:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135124608 00000100:00100000:3.0:1788838250.369108:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135124480 00000100:00100000:3.0:1788838250.369110:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135124480 00000100:00100000:3.0:1788838250.369121:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4190 00000100:00100000:3.0:1788838250.369127:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3643:x1875729135123456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.369159:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3643:x1875729135123456:12345-0@lo:400:kworker.0 Request processed in 31us (3482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.369174:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4190 00000100:00100000:3.0:1788838250.369186:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4191 00000100:00100000:3.0:1788838250.369192:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135123968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.369298:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135123968:12345-0@lo:400:kworker.0 Request processed in 106us (3584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.369305:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4191 00000100:00100000:3.0:1788838250.369316:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4192 00000100:00100000:3.0:1788838250.369330:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135124608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838250.369351:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838250.369384:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135124608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.369391:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4192 00000100:00100000:3.0:1788838250.369403:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4193 00000100:00100000:3.0:1788838250.369409:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135124480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838250.369423:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445081088 avail 1298841600 00000100:00100000:3.0:1788838250.369451:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135124480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838250.369457:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4193 00000100:00100000:3.0:1788838250.369497:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:3.0:1788838250.369503:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000004:00080000:3.0:1788838250.369533:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000020:00080000:3.0:1788838250.369538:0:3644:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8ff503476180 refcount 2 committed 0 result 0 batchid 73014444094 00000020:00080000:3.0:1788838250.369542:0:3644:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ff632990900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8ff503476600 00000020:00080000:3.0:1788838250.369546:0:3644:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].5 00000020:00080000:3.0:1788838250.369554:0:3644:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ff632990700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ff627d9ae00 00000020:00080000:3.0:1788838250.369557:0:3644:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].6 00000100:00100000:3.0:1788838250.369583:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135124480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838250.369599:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135124608:0@lo:41:osp-pre-1-0.0 00000020:00080000:3.0:1788838250.369618:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444094 committed batchid 73014444093 00000020:00080000:3.0:1788838250.369678:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444093 00000100:00100000:3.0:1788838250.369699:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135122816:0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.369711:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135123328:0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.369722:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135123840:0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.369734:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135124352:0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.369744:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:3.0:1788838250.369758:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135122688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838250.369770:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135123200:0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.369782:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135123712:0@lo:400:kworker.0 00000100:00100000:3.0:1788838250.369791:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135124224:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.384599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838250.384741:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135124096 00000100:00100000:0.0:1788838250.384751:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135124096 00000100:00100000:0.0:1788838250.384838:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:0.0:1788838250.384849:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135124096:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788838250.384856:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838250.384916:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135124096:12345-0@lo:400:kworker.0 Request processed in 70us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838250.384923:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:0.0:1788838250.384965:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 2 00000100:00100000:0.0:1788838250.384982:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135124096:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.384999:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135122944:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.385011:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135123456:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.385023:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135123968:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.385053:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135123072:0@lo:400:kworker.0 00000100:00100000:0.0:1788838250.385065:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135123584:0@lo:400:kworker.0 00000001:02000400:3.0:1788838250.470340:0:93054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 23:30:49 (1788838249) 00010000:00010000:0.0:1788838250.560076:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838250.879723:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135124736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838250.879828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838250.879928:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135124736 00000100:00100000:1.0:1788838250.879937:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135124736 00000100:00100000:1.0:1788838250.879992:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:1.0:1788838250.880003:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135124736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838250.880031:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838250.880078:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135124736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838250.880085:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1788838250.880440:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135124736:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788838251.526988:0:93103:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe470fd870 20000000:00000080:3.0:1788838251.527021:0:93103:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8ff503696000 uarg=0000000000000000 00000040:00100000:3.0:1788838251.527660:0:93103:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 49 00000040:00100000:3.0:1788838251.527670:0:93103:0:(llog.c:1072:llog_reverse_process()) index 47 : idx 1 00000040:00080000:3.0:1788838251.527917:0:93103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:3.0:1788838251.527941:0:93103:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1788838251.527960:0:93103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:3.0:1788838251.527976:0:93103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:3.0:1788838251.528047:0:93103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:3.0:1788838251.528056:0:93103:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1788838251.528071:0:93103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:3.0:1788838251.528296:0:93103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:3.0:1788838251.528787:0:93103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:3.0:1788838251.528937:0:93103:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1788838251.528962:0:93103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:3.0:1788838251.529086:0:93103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:3.0:1788838251.529105:0:93103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788838251.529134:0:93103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529161:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50712da00/0x88da08396ccc94db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce66 expref: 9 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529171:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50b8e5200/0x88da08396ccc94e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce74 expref: 9 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529181:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50712c200/0x88da08396ccc9521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc951a expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529188:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50b8e4600/0x88da08396ccc95f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc95ec expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529196:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50b8e5600/0x88da08396ccc962b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9624 expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529210:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff5059a4200/0x88da08396ccc9647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9640 expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529217:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc9671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc966a expref: 23 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529224:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc967f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9678 expref: 23 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529230:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc969b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9694 expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529237:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc96a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc96a2 expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529244:0:93103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff600030200/0x88da08396ccc96d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc96cc expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529252:0:93103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529311:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff600030200/0x88da08396ccc96d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc96cc expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529344:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff600030200/0x88da08396ccc96d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc96cc expref: 23 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.529362:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135124864:0@lo:104: 00000100:00100000:3.0:1788838251.529458:0:93103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838251.529535:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc96a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc96a2 expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529544:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc96a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc96a2 expref: 23 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.529553:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135124992:0@lo:104: 00000100:00100000:3.0:1788838251.529579:0:93103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838251.529622:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc969b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9694 expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529629:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc969b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9694 expref: 23 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.529637:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125120:0@lo:104: 00010000:00010000:3.0:1788838251.529664:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc967f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9678 expref: 23 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529671:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc967f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9678 expref: 23 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.529678:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125248:0@lo:104: 00010000:00010000:3.0:1788838251.529703:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc9671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc966a expref: 23 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529711:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc9671 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc966a expref: 23 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.529719:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125376:0@lo:104: 00010000:00010000:3.0:1788838251.529743:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff5059a4200/0x88da08396ccc9647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9640 expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529757:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff5059a4200/0x88da08396ccc9647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9640 expref: 23 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.529766:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125504:0@lo:104: 00010000:00010000:3.0:1788838251.529791:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50b8e5600/0x88da08396ccc962b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9624 expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529834:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50b8e5600/0x88da08396ccc962b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9624 expref: 23 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.529842:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125632:0@lo:104: 00010000:00010000:3.0:1788838251.529869:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50b8e4600/0x88da08396ccc95f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc95ec expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529877:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50b8e4600/0x88da08396ccc95f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc95ec expref: 23 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.529885:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125760:0@lo:104: 00010000:00010000:3.0:1788838251.529903:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50712c200/0x88da08396ccc9521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc951a expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529910:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50712c200/0x88da08396ccc9521 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc951a expref: 23 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.529918:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125888:0@lo:104: 00010000:00010000:3.0:1788838251.529940:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50b8e5200/0x88da08396ccc94e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce74 expref: 9 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.529960:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50b8e5200/0x88da08396ccc94e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce74 expref: 9 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.529970:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135126016:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788838251.530037:0:93103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50712da00/0x88da08396ccc94db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce66 expref: 9 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.530046:0:93103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50712da00/0x88da08396ccc94db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce66 expref: 9 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.530055:0:93103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135126144:192.168.203.30@tcp:104: 00000100:00100000:3.0:1788838251.530079:0:93103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838251.530190:0:6529:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788838251.530215:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.530244:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.530253:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.530261:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.530269:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.530277:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.530286:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.530295:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135124864 00000100:00100000:1.0:1788838251.530304:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135124864 00000100:00100000:1.0:1788838251.530375:0:6529:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:1.0:1788838251.530382:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135124992 00000100:00100000:1.0:1788838251.530384:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135124992 00000100:00100000:1.0:1788838251.530396:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135125120 00000100:00100000:1.0:1788838251.530398:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135125120 00000100:00100000:1.0:1788838251.530407:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135125248 00000100:00100000:1.0:1788838251.530409:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135125248 00000100:00100000:1.0:1788838251.530418:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135125376 00000100:00100000:1.0:1788838251.530420:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135125376 00000100:00100000:1.0:1788838251.530429:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135125504 00000100:00100000:1.0:1788838251.530433:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135125504 00000100:00100000:1.0:1788838251.530442:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135125632 00000100:00100000:1.0:1788838251.530445:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135125632 00000100:00100000:1.0:1788838251.530454:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135125760 00000100:00100000:1.0:1788838251.530456:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135125760 00000100:00100000:1.0:1788838251.530464:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135125888 00000100:00100000:1.0:1788838251.530466:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135125888 00000100:00100000:1.0:1788838251.530479:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788838251.530488:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:93103:x1875729135124864:12345-0@lo:104: 00010000:00010000:1.0:1788838251.530504:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.530568:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788838251.530582:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:93103:x1875729135124864:12345-0@lo:104: Request processed in 96us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.530590:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788838251.530609:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788838251.530615:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:93103:x1875729135124992:12345-0@lo:104: 00010000:00010000:1.0:1788838251.530624:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.530660:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788838251.530665:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+10:93103:x1875729135124992:12345-0@lo:104: Request processed in 51us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.530671:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788838251.530764:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788838251.530772:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:93103:x1875729135125120:12345-0@lo:104: 00010000:00010000:1.0:1788838251.530780:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.530848:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788838251.530854:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:93103:x1875729135125120:12345-0@lo:104: Request processed in 84us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.530860:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788838251.530871:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788838251.530877:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:93103:x1875729135125248:12345-0@lo:104: 00010000:00010000:1.0:1788838251.530884:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.530913:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788838251.530923:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:93103:x1875729135125248:12345-0@lo:104: Request processed in 46us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.530928:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788838251.530939:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788838251.530944:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93103:x1875729135125376:12345-0@lo:104: 00010000:00010000:1.0:1788838251.530952:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.530975:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788838251.530979:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93103:x1875729135125376:12345-0@lo:104: Request processed in 36us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.530985:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788838251.530994:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788838251.530998:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+6:93103:x1875729135125504:12345-0@lo:104: 00010000:00010000:1.0:1788838251.531005:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531029:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788838251.531033:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+6:93103:x1875729135125504:12345-0@lo:104: Request processed in 35us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.531039:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788838251.531049:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788838251.531055:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:93103:x1875729135125632:12345-0@lo:104: 00010000:00010000:1.0:1788838251.531063:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531087:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788838251.531097:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:93103:x1875729135125632:12345-0@lo:104: Request processed in 42us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.531103:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788838251.531115:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788838251.531121:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+4:93103:x1875729135125760:12345-0@lo:104: 00010000:00010000:1.0:1788838251.531129:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531153:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1788838251.531158:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+4:93103:x1875729135125760:12345-0@lo:104: Request processed in 38us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.531163:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788838251.531172:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788838251.531177:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a3cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+3:93103:x1875729135125888:12345-0@lo:104: 00010000:00010000:1.0:1788838251.531184:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531207:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1788838251.531211:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a3cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+3:93103:x1875729135125888:12345-0@lo:104: Request processed in 36us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.531217:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00010000:1.0:1788838251.531248:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788838251.531256:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531264:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e5a00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838251.531270:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531289:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838251.531298:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838251.531305:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838251.531356:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531364:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838251.531389:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531396:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5a00/0x88da08396ccc96cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc96d3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531412:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788838251.531415:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531421:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712dc00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838251.531424:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531430:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838251.531436:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838251.531446:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838251.531459:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531465:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838251.531490:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531498:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712dc00/0x88da08396ccc96a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc96a9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531508:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788838251.531511:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531516:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838251.531519:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531526:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838251.531531:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838251.531537:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838251.531548:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531554:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838251.531567:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531572:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5400/0x88da08396ccc9694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc969b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531583:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788838251.531586:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531592:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4c00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838251.531594:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531601:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838251.531608:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838251.531613:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838251.531625:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531631:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838251.531637:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531644:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4c00/0x88da08396ccc9678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc967f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531651:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788838251.531659:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531664:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838251.531667:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531673:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838251.531679:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838251.531683:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838251.531694:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531699:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838251.531703:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531709:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff600031600/0x88da08396ccc966a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9671 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531720:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788838251.531723:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531728:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838251.531731:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531747:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838251.531753:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838251.531759:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838251.531772:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531778:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838251.531783:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531789:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712c400/0x88da08396ccc9640 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9647 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531825:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838251.531829:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531835:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712cc00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838251.531837:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531843:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838251.531849:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838251.531859:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838251.531871:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531876:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838251.531881:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531886:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396ccc9624 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc962b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531894:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838251.531897:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531901:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50b8e4800 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838251.531904:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531909:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838251.531915:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838251.531919:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838251.531929:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531934:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838251.531944:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531950:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4800/0x88da08396ccc95ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc95f3 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531958:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838251.531961:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531966:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838251.531969:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.531975:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838251.531980:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838251.531986:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838251.531998:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.532005:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838251.532009:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.532015:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712d400/0x88da08396ccc951a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9521 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.532041:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838251.532043:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838251.532046:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838251.532060:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838251.532067:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838251.532073:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838251.532103:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135126272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.532163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.532200:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135126784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.532220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.532238:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135127296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.532260:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.532283:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788838251.532289:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135126656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.532310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.532342:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135127168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.532363:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.532394:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135126528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.532416:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.532433:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135127040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.532453:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.532465:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788838251.532470:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135126400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.532489:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.532508:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135126912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.532528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838251.532557:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135126272 00000100:00100000:1.0:1788838251.532564:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135126272 00010000:00010000:1.0:1788838251.532599:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff600030200/0x88da08396ccc96d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc96cc expref: 24 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.532620:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135126784 00000100:00100000:1.0:1788838251.532623:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135126784 00010000:00010000:1.0:1788838251.532634:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc9671 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc966a expref: 25 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.532644:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135127296 00000100:00100000:1.0:1788838251.532646:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135127296 00010000:00010000:1.0:1788838251.532655:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50712c200/0x88da08396ccc9521 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc951a expref: 26 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.532666:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135126656 00000100:00100000:1.0:1788838251.532669:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135126656 00010000:00010000:1.0:1788838251.532678:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc967f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9678 expref: 27 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.532686:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135127168 00000100:00100000:1.0:1788838251.532688:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135127168 00010000:00010000:1.0:1788838251.532697:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50b8e4600/0x88da08396ccc95f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc95ec expref: 28 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.532706:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135126528 00000100:00100000:1.0:1788838251.532708:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135126528 00010000:00010000:1.0:1788838251.532716:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc969b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9694 expref: 29 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.532725:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135127040 00000100:00100000:1.0:1788838251.532733:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135127040 00010000:00010000:1.0:1788838251.532745:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50b8e5600/0x88da08396ccc962b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9624 expref: 30 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.532756:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135126400 00000100:00100000:1.0:1788838251.532758:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135126400 00010000:00010000:1.0:1788838251.532767:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc96a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc96a2 expref: 31 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.532775:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135126912 00000100:00100000:1.0:1788838251.532777:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135126912 00010000:00010000:1.0:1788838251.532784:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff5059a4200/0x88da08396ccc9647 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9640 expref: 32 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.532824:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:1.0:1788838251.532832:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+32:3646:x1875729135126272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838251.532847:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838251.532853:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff600030200/0x88da08396ccc96d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc96cc expref: 32 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.532865:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff600030200/0x88da08396ccc96d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc96cc expref: 32 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.532887:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838251.532927:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+32:3646:x1875729135126272:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.532935:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:1.0:1788838251.532951:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1788838251.532957:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+31:3646:x1875729135126784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838251.532964:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838251.532974:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc9671 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc966a expref: 31 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.532982:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc9671 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc966a expref: 31 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.532992:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838251.533014:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+31:3646:x1875729135126784:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.533020:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1788838251.533033:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1788838251.533039:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+30:3646:x1875729135127296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838251.533046:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838251.533050:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50712c200/0x88da08396ccc9521 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc951a expref: 30 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.533058:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50712c200/0x88da08396ccc9521 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc951a expref: 30 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.533066:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838251.533086:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+30:3646:x1875729135127296:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.533091:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1788838251.533130:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1788838251.533136:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+29:3646:x1875729135126656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838251.533143:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838251.533148:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc967f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9678 expref: 29 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.533167:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc967f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9678 expref: 29 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.533178:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838251.533200:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+29:3646:x1875729135126656:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.533206:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1788838251.533218:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:1.0:1788838251.533224:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+28:3646:x1875729135127168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838251.533231:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838251.533235:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50b8e4600/0x88da08396ccc95f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc95ec expref: 28 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.533243:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50b8e4600/0x88da08396ccc95f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc95ec expref: 28 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.533252:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838251.533273:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+28:3646:x1875729135127168:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.533279:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:1.0:1788838251.533290:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1788838251.533297:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+27:3644:x1875729135126528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838251.533303:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838251.533307:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc969b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9694 expref: 27 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.533552:0:93103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600030200/0x88da08396ccc96d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc96cc expref: 27 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.533570:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135124864:0@lo:104: 00000100:00100000:3.0:1788838251.533583:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135124992:0@lo:104: 00000100:00100000:3.0:1788838251.533593:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125120:0@lo:104: 00010000:00010000:3.0:1788838251.533602:0:93103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4e00/0x88da08396ccc967f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9678 expref: 26 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.533612:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125248:0@lo:104: 00010000:00010000:3.0:1788838251.533623:0:93103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4600/0x88da08396ccc9671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc966a expref: 25 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.533631:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125376:0@lo:104: 00000100:00100000:3.0:1788838251.533655:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125504:0@lo:104: 00000100:00100000:3.0:1788838251.533664:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125632:0@lo:104: 00010000:00010000:3.0:1788838251.533673:0:93103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50b8e4600/0x88da08396ccc95f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc95ec expref: 24 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.533682:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125760:0@lo:104: 00010000:00010000:3.0:1788838251.533691:0:93103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712c200/0x88da08396ccc9521 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc951a expref: 23 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.533703:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135125888:0@lo:104: 00000100:00100000:0.0:1788838251.534646:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:0.0:1788838251.534784:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3644:x1875729135127040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838251.534829:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838251.534838:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50b8e5600/0x88da08396ccc962b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9624 expref: 22 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838251.534864:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50b8e5600/0x88da08396ccc962b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9624 expref: 22 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838251.534882:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50b8e5600/0x88da08396ccc962b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9624 expref: 22 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838251.534897:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838251.534974:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3644:x1875729135127040:12345-0@lo:103:ldlm_bl.0 Request processed in 315us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838251.534980:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1788838251.535027:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135127040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838251.535172:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:0.0:1788838251.535180:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3644:x1875729135126400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838251.535422:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838251.535427:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc96a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc96a2 expref: 20 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838251.535439:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc96a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc96a2 expref: 20 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838251.535450:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4400/0x88da08396ccc96a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc96a2 expref: 20 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838251.535461:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838251.535627:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:3644:x1875729135126400:12345-0@lo:103:ldlm_bl.0 Request processed in 448us (3136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838251.535636:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:0.0:1788838251.535658:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1788838251.535661:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135126400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838251.535820:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:3644:x1875729135126912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838251.535842:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838251.535847:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff5059a4200/0x88da08396ccc9647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9640 expref: 18 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838251.535856:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff5059a4200/0x88da08396ccc9647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9640 expref: 18 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838251.535867:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4200/0x88da08396ccc9647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9640 expref: 18 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838251.535876:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838251.535918:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:3644:x1875729135126912:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (3387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838251.535924:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00010000:00010000:1.0:1788838251.536155:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc969b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9694 expref: 16 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.536176:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc969b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9694 expref: 16 pid: 92475 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.536338:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838251.536422:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+15:3644:x1875729135126528:12345-0@lo:103:ldlm_bl.0 Request processed in 3126us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838251.536428:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1788838251.536458:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135126656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.536465:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135127168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.536472:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135126272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.536478:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135126784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838251.536483:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135127296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838251.537587:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135126912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838251.537606:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135126528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838251.555932:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135126016:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788838251.557774:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838251.557907:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838251.558007:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116454912 00000100:00100000:2.0:1788838251.558019:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116454912 00010000:00010000:2.0:1788838251.558063:0:6531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50712da00/0x88da08396ccc94db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce66 expref: 10 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838251.558108:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116454784 00000100:00100000:2.0:1788838251.558111:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116454784 00010000:00010000:2.0:1788838251.558123:0:6531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50b8e5200/0x88da08396ccc94e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce74 expref: 11 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838251.558147:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2563 00000100:00100000:2.0:1788838251.558155:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2af93169-6705-472b-b7ff-fd7cc5c04782+11:2405:x1875729116454912:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838251.558170:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838251.558174:0:6531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50712da00/0x88da08396ccc94db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce66 expref: 11 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838251.558192:0:6531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50712da00/0x88da08396ccc94db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce66 expref: 11 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838251.558214:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838251.558294:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2af93169-6705-472b-b7ff-fd7cc5c04782+11:2405:x1875729116454912:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 138us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838251.558302:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2563 00010000:00010000:3.0:1788838251.558513:0:93103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712da00/0x88da08396ccc94db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce66 expref: 10 pid: 92477 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838251.558531:0:93103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93103:1875729135126144:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788838251.558656:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2564 00000100:00100000:1.0:1788838251.558669:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:2404:x1875729116454784:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838251.558679:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838251.558684:0:6533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50b8e5200/0x88da08396ccc94e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce74 expref: 9 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558696:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50b8e5200/0x88da08396ccc94e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce74 expref: 9 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558709:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50b8e5200/0x88da08396ccc94e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce74 expref: 9 pid: 92476 timeout: 3745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558732:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558740:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558758:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558765:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558773:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558779:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558785:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838251.558790:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558822:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558832:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.558842:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838251.558851:0:93103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838251.558861:0:93103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.558867:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2af93169-6705-472b-b7ff-fd7cc5c04782+8:2404:x1875729116454784:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 203us (960us total) trans 0 rc 0/0 00010000:00010000:3.0:1788838251.558878:0:93103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838251.558879:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2564 00010000:00010000:3.0:1788838251.558885:0:93103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601528600/0x88da08396ccc99ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838251.585161:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838251.585563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838251.585615:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838251.585666:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838251.585831:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116455168 00000100:00100000:0.0:1788838251.585845:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116455168 00000100:00100000:0.0:1788838251.585921:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116455040 00000100:00100000:0.0:1788838251.585925:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116455040 00000100:00100000:0.0:1788838251.585956:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1353 00000100:00100000:0.0:1788838251.585969:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116455168:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838251.586072:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116455168:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 106us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838251.586081:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1353 00000100:00100000:0.0:1788838251.586103:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1354 00000100:00100000:0.0:1788838251.586110:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2407:x1875729116455040:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838251.586137:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2407:x1875729116455040:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838251.586165:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1354 00000100:00100000:0.0:1788838251.586189:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116455296 00000100:00100000:0.0:1788838251.586193:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116455296 00000100:00100000:0.0:1788838251.586226:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2661 00000100:00100000:0.0:1788838251.586233:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116455296:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838251.586270:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116455296:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838251.586276:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2661 00000100:00080000:2.0:1788838251.587157:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838251.587165:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838251.587168:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838251.902012:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135127424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838251.902138:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838251.902199:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838251.902207:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135127552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838251.902224:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135127424 00000100:00100000:1.0:1788838251.902236:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135127424 00000100:00100000:1.0:1788838251.902297:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:1.0:1788838251.902309:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135127424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838251.902361:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838251.902417:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135127424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838251.902518:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838251.902631:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135127424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838251.902666:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135127552 00000100:00100000:2.0:1788838251.902671:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135127552 00000100:00100000:1.0:1788838251.902684:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:2.0:1788838251.902771:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:2.0:1788838251.902780:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135127552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838251.902792:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838251.902858:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875729135127552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838251.902864:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:2.0:1788838251.902897:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135127552:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1788838251.904190:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969455 is committed 00010000:00010000:1.0:1788838252.610743:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838252.799126:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838252.799378:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116455424 00000100:00100000:2.0:1788838252.799392:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116455424 00000100:00100000:2.0:1788838252.799512:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:2.0:1788838252.799525:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6049b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116455424:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838252.799555:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838252.799599:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc99f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cec8 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838252.799639:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc99f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec8 expref: 9 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838252.799655:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc99f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec8 expref: 9 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838252.799667:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8e00, rc 0) 00000100:00100000:2.0:1788838252.799746:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6049b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116455424:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 224us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838252.799753:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:0.0:1788838252.808732:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838252.808854:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116455552 00000100:00100000:2.0:1788838252.808868:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116455552 00000100:00100000:2.0:1788838252.808944:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:2.0:1788838252.808955:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116455552:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838252.809322:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116455552:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 367us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838252.809332:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:0.0:1788838252.822069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838252.822372:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116455680 00000100:00100000:3.0:1788838252.822387:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116455680 00000100:00100000:3.0:1788838252.822463:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:3.0:1788838252.822476:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116455680:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838252.822687:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116455680:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 212us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838252.822696:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:0.0:1788838252.832572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838252.833096:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116455808 00000100:00100000:3.0:1788838252.833110:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116455808 00000100:00100000:3.0:1788838252.833345:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:3.0:1788838252.833361:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:71875:x1875729116455808:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838252.833598:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:71875:x1875729116455808:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 240us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838252.841046:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1788838252.842137:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838252.842353:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116455936 00000100:00100000:0.0:1788838252.842366:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116455936 00000100:00100000:0.0:1788838252.842435:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:0.0:1788838252.842447:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:71875:x1875729116455936:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788838252.842661:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:71875:x1875729116455936:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 215us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838252.842671:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:0.0:1788838252.847358:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838252.847655:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116456064 00000100:00100000:3.0:1788838252.847669:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116456064 00000100:00100000:3.0:1788838252.847741:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:3.0:1788838252.847752:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116456064:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838252.847775:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838252.847876:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601528600/0x88da08396ccc99f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cecf expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838252.847915:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601528600/0x88da08396ccc99f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cecf expref: 10 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838252.847930:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601528600/0x88da08396ccc99f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cecf expref: 10 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838252.847941:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528600, rc 0) 00000100:00100000:3.0:1788838252.848009:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116456064:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 259us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838252.848017:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:1.0:1788838252.852466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838252.852567:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116456192 00000100:00100000:3.0:1788838252.852583:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116456192 00000100:00100000:3.0:1788838252.852655:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:3.0:1788838252.852665:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116456192:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838252.853024:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116456192:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 359us (574us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788838252.853034:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 87 10000000:01000000:1.0:1788838253.373076:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788838253.373087:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff62ceaa000 from 52 10000000:01000000:1.0:1788838253.373094:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838253.373212:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.373227:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.373241:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838253.373275:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135127680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.374792:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838253.375166:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6413f6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838253.376711:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135127680 00000100:00100000:0.0:1788838253.376730:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135127680 00000100:00100000:0.0:1788838253.376849:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788838253.376862:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135127680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838253.376902:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838253.376927:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504626c00/0x88da08396ccc9a06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc99ff expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.376962:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504626c00/0x88da08396ccc9a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc99ff expref: 16 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.376976:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504626c00/0x88da08396ccc9a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc99ff expref: 16 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.376987:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626c00, rc 0) 00000100:00100000:0.0:1788838253.377099:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135127680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.377108:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788838253.377574:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135127680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838253.377604:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.377617:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838253.377726:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135127808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.377783:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.377873:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60820fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.378473:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135127808 00000100:00100000:3.0:1788838253.378484:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135127808 00000100:00100000:3.0:1788838253.378546:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788838253.378556:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135127808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838253.378738:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135127808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.378746:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788838253.380294:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135127808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.380393:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135127936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.380505:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.380565:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60820fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838253.381571:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135127936 00000100:00100000:1.0:1788838253.381585:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135127936 00000100:00100000:1.0:1788838253.381670:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788838253.381682:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135127936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.381931:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135127936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838253.381940:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788838253.384758:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135127936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.386861:0:93104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93104:1875729135128064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838253.386996:0:93104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.387072:0:93104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838253.391593:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135128064 00000100:00100000:0.0:1788838253.391616:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135128064 00000100:00100000:0.0:1788838253.391713:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788838253.391725:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:93104:x1875729135128064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.392023:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:93104:x1875729135128064:12345-0@lo:502:llog_process_th.0 Request processed in 300us (5027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.392032:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788838253.400457:0:93104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93104:1875729135128064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838253.400613:0:93104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93104:1875729135128192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838253.400727:0:93104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.400844:0:93104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.401044:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135128192 00000100:00100000:3.0:1788838253.401053:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135128192 00000100:00100000:3.0:1788838253.401125:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788838253.401138:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:93104:x1875729135128192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838253.401318:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:93104:x1875729135128192:12345-0@lo:502:llog_process_th.0 Request processed in 182us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.401327:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788838253.401439:0:93104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93104:1875729135128192:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788838253.401477:0:93104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:1.0:1788838253.401706:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:1.0:1788838253.401735:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838253.401749:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.401763:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838253.401775:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788838253.401778:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:1.0:1788838253.401781:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788838253.401857:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.401866:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.401876:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838253.401897:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135128320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.401941:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838253.401990:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6413f60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.402116:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135128320 00000100:00100000:3.0:1788838253.402122:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135128320 00000100:00100000:3.0:1788838253.402167:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788838253.402175:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135128320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838253.402187:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838253.402205:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9a0d expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838253.402235:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9a0d expref: 17 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838253.402246:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a0d expref: 17 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838253.402255:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529400, rc 0) 00000100:00100000:3.0:1788838253.402313:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135128320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.402320:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788838253.402437:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135128320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838253.402454:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.402464:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838253.402531:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135128448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.402569:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.402599:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.404885:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135128448 00000100:00100000:3.0:1788838253.404903:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135128448 00000100:00100000:3.0:1788838253.405001:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788838253.405013:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135128448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838253.405275:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135128448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (2704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.405284:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788838253.405515:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135128448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.405589:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135128576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.405651:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.405695:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.406043:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135128576 00000100:00100000:3.0:1788838253.406049:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135128576 00000100:00100000:3.0:1788838253.406130:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788838253.406139:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135128576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838253.406271:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135128576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.406279:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788838253.406363:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135128576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.406747:0:93105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93105:1875729135128704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838253.406868:0:93105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.420680:0:93105:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838253.423724:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135128704 00000100:00100000:1.0:1788838253.423746:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135128704 00000100:00100000:1.0:1788838253.423862:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788838253.423876:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:93105:x1875729135128704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838253.424162:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:93105:x1875729135128704:12345-0@lo:502:llog_process_th.0 Request processed in 288us (17364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838253.424170:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788838253.424369:0:93105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93105:1875729135128704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838253.424439:0:93105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838253.424455:0:93105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838253.424458:0:93105:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1788838253.424464:0:93105:0:(obd_config.c:1472:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1788838253.424547:0:93105:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:2.0:1788838253.425376:0:93105:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:0.0:1788838253.431245:0:93105:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00080000:10000000:0.0:1788838253.433971:0:93105:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000100:00100000:0.0:1788838253.438979:0:93105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93105:1875729135128832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.439646:0:93105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838253.440575:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135128832 00000100:00100000:1.0:1788838253.440590:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135128832 00000100:00100000:1.0:1788838253.440675:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788838253.440687:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:93105:x1875729135128832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838253.440910:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:93105:x1875729135128832:12345-0@lo:502:llog_process_th.0 Request processed in 225us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838253.440920:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788838253.440980:0:93105:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632963000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838253.441016:0:93105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93105:1875729135128832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.441133:0:93105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93105:1875729135128960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.441181:0:93105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.441211:0:93105:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838253.441386:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135128960 00000100:00100000:2.0:1788838253.441393:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135128960 00000100:00100000:2.0:1788838253.441462:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788838253.441471:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:93105:x1875729135128960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838253.441720:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:93105:x1875729135128960:12345-0@lo:502:llog_process_th.0 Request processed in 250us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838253.441728:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788838253.442057:0:93105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93105:1875729135128960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788838253.442171:0:93105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838253.442181:0:93105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838253.442183:0:93105:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:0.0:1788838253.442189:0:93105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:2.0:1788838253.442485:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:2.0:1788838253.442590:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788838253.442602:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.442612:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838253.442621:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788838253.442623:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff503592800 from 52 10000000:01000000:2.0:1788838253.442626:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788838253.442660:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.442666:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.442674:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838253.442689:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.442728:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.442952:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.443043:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135129088 00000100:00100000:3.0:1788838253.443051:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135129088 00000100:00100000:3.0:1788838253.443181:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788838253.443191:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135129088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838253.443206:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838253.443223:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601529000/0x88da08396ccc9a22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9a1b expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838253.443252:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601529000/0x88da08396ccc9a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9a1b expref: 18 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838253.443265:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601529000/0x88da08396ccc9a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a1b expref: 18 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838253.443276:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529000, rc 0) 00000100:00100000:0.0:1788838253.443962:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838253.443993:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.444008:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838253.444117:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.444168:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.444212:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.444271:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135129088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.444310:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788838253.444358:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135129216 00000100:00100000:3.0:1788838253.444616:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135129216 00000100:00100000:3.0:1788838253.444660:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788838253.444669:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135129216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838253.445207:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135129216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 537us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.445217:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788838253.445322:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.445565:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.445632:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.445708:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838253.446030:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135129344 00000100:00100000:2.0:1788838253.446038:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135129344 00000100:00100000:3.0:1788838253.446279:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788838253.446291:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135129344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838253.446458:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135129344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.446467:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788838253.446728:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838253.447769:0:93106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93106:1875729135129472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838253.448016:0:93106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838253.448105:0:93106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788838253.448487:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135129472 00000100:00100000:0.0:1788838253.448565:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135129472 00000100:00100000:0.0:1788838253.448673:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788838253.448685:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:93106:x1875729135129472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.448921:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:93106:x1875729135129472:12345-0@lo:502:llog_process_th.0 Request processed in 237us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.448930:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788838253.449040:0:93106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93106:1875729135129472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838253.449121:0:93106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93106:1875729135129600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838253.449169:0:93106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838253.449298:0:93106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6413f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.449558:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135129600 00000100:00100000:3.0:1788838253.449565:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135129600 00000100:00100000:3.0:1788838253.449601:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788838253.449609:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:93106:x1875729135129600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838253.449721:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:93106:x1875729135129600:12345-0@lo:502:llog_process_th.0 Request processed in 111us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.449729:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788838253.449926:0:93106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93106:1875729135129600:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788838253.449960:0:93106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1788838253.450086:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1788838253.450123:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788838253.450137:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.450152:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838253.450164:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788838253.450168:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1788838253.450171:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788838253.450206:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.450215:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.450225:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838253.450244:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.450285:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.450329:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5025530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838253.450669:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135129728 00000100:00100000:2.0:1788838253.450675:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135129728 00000100:00100000:2.0:1788838253.450724:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788838253.450733:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135129728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838253.450760:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838253.450777:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc9a30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9a29 expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.450840:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc9a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9a29 expref: 19 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.450853:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc9a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a29 expref: 19 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.450864:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9800, rc 0) 00000100:00100000:2.0:1788838253.450924:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135129728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838253.450931:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788838253.452289:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838253.452336:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.452379:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838253.452489:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.452553:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838253.452602:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6413f6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838253.452657:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135129856 00000100:00100000:2.0:1788838253.452665:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135129856 00000100:00100000:2.0:1788838253.452718:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788838253.452728:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135129856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.452948:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135129856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838253.452956:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788838253.453569:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.453627:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.453694:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838253.453731:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6413f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.453885:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135129984 00000100:00100000:3.0:1788838253.453893:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135129984 00000100:00100000:3.0:1788838253.453948:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788838253.453958:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135129984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838253.454088:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135129984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.454096:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788838253.455065:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135129984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.455860:0:93107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93107:1875729135130112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838253.455966:0:93107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838253.456011:0:93107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6413f60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838253.456161:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135130112 00000100:00100000:0.0:1788838253.456170:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135130112 00000100:00100000:0.0:1788838253.456229:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788838253.456253:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:93107:x1875729135130112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838253.457476:0:93107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93107:1875729135130112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788838253.457550:0:93107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788838253.457565:0:93107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838253.457568:0:93107:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:3.0:1788838253.457574:0:93107:0:(obd_config.c:1472:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1788838253.457660:0:93107:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:3.0:1788838253.457699:0:93107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93107:1875729135130240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.457772:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:93107:x1875729135130112:12345-0@lo:502:llog_process_th.0 Request processed in 1521us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.457785:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788838253.460027:0:93107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838253.460125:0:93107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838253.460685:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135130240 00000100:00100000:2.0:1788838253.460696:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135130240 00000100:00100000:2.0:1788838253.460764:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788838253.460775:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:93107:x1875729135130240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838253.461005:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:93107:x1875729135130240:12345-0@lo:502:llog_process_th.0 Request processed in 231us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838253.461026:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788838253.461248:0:93107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93107:1875729135130240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.461352:0:93107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93107:1875729135130368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.461413:0:93107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.461446:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135130368 00000100:00100000:0.0:1788838253.461450:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135130368 00000100:00100000:0.0:1788838253.461476:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788838253.461484:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:93107:x1875729135130368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.461865:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:93107:x1875729135130368:12345-0@lo:502:llog_process_th.0 Request processed in 381us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.461873:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788838253.461922:0:93107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838253.461938:0:93107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93107:1875729135130368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788838253.461968:0:93107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838253.461977:0:93107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838253.461980:0:93107:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:0.0:1788838253.461986:0:93107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:0.0:1788838253.462204:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:0.0:1788838253.462229:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788838253.462242:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.462254:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838253.462273:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788838253.462276:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff63f7ce800 from 52 10000000:01000000:0.0:1788838253.462279:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788838253.462319:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.462327:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.462470:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838253.462502:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135130496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.462543:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.462688:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838253.462709:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135130496 00000100:00100000:0.0:1788838253.462713:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135130496 00000100:00100000:0.0:1788838253.462742:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788838253.462750:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135130496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838253.462762:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838253.462869:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9a3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9a37 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.462902:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9a37 expref: 20 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.462913:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a37 expref: 20 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.462936:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627e00, rc 0) 00000100:00100000:0.0:1788838253.462974:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135130496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.462981:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788838253.463020:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135130496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838253.463035:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.463045:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838253.463268:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135130624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.463298:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.463392:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838253.468299:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135130624 00000100:00100000:2.0:1788838253.468344:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135130624 00000100:00100000:2.0:1788838253.468448:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788838253.468462:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135130624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.468719:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135130624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (5420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838253.468728:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788838253.468930:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135130624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.469011:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135130752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.469098:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.469138:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838253.469159:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135130752 00000100:00100000:0.0:1788838253.469163:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135130752 00000100:00100000:0.0:1788838253.469192:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788838253.469200:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135130752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.469295:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135130752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.469323:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788838253.469367:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135130752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.473738:0:93108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93108:1875729135130880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.473907:0:93108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.473976:0:93108:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788838253.474483:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135130880 00000100:00100000:2.0:1788838253.474505:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135130880 00000100:00100000:2.0:1788838253.474581:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788838253.474593:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:93108:x1875729135130880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838253.474817:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:93108:x1875729135130880:12345-0@lo:502:llog_process_th.0 Request processed in 206us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838253.474826:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788838253.475070:0:93108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93108:1875729135130880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838253.475153:0:93108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93108:1875729135131008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838253.475200:0:93108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838253.475239:0:93108:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd3600 going to sleep for 11 seconds 00000100:00100000:0.0:1788838253.475512:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135131008 00000100:00100000:0.0:1788838253.475519:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135131008 00000100:00100000:0.0:1788838253.475563:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788838253.475572:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:93108:x1875729135131008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838253.475671:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:93108:x1875729135131008:12345-0@lo:502:llog_process_th.0 Request processed in 99us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.475680:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788838253.476538:0:93108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93108:1875729135131008:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788838253.476591:0:93108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1788838253.476846:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1788838253.476882:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838253.476897:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.476912:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838253.476925:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788838253.476929:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788838253.477226:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788838253.477273:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.477295:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.477315:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838253.477338:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.477552:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.477606:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838253.478182:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135131136 00000100:00100000:0.0:1788838253.478194:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135131136 00000100:00100000:0.0:1788838253.478253:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788838253.478265:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135131136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838253.478285:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838253.478315:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504626600/0x88da08396ccc9a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9a45 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.478346:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504626600/0x88da08396ccc9a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9a45 expref: 21 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.478360:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504626600/0x88da08396ccc9a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a45 expref: 21 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.478993:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626600, rc 0) 00000100:00100000:0.0:1788838253.479183:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a372050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135131136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 919us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.479192:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788838253.481420:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838253.481461:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.481479:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838253.481614:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.481692:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.481751:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.483024:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135131264 00000100:00100000:3.0:1788838253.483040:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135131264 00000100:00100000:3.0:1788838253.483120:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788838253.483132:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135131264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838253.483354:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a372450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135131264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.483386:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788838253.483693:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.483758:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.483837:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.483875:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5035ad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838253.484478:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135131392 00000100:00100000:2.0:1788838253.484486:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135131392 00000100:00100000:2.0:1788838253.484546:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788838253.484556:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135131392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.484723:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a373050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135131392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838253.484731:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788838253.486596:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838253.496933:0:93109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788838253.497839:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788838253.497890:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788838253.497905:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.497919:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838253.497931:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788838253.497934:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627f9a800 from 52 10000000:01000000:0.0:1788838253.497936:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788838253.497976:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.497984:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.498014:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838253.498042:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.498128:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.498239:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838253.501357:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135131520 00000100:00100000:2.0:1788838253.501375:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135131520 00000100:00100000:0.0:1788838253.502910:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788838253.502923:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135131520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838253.502941:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838253.502961:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504627800/0x88da08396ccc9a5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9a53 expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.502993:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504627800/0x88da08396ccc9a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9a53 expref: 22 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.503006:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504627800/0x88da08396ccc9a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a53 expref: 22 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.503016:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627800, rc 0) 00000100:00100000:0.0:1788838253.503209:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a371450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135131520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (5080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.503216:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788838253.503291:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838253.503382:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.503457:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838253.503782:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.503887:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.503921:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838253.505461:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135131648 00000100:00100000:1.0:1788838253.505506:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135131648 00000100:00100000:1.0:1788838253.505594:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788838253.505607:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135131648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.505883:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a373c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135131648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838253.505892:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788838253.506216:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.506279:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.506377:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.506714:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.507041:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135131776 00000100:00100000:3.0:1788838253.507053:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135131776 00000100:00100000:3.0:1788838253.507110:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788838253.507120:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135131776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838253.507290:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a373450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135131776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.507298:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788838253.507836:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135131776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.511742:0:93110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93110:1875729135131904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838253.511892:0:93110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.511961:0:93110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.511997:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135131904 00000100:00100000:3.0:1788838253.512014:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135131904 00000100:00100000:3.0:1788838253.512119:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788838253.512131:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:93110:x1875729135131904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838253.512386:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:93110:x1875729135131904:12345-0@lo:502:llog_process_th.0 Request processed in 257us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.512397:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788838253.512717:0:93110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93110:1875729135131904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838253.512781:0:93110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93110:1875729135132032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838253.513185:0:93110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.513216:0:93110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6054916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838253.513246:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135132032 00000100:00100000:1.0:1788838253.513257:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135132032 00000100:00100000:1.0:1788838253.513337:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788838253.513346:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62c431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:93110:x1875729135132032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838253.513607:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62c431050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:93110:x1875729135132032:12345-0@lo:502:llog_process_th.0 Request processed in 261us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838253.513615:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788838253.517064:0:93110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93110:1875729135132032:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788838253.522161:0:93110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1788838253.523610:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1788838253.523902:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788838253.523917:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.523954:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838253.523965:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788838253.523968:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1788838253.523972:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788838253.524014:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.524022:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.524033:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838253.524060:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135132160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.524129:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.524180:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.524246:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135132160 00000100:00100000:3.0:1788838253.524254:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135132160 00000100:00100000:3.0:1788838253.524319:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788838253.524329:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135132160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838253.524342:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838253.524355:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601529600/0x88da08396ccc9a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9a61 expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838253.524474:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601529600/0x88da08396ccc9a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9a61 expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838253.524493:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601529600/0x88da08396ccc9a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a61 expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838253.524500:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529600, rc 0) 00000100:00100000:3.0:1788838253.524539:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135132160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838253.524544:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788838253.524614:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135132160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838253.524629:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838253.524638:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838253.524706:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135132288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.524731:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838253.524754:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838253.525979:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135132288 00000100:00100000:1.0:1788838253.526002:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135132288 00000100:00100000:0.0:1788838253.526156:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788838253.526171:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135132288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838253.526347:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135132288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.526355:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788838253.526499:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135132288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.526576:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135132416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.526669:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.526728:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff502553e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838253.526764:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135132416 00000100:00100000:3.0:1788838253.526774:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135132416 00000100:00100000:1.0:1788838253.526850:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788838253.526867:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135132416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.527018:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135132416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838253.527069:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135132416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838253.528231:0:93111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000100:00100000:1.0:1788838253.529462:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000020:01000000:2.0:1788838253.529641:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788838253.529688:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788838253.529705:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.529720:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838253.529735:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788838253.529739:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ff610244d28 from 1 10000000:01000000:2.0:1788838253.529742:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788838253.529827:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.529836:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838253.529848:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838253.529876:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135132544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838253.529961:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838253.530019:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838253.531283:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135132544 00000100:00100000:1.0:1788838253.531308:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135132544 00000100:00100000:1.0:1788838253.531394:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788838253.531408:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135132544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838253.531431:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838253.531455:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e800/0x88da08396ccc9a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9a6f expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.531496:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e800/0x88da08396ccc9a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9a6f expref: 24 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.531511:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e800/0x88da08396ccc9a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a6f expref: 24 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.531522:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e800, rc 0) 00000100:00100000:1.0:1788838253.531627:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135132544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838253.531654:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788838253.531732:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135132544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838253.531755:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.531765:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838253.532070:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135132672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.532126:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838253.532154:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135132672 00000100:00100000:1.0:1788838253.532158:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135132672 00000100:00100000:1.0:1788838253.532180:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788838253.532197:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ba92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135132672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838253.532289:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ba92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135132672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (163us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838253.532299:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788838253.532347:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60925f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788838253.532512:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135132672:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788838253.532552:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788838253.532560:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.532570:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838253.634474:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838254.653971:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838255.485285:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135132800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838255.485402:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838255.485487:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135132800 00000100:00100000:3.0:1788838255.485496:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135132800 00000100:00100000:3.0:1788838255.485556:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4194 00000100:00100000:3.0:1788838255.485565:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135132800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838255.485607:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445441536 avail 1299202048 00000100:00100000:3.0:1788838255.485656:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135132800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838255.485664:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4194 00000100:00100000:3.0:1788838255.485720:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135132800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838255.486053:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135133056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838255.486101:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838255.486147:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135133056 00000100:00100000:0.0:1788838255.486151:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135133056 00000100:00100000:0.0:1788838255.486198:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:0.0:1788838255.486206:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135133056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788838255.486232:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838255.486269:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135133056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838255.486276:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00080000:0.0:1788838255.486308:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838255.486336:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135133056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838255.486929:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135133184:0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.486972:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838255.487013:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135133696:0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838255.487077:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135134208:0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487121:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838255.487141:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788838255.487147:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135133568:0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487168:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838255.487187:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135134080:0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487213:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838255.487245:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135133696 00000100:00100000:0.0:1788838255.487250:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135133696 00000100:00100000:0.0:1788838255.487307:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135134208 00000100:00100000:0.0:1788838255.487311:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135134208 00000100:00100000:0.0:1788838255.487328:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135133568 00000100:00100000:0.0:1788838255.487331:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135133568 00000100:00100000:0.0:1788838255.487351:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1788838255.487359:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135133696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487406:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135133696:12345-0@lo:400:kworker.0 Request processed in 48us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838255.487414:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1788838255.487432:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:0.0:1788838255.487438:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135134208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487466:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135134208:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838255.487473:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:0.0:1788838255.487484:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:0.0:1788838255.487490:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135133568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487517:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135133568:12345-0@lo:400:kworker.0 Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838255.487542:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:0.0:1788838255.487563:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135134080 00000100:00100000:0.0:1788838255.487566:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135134080 00000100:00100000:0.0:1788838255.487594:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:0.0:1788838255.487599:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135134080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487630:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135134080:12345-0@lo:400:kworker.0 Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838255.487635:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00080000:0.0:1788838255.487662:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838255.487665:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838255.487667:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838255.487691:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135133568:0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487699:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969455 gen 2 00000004:00080000:0.0:1788838255.487705:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ff50f38dc00, transno 4294969455 00000100:00100000:0.0:1788838255.487715:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135134080:0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487723:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135133696:0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.487731:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135134208:0@lo:400:kworker.0 00000100:00100000:1.0:1788838255.488353:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135133184 00000100:00100000:1.0:1788838255.488361:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135133184 00000100:00100000:1.0:1788838255.488408:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788838255.488416:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6411ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135133184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838255.488476:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6411ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135133184:12345-0@lo:400:kworker.0 Request processed in 61us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838255.488483:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788838255.488708:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135133184:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.488919:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135132928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838255.488968:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838255.488998:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135133440:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489024:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838255.489065:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135133952:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489109:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838255.489131:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135134464:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489154:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838255.489179:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788838255.489186:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135133312:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838255.489228:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135133824:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838255.489264:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135134336:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838255.489333:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135133952 00000100:00100000:3.0:1788838255.489338:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135133952 00000100:00100000:3.0:1788838255.489383:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135134336 00000100:00100000:3.0:1788838255.489386:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135134336 00000100:00100000:3.0:1788838255.489405:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:3.0:1788838255.489413:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135133952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489461:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135133952:12345-0@lo:400:kworker.0 Request processed in 49us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838255.489468:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:3.0:1788838255.489484:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:3.0:1788838255.489490:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135134336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489516:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135134336:12345-0@lo:400:kworker.0 Request processed in 27us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838255.489522:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:3.0:1788838255.489552:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135133440 00000100:00100000:3.0:1788838255.489557:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135133440 00000100:00100000:3.0:1788838255.489595:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135134464 00000100:00100000:3.0:1788838255.489598:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135134464 00000100:00100000:3.0:1788838255.489614:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135133312 00000100:00100000:3.0:1788838255.489617:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135133312 00000100:00100000:3.0:1788838255.489640:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1788838255.489647:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135133440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489683:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135133440:12345-0@lo:400:kworker.0 Request processed in 36us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838255.489690:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1788838255.489703:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1788838255.489709:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135134464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489737:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135134464:12345-0@lo:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838255.489744:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1788838255.489755:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1788838255.489761:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135133312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489785:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135133312:12345-0@lo:400:kworker.0 Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838255.489792:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00080000:3.0:1788838255.489896:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838255.489901:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838255.489903:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838255.489940:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135133312:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489952:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135134336:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489963:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135133440:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489974:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135133952:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.489995:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135134464:0@lo:400:kworker.0 00000100:00100000:0.0:1788838255.490400:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135132928 00000100:00100000:0.0:1788838255.490406:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135132928 00000100:00100000:0.0:1788838255.490439:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135133824 00000100:00100000:0.0:1788838255.490442:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135133824 00000100:00100000:0.0:1788838255.490465:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4195 00000100:00100000:0.0:1788838255.490473:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1875729135132928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838255.490513:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445019648 avail 1298780160 00000100:00100000:1.0:1788838255.490643:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4196 00000100:00100000:1.0:1788838255.490655:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1875729135133824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838255.490718:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1875729135133824:12345-0@lo:400:kworker.0 Request processed in 68us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838255.490724:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4196 00000100:00100000:1.0:1788838255.491365:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135132928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 892us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838255.491374:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4195 00000100:00100000:3.0:1788838255.491719:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135133824:0@lo:400:kworker.0 00000100:00100000:3.0:1788838255.491744:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135132928:0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788838255.492072:0:75678:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444094 batchid updated 00000020:00080000:2.0:1788838255.493694:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444094 00000004:00080000:2.0:1788838255.493790:0:75698:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8ff639570840 with version 15 00000020:00080000:2.0:1788838255.493819:0:75698:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444094 cancel update log [0x2000090a1:0x2:0x0].5: rc = 0 00000020:00080000:2.0:1788838255.493923:0:75698:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444094 cancel update log [0x2400088d0:0x2:0x0].6: rc = 0 00000020:00080000:2.0:1788838255.493933:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444094 00000004:00080000:1.0:1788838255.494029:0:75683:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8ff626ae9780 version 15 rpc_version 15 00000020:00100000:1.0:1788838255.494073:0:75683:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788838255.494087:0:75683:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8ff5059a9500 x1875729135134720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838255.494126:0:75683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135134720:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788838255.494227:0:75683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838255.494271:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60925f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838255.500641:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135134720 00000100:00100000:2.0:1788838255.500667:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135134720 00000100:00100000:2.0:1788838255.500755:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4197 00000100:00100000:2.0:1788838255.500765:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75683:x1875729135134720:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788838255.501079:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75683:x1875729135134720:12345-0@lo:1000:osp_up0-1.0 Request processed in 314us (6850us total) trans 120259084291 rc 0/0 00000100:00100000:2.0:1788838255.501088:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4197 00000100:00100000:1.0:1788838255.501130:0:75683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135134720:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1788838255.677065:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838256.000723:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135134848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838256.000833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838256.000927:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135134848 00000100:00100000:1.0:1788838256.000938:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135134848 00000100:00100000:1.0:1788838256.001022:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1788838256.001034:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135134848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838256.001069:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838256.020635:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135134848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 19592us (19790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.020651:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:0.0:1788838256.021894:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63956ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135134848:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788838256.281354:0:93208:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff12686270 20000000:00000080:3.0:1788838256.281379:0:93208:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8ff503695000 uarg=0000000000000000 00000040:00100000:3.0:1788838256.282664:0:93208:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 49 20000000:01000000:3.0:1788838256.282679:0:93208:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:3.0:1788838256.282847:0:93208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:3.0:1788838256.282874:0:93208:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1788838256.282895:0:93208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:3.0:1788838256.282914:0:93208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:3.0:1788838256.283001:0:93208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:3.0:1788838256.283010:0:93208:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1788838256.283024:0:93208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:3.0:1788838256.283039:0:93208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:3.0:1788838256.283105:0:93208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:3.0:1788838256.283113:0:93208:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1788838256.283126:0:93208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:3.0:1788838256.283139:0:93208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:3.0:1788838256.283152:0:93208:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788838256.283178:0:93208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283204:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc99f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec8 expref: 9 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283212:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff601528600/0x88da08396ccc99f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cecf expref: 9 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283241:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff504626c00/0x88da08396ccc9a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc99ff expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283248:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a0d expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283255:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff601529000/0x88da08396ccc9a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a1b expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283262:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc9a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a29 expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283269:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9a3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a37 expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283276:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff504626600/0x88da08396ccc9a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a45 expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283296:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff504627800/0x88da08396ccc9a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a53 expref: 23 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283303:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff601529600/0x88da08396ccc9a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a61 expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283311:0:93208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff60148e800/0x88da08396ccc9a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a6f expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283318:0:93208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283383:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff60148e800/0x88da08396ccc9a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9a6f expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283402:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff60148e800/0x88da08396ccc9a76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9a6f expref: 23 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.283521:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135134976:0@lo:104: 00000100:00100000:3.0:1788838256.283615:0:93208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838256.283690:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff601529600/0x88da08396ccc9a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9a61 expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283699:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff601529600/0x88da08396ccc9a68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9a61 expref: 23 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.283701:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135134976 00000100:00100000:3.0:1788838256.283708:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135104:0@lo:104: 00000100:00100000:1.0:1788838256.283710:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135134976 00000100:00100000:3.0:1788838256.283729:0:93208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838256.283761:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff504627800/0x88da08396ccc9a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9a53 expref: 23 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283770:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff504627800/0x88da08396ccc9a5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9a53 expref: 23 pid: 92476 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.283779:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135232:0@lo:104: 00000100:00100000:1.0:1788838256.283788:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135135104 00000100:00100000:1.0:1788838256.283791:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135135104 00000100:00100000:3.0:1788838256.283819:0:93208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838256.283828:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135135232 00000100:00100000:1.0:1788838256.283831:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135135232 00010000:00010000:3.0:1788838256.283844:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff504626600/0x88da08396ccc9a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9a45 expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.283848:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00010000:00010000:3.0:1788838256.283853:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff504626600/0x88da08396ccc9a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9a45 expref: 23 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.283857:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:93208:x1875729135134976:12345-0@lo:104: 00010000:00010000:1.0:1788838256.283871:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.283872:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135360:0@lo:104: 00000100:00100000:3.0:1788838256.283896:0:93208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838256.283914:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9a37 expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.283922:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9a3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9a37 expref: 23 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.283930:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135488:0@lo:104: 00010000:00010000:1.0:1788838256.283938:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788838256.283944:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:93208:x1875729135134976:12345-0@lo:104: Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838256.283948:0:93208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838256.283952:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00010000:00010000:3.0:1788838256.283962:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc9a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9a29 expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.283967:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135135360 00010000:00010000:3.0:1788838256.283970:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc9a30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9a29 expref: 23 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.283970:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135135360 00000100:00100000:3.0:1788838256.283978:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135616:0@lo:104: 00000100:00100000:1.0:1788838256.283980:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135135488 00000100:00100000:1.0:1788838256.283982:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135135488 00000100:00100000:3.0:1788838256.283997:0:93208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838256.284001:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135135616 00000100:00100000:1.0:1788838256.284003:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135135616 00010000:00010000:3.0:1788838256.284012:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff601529000/0x88da08396ccc9a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9a1b expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.284015:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788838256.284019:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93208:x1875729135135104:12345-0@lo:104: 00010000:00010000:3.0:1788838256.284021:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff601529000/0x88da08396ccc9a22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9a1b expref: 23 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284027:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.284028:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135744:0@lo:104: 00000100:00100000:0.0:1788838256.284099:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788838256.284109:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93208:x1875729135135232:12345-0@lo:104: 00010000:00010000:0.0:1788838256.284120:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284167:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788838256.284184:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93208:x1875729135135104:12345-0@lo:104: Request processed in 164us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.284191:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788838256.284193:0:93208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838256.284213:0:6529:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788838256.284215:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9a0d expref: 23 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.284224:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135135744 00000100:00100000:1.0:1788838256.284226:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135135744 00010000:00010000:3.0:1788838256.284233:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9a0d expref: 23 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.284239:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788838256.284242:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135872:0@lo:104: 00000100:00100000:1.0:1788838256.284245:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93208:x1875729135135360:12345-0@lo:104: 00010000:00010000:1.0:1788838256.284252:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.284265:0:93208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838256.284295:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff504626c00/0x88da08396ccc9a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc99ff expref: 23 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284295:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788838256.284300:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93208:x1875729135135360:12345-0@lo:104: Request processed in 56us (403us total) trans 0 rc 0/0 00010000:00010000:3.0:1788838256.284304:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff504626c00/0x88da08396ccc9a06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc99ff expref: 23 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.284306:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788838256.284312:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135136000:0@lo:104: 00000100:00100000:1.0:1788838256.284317:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135135872 00000100:00100000:1.0:1788838256.284320:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135135872 00000100:00100000:1.0:1788838256.284332:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788838256.284334:0:93208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838256.284337:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93208:x1875729135135488:12345-0@lo:104: 00010000:00010000:1.0:1788838256.284345:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.284356:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff601528600/0x88da08396ccc99f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cecf expref: 9 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.284365:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff601528600/0x88da08396ccc99f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cecf expref: 9 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.284374:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f04700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135136128:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788838256.284383:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788838256.284387:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93208:x1875729135135488:12345-0@lo:104: Request processed in 51us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.284393:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788838256.284402:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135136000 00000100:00100000:1.0:1788838256.284405:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135136000 00000100:00100000:1.0:1788838256.284419:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788838256.284423:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93208:x1875729135135616:12345-0@lo:104: 00010000:00010000:1.0:1788838256.284431:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284457:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788838256.284462:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:93208:x1875729135135616:12345-0@lo:104: Request processed in 39us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.284468:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788838256.284479:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788838256.284483:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a3ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+6:93208:x1875729135135744:12345-0@lo:104: 00010000:00010000:1.0:1788838256.284491:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284515:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788838256.284531:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a3ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+6:93208:x1875729135135744:12345-0@lo:104: Request processed in 36us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.284537:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788838256.284550:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788838256.284555:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:93208:x1875729135135872:12345-0@lo:104: 00010000:00010000:1.0:1788838256.284571:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284600:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788838256.284605:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:93208:x1875729135135872:12345-0@lo:104: Request processed in 50us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.284611:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788838256.284623:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788838256.284630:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+4:93208:x1875729135136000:12345-0@lo:104: 00010000:00010000:1.0:1788838256.284637:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284665:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1788838256.284670:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+4:93208:x1875729135136000:12345-0@lo:104: Request processed in 42us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.284676:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00010000:00010000:3.0:1788838256.284677:0:93208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc99f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec8 expref: 9 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.284686:0:93208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc99f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec8 expref: 9 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.284695:0:93208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135136256:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788838256.284703:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788838256.284709:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284716:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8000 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838256.284721:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.284729:0:93208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e540 going to sleep for 11 seconds 00010000:00010000:1.0:1788838256.284732:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838256.284740:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838256.284753:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788838256.284754:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135134976:0@lo:104: 00000100:00100000:3.0:1788838256.284763:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135104:0@lo:104: 00000100:00100000:3.0:1788838256.284770:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135360:0@lo:104: 00000100:00100000:3.0:1788838256.284776:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135488:0@lo:104: 00000100:00100000:3.0:1788838256.284782:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135616:0@lo:104: 00000100:00100000:3.0:1788838256.284788:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135744:0@lo:104: 00010000:00010000:1.0:1788838256.284788:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.284794:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135872:0@lo:104: 00010000:00010000:1.0:1788838256.284795:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788838256.284826:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135136000:0@lo:104: 00010000:00010000:1.0:1788838256.284844:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284852:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9a6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a76 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284866:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788838256.284870:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284875:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627c00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838256.284878:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284883:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838256.284888:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838256.284891:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838256.284902:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284905:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838256.284931:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284938:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff504627c00/0x88da08396ccc9a61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a68 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284947:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:3.0:1788838256.284949:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135136512:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838256.284950:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284956:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838256.284959:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284966:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838256.284972:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838256.284977:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788838256.284979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788838256.284990:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.284996:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838256.285002:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285008:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9a45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a4c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.285009:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838256.285014:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135136640:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838256.285018:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788838256.285026:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.285033:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788838256.285033:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626200 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838256.285036:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285043:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838256.285049:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838256.285055:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838256.285069:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285075:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838256.285081:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285088:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff504626200/0x88da08396ccc9a37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a3e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285097:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788838256.285100:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285105:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626000 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838256.285108:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285123:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838256.285131:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838256.285136:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838256.285148:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285155:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838256.285160:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285167:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9a29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a30 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285176:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838256.285179:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285184:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838256.285187:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285192:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838256.285198:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838256.285208:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838256.285222:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285228:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838256.285246:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285253:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8800/0x88da08396ccc9a1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a22 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285263:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788838256.285265:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135137024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838256.285266:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285272:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148e000 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838256.285275:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285293:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.285299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1788838256.285300:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838256.285306:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838256.285319:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285325:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838256.285344:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285351:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9a0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a14 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285366:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838256.285370:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285375:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148e400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838256.285378:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285384:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838256.285389:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838256.285394:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838256.285408:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285413:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838256.285417:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285423:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148e400/0x88da08396ccc99ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a06 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285431:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838256.285437:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838256.285439:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838256.285448:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838256.285456:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838256.285462:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838256.285544:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838256.285552:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135137152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838256.285577:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838256.285661:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135136384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838256.285688:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135136512 00000100:00100000:1.0:1788838256.285699:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838256.285706:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135136512 00000100:00100000:1.0:1788838256.285724:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135136896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838256.285758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788838256.285769:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff601529600/0x88da08396ccc9a68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a61 expref: 24 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.285780:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788838256.285785:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135136640 00000100:00100000:3.0:1788838256.285791:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135136640 00000100:00100000:1.0:1788838256.285791:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135136768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838256.285845:0:10364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff504626600/0x88da08396ccc9a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a45 expref: 25 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.285845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838256.285862:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135137024 00000100:00100000:1.0:1788838256.285864:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135137280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838256.285883:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135137024 00000100:00100000:1.0:1788838256.285885:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788838256.285898:0:10364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff601529000/0x88da08396ccc9a22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a1b expref: 26 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.285911:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135137152 00000100:00100000:3.0:1788838256.285914:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135137152 00000100:00100000:1.0:1788838256.285926:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135136384 00010000:00010000:3.0:1788838256.285927:0:10364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a0d expref: 27 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838256.285928:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135136896 00000100:00100000:1.0:1788838256.285929:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135136384 00000100:00100000:2.0:1788838256.285941:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135136896 00000100:00100000:3.0:1788838256.285946:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135136768 00010000:00010000:1.0:1788838256.285948:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff60148e800/0x88da08396ccc9a76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a6f expref: 29 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.285951:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135136768 00000100:00100000:1.0:1788838256.285960:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135137280 00000100:00100000:1.0:1788838256.285962:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135137280 00010000:00010000:3.0:1788838256.285974:0:10364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9a3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a37 expref: 31 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.285975:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff504626c00/0x88da08396ccc9a06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc99ff expref: 31 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838256.285978:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc9a30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a29 expref: 31 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.285998:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:1.0:1788838256.286005:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:3.0:1788838256.286007:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+31:3645:x1875729135136512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838256.286011:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+31:3645:x1875729135136640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838256.286022:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838256.286028:0:10364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff601529600/0x88da08396ccc9a68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a61 expref: 31 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.286038:0:10364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff601529600/0x88da08396ccc9a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9a61 expref: 31 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.286056:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601529600/0x88da08396ccc9a68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9a61 expref: 31 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.286073:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838256.286120:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+30:3645:x1875729135136512:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838256.286120:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1788838256.286138:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1788838256.286146:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+30:3645:x1875729135137024:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838256.286166:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00010000:00010000:2.0:1788838256.286167:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838256.286178:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff601529000/0x88da08396ccc9a22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a1b expref: 29 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.286191:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+29:3645:x1875729135137152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838256.286194:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff601529000/0x88da08396ccc9a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9a1b expref: 29 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.286206:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838256.286213:0:10364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a0d expref: 29 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.286652:0:10364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9a0d expref: 29 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.287363:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788838256.287376:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:93208:x1875729135135232:12345-0@lo:104: Request processed in 3265us (3552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838256.287386:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788838256.287477:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:0.0:1788838256.287489:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+29:3644:x1875729135136384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838256.287505:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838256.287514:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff60148e800/0x88da08396ccc9a76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a6f expref: 29 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.287585:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838256.287591:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff504626600/0x88da08396ccc9a4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a45 expref: 29 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838256.290151:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601529000/0x88da08396ccc9a22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9a1b expref: 29 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838256.290180:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838256.290222:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9a0d expref: 28 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.290247:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838256.290318:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+27:3645:x1875729135137024:12345-0@lo:103:ldlm_bl.0 Request processed in 4168us (5005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838256.290331:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1788838256.290341:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+27:3645:x1875729135137152:12345-0@lo:103:ldlm_bl.0 Request processed in 4151us (4759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838256.290354:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1788838256.290385:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:3.0:1788838256.290395:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:2.0:1788838256.290404:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+25:3644:x1875729135136768:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838256.290412:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+25:3644:x1875729135137280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838256.290429:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838256.290431:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838256.290443:0:10364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff504626c00/0x88da08396ccc9a06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc99ff expref: 25 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838256.290446:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9a3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a37 expref: 25 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.290459:0:10364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff504626c00/0x88da08396ccc9a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc99ff expref: 25 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.290496:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff504626c00/0x88da08396ccc9a06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc99ff expref: 25 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838256.290499:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9a37 expref: 25 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.290518:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838256.290529:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9a3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9a37 expref: 24 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838256.290546:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838256.290569:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3644:x1875729135137280:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (4681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838256.290602:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3644:x1875729135136768:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (4750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838256.290606:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:2.0:1788838256.290620:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:3.0:1788838256.290636:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1788838256.290648:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3644:x1875729135136896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838256.290659:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838256.290666:0:10364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc9a30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a29 expref: 21 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.290676:0:10364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc9a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9a29 expref: 21 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.290689:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9800/0x88da08396ccc9a30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9a29 expref: 21 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.290701:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838256.290733:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3644:x1875729135136896:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838256.290741:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:2.0:1788838256.290837:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135137152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838256.290849:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135135232:0@lo:104: 00000100:00100000:2.0:1788838256.290859:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135137024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838256.290877:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135136512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838256.291003:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff60148e800/0x88da08396ccc9a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9a6f expref: 19 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.291043:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff504626600/0x88da08396ccc9a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9a45 expref: 19 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.291056:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff504626600/0x88da08396ccc9a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9a45 expref: 19 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.291066:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838256.291109:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+18:3645:x1875729135136640:12345-0@lo:103:ldlm_bl.0 Request processed in 5098us (6075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.291116:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1788838256.291230:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838256.291258:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838256.291277:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116456320 00000100:00100000:1.0:1788838256.291294:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116456320 00010000:00010000:1.0:1788838256.291321:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff601528600/0x88da08396ccc99f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cecf expref: 10 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.291341:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116456448 00000100:00100000:1.0:1788838256.291344:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116456448 00010000:00010000:1.0:1788838256.291352:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc99f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec8 expref: 11 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.291366:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2573 00000100:00100000:1.0:1788838256.291372:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2af93169-6705-472b-b7ff-fd7cc5c04782+11:2404:x1875729116456320:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838256.291382:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838256.291386:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff601528600/0x88da08396ccc99f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cecf expref: 11 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.291408:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff601528600/0x88da08396ccc99f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cecf expref: 11 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.291431:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838256.291475:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2af93169-6705-472b-b7ff-fd7cc5c04782+11:2404:x1875729116456320:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 102us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.291482:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2573 00000100:00100000:1.0:1788838256.291495:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2574 00000100:00100000:1.0:1788838256.291501:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116456448:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838256.291508:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838256.291512:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc99f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec8 expref: 10 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.291521:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc99f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec8 expref: 10 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.291530:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838256.291544:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116456448:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 44us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.291550:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2574 00000100:00100000:1.0:1788838256.291582:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135136768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838256.291591:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135137280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838256.291599:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135136896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838256.292013:0:93208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601528600/0x88da08396ccc99f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cecf expref: 9 pid: 92475 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.292026:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f04700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135136128:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788838256.292045:0:93208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8e00/0x88da08396ccc99f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cec8 expref: 8 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838256.292054:0:93208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93208:1875729135136256:192.168.203.30@tcp:104: 00010000:00010000:3.0:1788838256.292113:0:93208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.292410:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838256.292425:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.292434:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838256.292439:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.292450:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838256.292458:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838256.292464:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788838256.292519:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.292526:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838256.292549:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.292556:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff504627600/0x88da08396ccc9a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9a5a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.292573:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838256.292575:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838256.292576:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838256.292592:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135137408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838256.292645:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838256.292701:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135137408 00000100:00100000:1.0:1788838256.292707:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135137408 00010000:00010000:1.0:1788838256.292737:0:6531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff504627800/0x88da08396ccc9a5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a53 expref: 18 pid: 92476 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838256.292762:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1788838256.292780:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:3644:x1875729135137408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838256.292793:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838256.292815:0:6531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff504627800/0x88da08396ccc9a5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9a53 expref: 18 pid: 92476 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.292827:0:6531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff504627800/0x88da08396ccc9a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9a53 expref: 18 pid: 92476 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.292841:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff504627800/0x88da08396ccc9a5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9a53 expref: 18 pid: 92476 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838256.292853:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838256.292889:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:3644:x1875729135137408:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838256.292897:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1788838256.292942:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135137408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838256.292976:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135136640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838256.293128:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148e800/0x88da08396ccc9a76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9a6f expref: 16 pid: 92477 timeout: 3750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.293210:0:6532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.293219:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.293246:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.293254:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.293261:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.293268:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.293273:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838256.293277:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.293294:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.293397:0:93208:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838256.293406:0:93208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.294668:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.294685:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601528c00/0x88da08396ccc9a7d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838256.294709:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838256.297089:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+15:3644:x1875729135136384:12345-0@lo:103:ldlm_bl.0 Request processed in 9589us (11378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838256.297109:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:1.0:1788838256.298669:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135136384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838256.701138:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838256.704747:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838256.704909:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838256.704942:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838256.704978:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838256.706342:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116456832 00000100:00100000:2.0:1788838256.706360:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116456832 00000100:00100000:2.0:1788838256.706471:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116456704 00000100:00100000:2.0:1788838256.706475:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116456704 00000100:00100000:2.0:1788838256.706509:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1361 00000100:00100000:2.0:1788838256.706533:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116456832:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:1.0:1788838256.706850:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788838256.706856:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838256.707049:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116456832:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 527us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838256.707059:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1361 00000100:00100000:2.0:1788838256.707087:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1362 00000100:00100000:2.0:1788838256.707095:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2407:x1875729116456704:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838256.707126:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2407:x1875729116456704:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 33us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838256.707133:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1362 00000100:00100000:2.0:1788838256.707156:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116456960 00000100:00100000:2.0:1788838256.707160:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116456960 00000100:00100000:2.0:1788838256.707938:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2665 00000100:00100000:2.0:1788838256.707950:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116456960:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838256.707998:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116456960:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 51us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838256.708005:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2665 00000100:00080000:1.0:1788838256.710337:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838256.712833:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116456576 00000100:00100000:0.0:1788838256.712876:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116456576 00000100:00100000:0.0:1788838256.712970:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:0.0:1788838256.712983:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6411ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+8:2407:x1875729116456576:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838256.713168:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6411ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+8:2407:x1875729116456576:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 187us (8433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838256.713183:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:1.0:1788838257.023921:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135137664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838257.024008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838257.024072:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838257.024083:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135137536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838257.024116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838257.024240:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135137664 00000100:00100000:3.0:1788838257.024248:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135137664 00000100:00100000:3.0:1788838257.024321:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135137536 00000100:00100000:3.0:1788838257.024325:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135137536 00000100:00100000:3.0:1788838257.024344:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:3.0:1788838257.024353:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135137664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838257.024376:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838257.024431:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135137664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838257.024439:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:3.0:1788838257.024455:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:3.0:1788838257.024461:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50364b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135137536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838257.024493:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838257.024519:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50364b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135137536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838257.024525:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:3.0:1788838257.024563:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135137536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838257.024575:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135137664:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788838257.024613:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838257.024621:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838257.341094:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838257.343053:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116457088 00000100:00100000:0.0:1788838257.343068:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116457088 00000100:00100000:0.0:1788838257.343150:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:0.0:1788838257.343161:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6411ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116457088:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838257.343181:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838257.343205:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504627200/0x88da08396ccc9a84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ced6 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838257.343234:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504627200/0x88da08396ccc9a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ced6 expref: 9 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838257.343247:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504627200/0x88da08396ccc9a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ced6 expref: 9 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838257.343256:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627200, rc 0) 00000100:00100000:0.0:1788838257.343345:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6411ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116457088:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 186us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838257.343353:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:2.0:1788838257.345890:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838257.345986:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116457216 00000100:00100000:1.0:1788838257.345996:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116457216 00000100:00100000:1.0:1788838257.346042:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:1.0:1788838257.346051:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116457216:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838257.346212:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116457216:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 160us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838257.346220:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:1.0:1788838257.352693:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838257.352866:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116457344 00000100:00100000:3.0:1788838257.352890:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116457344 00000100:00100000:3.0:1788838257.352949:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:3.0:1788838257.352959:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116457344:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838257.353098:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116457344:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 140us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838257.353107:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:2.0:1788838257.360067:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838257.360374:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116457472 00000100:00100000:0.0:1788838257.360384:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116457472 00000100:00100000:0.0:1788838257.360460:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:0.0:1788838257.360480:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:71920:x1875729116457472:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788838257.360642:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:71920:x1875729116457472:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 173us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838257.360653:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:2.0:1788838257.366512:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838257.366627:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116457600 00000100:00100000:1.0:1788838257.366640:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116457600 00000100:00100000:1.0:1788838257.366700:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:1.0:1788838257.366711:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:71920:x1875729116457600:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788838257.366897:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:71920:x1875729116457600:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 187us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838257.366905:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:1.0:1788838257.375042:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838257.375333:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116457728 00000100:00100000:3.0:1788838257.375345:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116457728 00000100:00100000:3.0:1788838257.375408:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:3.0:1788838257.375418:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116457728:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838257.375435:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838257.375453:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601528600/0x88da08396ccc9a8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cedd expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838257.375579:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601528600/0x88da08396ccc9a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cedd expref: 10 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838257.375592:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601528600/0x88da08396ccc9a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cedd expref: 10 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838257.375601:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528600, rc 0) 00000100:00100000:3.0:1788838257.375663:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116457728:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 246us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838257.375670:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:2.0:1788838257.377658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838257.377822:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116457856 00000100:00100000:0.0:1788838257.377830:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116457856 00000100:00100000:0.0:1788838257.377887:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:0.0:1788838257.377896:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116457856:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838257.378011:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116457856:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 116us (360us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788838257.378019:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00010000:00010000:1.0:1788838257.725085:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788838257.981080:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788838257.981088:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff62ceaa000 from 55 10000000:01000000:1.0:1788838257.981093:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838257.981164:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838257.981175:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838257.981186:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838257.981211:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135137792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838257.981297:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838257.981344:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838257.981481:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135137792 00000100:00100000:3.0:1788838257.981489:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135137792 00000100:00100000:3.0:1788838257.981548:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788838257.981558:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135137792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838257.981580:0:92475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838257.981595:0:92475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9a92 expref: -99 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838257.981620:0:92475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9a92 expref: 16 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838257.981629:0:92475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9a92 expref: 16 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838257.981639:0:92475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529400, rc 0) 00000100:00100000:3.0:1788838257.981688:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135137792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838257.981695:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788838257.981835:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135137792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838257.981849:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838257.981859:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838257.981915:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135137920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838257.981942:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838257.981971:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838257.982062:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135137920 00000100:00100000:3.0:1788838257.982067:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135137920 00000100:00100000:3.0:1788838257.982096:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788838257.982102:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135137920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838257.982219:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135137920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838257.982226:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788838257.982338:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135137920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838257.982370:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135138048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838257.982414:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838257.982436:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476900 going to sleep for 11 seconds 00000100:00100000:0.0:1788838257.982483:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135138048 00000100:00100000:0.0:1788838257.982488:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135138048 00000100:00100000:0.0:1788838257.982521:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788838257.982529:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135138048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838257.982621:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135138048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838257.982629:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788838257.982706:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135138048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838257.983192:0:93209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93209:1875729135138176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838257.983232:0:93209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838257.983264:0:93209:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838257.983325:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135138176 00000100:00100000:0.0:1788838257.983330:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135138176 00000100:00100000:0.0:1788838257.983365:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788838257.983373:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:93209:x1875729135138176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838257.983465:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:93209:x1875729135138176:12345-0@lo:502:llog_process_th.0 Request processed in 93us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838257.983484:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788838257.983595:0:93209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93209:1875729135138176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838257.983639:0:93209:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93209:1875729135138304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838257.983674:0:93209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838257.983698:0:93209:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838257.983751:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135138304 00000100:00100000:3.0:1788838257.983756:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135138304 00000100:00100000:3.0:1788838257.983788:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788838257.983795:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:93209:x1875729135138304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838257.983905:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:93209:x1875729135138304:12345-0@lo:502:llog_process_th.0 Request processed in 110us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838257.983922:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788838257.984090:0:93209:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93209:1875729135138304:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788838257.984111:0:93209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1788838257.986008:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1788838257.986053:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788838257.986065:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838257.986078:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838257.986089:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788838257.986092:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:3.0:1788838257.986095:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788838257.986133:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838257.986157:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838257.986168:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838257.986193:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135138432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838257.986254:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838257.986356:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ccd33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838257.989098:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135138432 00000100:00100000:1.0:1788838257.989111:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135138432 00000100:00100000:1.0:1788838257.989182:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788838257.989193:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509c7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135138432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838257.989209:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838257.989227:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e200/0x88da08396ccc9aa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9aa0 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838257.989254:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e200/0x88da08396ccc9aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9aa0 expref: 17 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838257.989267:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e200/0x88da08396ccc9aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9aa0 expref: 17 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838257.989287:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e200, rc 0) 00000100:00100000:1.0:1788838257.989418:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509c7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135138432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838257.989426:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788838257.992295:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135138432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838257.992325:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838257.992337:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838257.992433:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135138560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838257.992566:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838257.992742:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838257.992790:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135138560 00000100:00100000:0.0:1788838257.993539:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135138560 00000100:00100000:0.0:1788838257.993644:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788838257.993654:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6049b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135138560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838257.993823:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6049b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135138560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838257.993831:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788838257.993946:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135138560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838257.993984:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135138688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838257.994032:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838257.998078:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838257.998280:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135138688 00000100:00100000:1.0:1788838257.998290:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135138688 00000100:00100000:1.0:1788838257.998351:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788838257.998362:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6049b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135138688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838257.998698:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6049b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135138688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 338us (4665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838257.998716:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788838258.000723:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135138688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838258.001186:0:93210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93210:1875729135138816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838258.001259:0:93210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838258.001314:0:93210:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838258.001426:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135138816 00000100:00100000:3.0:1788838258.001432:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135138816 00000100:00100000:3.0:1788838258.001523:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788838258.001532:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6049b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:93210:x1875729135138816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838258.001668:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6049b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:93210:x1875729135138816:12345-0@lo:502:llog_process_th.0 Request processed in 137us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838258.001682:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788838258.001746:0:93210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93210:1875729135138816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838258.001778:0:93210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838258.001789:0:93210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838258.001791:0:93210:0:(obd_config.c:1563:class_process_config()) marker 43 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1788838258.001832:0:93210:0:(obd_config.c:1472:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1788838258.001862:0:93210:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1788838258.002058:0:93210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93210:1875729135138944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838258.002093:0:93210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838258.009465:0:93210:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c000 going to sleep for 11 seconds 00000020:01000004:2.0:1788838258.009569:0:93211:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff62ceaa000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788838258.009574:0:93211:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff62ceaa000 4 00000100:00100000:0.0:1788838258.013438:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135138944 00000100:00100000:0.0:1788838258.013453:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135138944 00000100:00100000:0.0:1788838258.013514:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788838258.013524:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:93210:x1875729135138944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838258.013710:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:93210:x1875729135138944:12345-0@lo:502:llog_process_th.0 Request processed in 187us (11615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838258.013719:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788838258.013939:0:93210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93210:1875729135138944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838258.013973:0:93210:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838258.013980:0:93210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838258.013983:0:93210:0:(obd_config.c:1563:class_process_config()) marker 43 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1788838258.013987:0:93210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:2.0:1788838258.014127:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:2.0:1788838258.014145:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788838258.014155:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.014166:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838258.014175:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788838258.014178:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff503592800 from 55 10000000:01000000:2.0:1788838258.014188:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788838258.014217:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.014226:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.014234:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838258.014254:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838258.014304:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.014539:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135139072 00000100:00100000:1.0:1788838258.014545:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135139072 00000100:00100000:1.0:1788838258.014613:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788838258.014623:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135139072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838258.014635:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838258.014661:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148fc00/0x88da08396ccc9ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9aae expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.014685:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148fc00/0x88da08396ccc9ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9aae expref: 18 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.014697:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148fc00/0x88da08396ccc9ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9aae expref: 18 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.014707:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148fc00, rc 0) 00000100:00100000:1.0:1788838258.014737:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135139072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838258.014744:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788838258.015483:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838258.015508:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838258.015526:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ab5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.015536:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9ab5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838258.015594:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838258.015627:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838258.015655:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838258.015704:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135139200 00000100:00100000:0.0:1788838258.015709:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135139200 00000100:00100000:3.0:1788838258.015741:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788838258.015753:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135139200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838258.015883:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135139200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838258.016175:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838258.016204:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838258.016482:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838258.016512:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788838258.016760:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135139328 00000100:00100000:1.0:1788838258.016765:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135139328 00000100:00100000:3.0:1788838258.018092:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788838258.023138:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788838258.023165:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135139328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.023357:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135139328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (6874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838258.023366:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788838258.023466:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838258.026034:0:93212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505931880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93212:1875729135139456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838258.026114:0:93212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838258.036528:0:93212:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838258.041835:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135139456 00000100:00100000:0.0:1788838258.041851:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135139456 00000100:00100000:0.0:1788838258.041927:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788838258.041938:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:93212:x1875729135139456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838258.042126:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:93212:x1875729135139456:12345-0@lo:502:llog_process_th.0 Request processed in 190us (16011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838258.042135:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788838258.042310:0:93212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505931880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93212:1875729135139456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838258.042374:0:93212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505931880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93212:1875729135139584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838258.042418:0:93212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838258.042457:0:93212:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838258.042578:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135139584 00000100:00100000:0.0:1788838258.042583:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135139584 00000100:00100000:0.0:1788838258.042612:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788838258.042618:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:93212:x1875729135139584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838258.043134:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:93212:x1875729135139584:12345-0@lo:502:llog_process_th.0 Request processed in 514us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838258.043142:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788838258.045284:0:93212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505931880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93212:1875729135139584:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788838258.045344:0:93212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1788838258.045536:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1788838258.045569:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838258.045580:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9aae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ab5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.045592:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ab5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838258.045603:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788838258.045606:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:1.0:1788838258.045608:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788838258.045643:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148fe00/0x88da08396ccc9abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.045650:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148fe00/0x88da08396ccc9abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.045660:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148fe00/0x88da08396ccc9abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838258.045681:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.045741:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.045785:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838258.047597:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135139712 00000100:00100000:3.0:1788838258.047610:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135139712 00000100:00100000:3.0:1788838258.047682:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788838258.047693:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135139712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838258.047708:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838258.047725:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601529e00/0x88da08396ccc9ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9abc expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838258.047752:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601529e00/0x88da08396ccc9ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9abc expref: 19 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838258.047777:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601529e00/0x88da08396ccc9ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9abc expref: 19 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838258.047786:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529e00, rc 0) 00000100:00100000:3.0:1788838258.048030:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135139712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 338us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838258.048036:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788838258.048126:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838258.048156:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148fe00/0x88da08396ccc9abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ac3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838258.048167:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148fe00/0x88da08396ccc9abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9ac3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838258.048251:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.048296:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838258.048330:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ecc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838258.048472:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135139840 00000100:00100000:3.0:1788838258.048476:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135139840 00000100:00100000:3.0:1788838258.048498:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788838258.048505:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135139840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838258.048622:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135139840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838258.048630:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788838258.048739:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.048766:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.048987:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838258.049304:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ecc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838258.049319:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135139968 00000100:00100000:3.0:1788838258.049323:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135139968 00000100:00100000:3.0:1788838258.049402:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788838258.049411:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135139968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838258.049513:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135139968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838258.049521:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788838258.049839:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135139968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.050053:0:93213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93213:1875729135140096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838258.050090:0:93213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838258.055849:0:93213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ecc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838258.058697:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135140096 00000100:00100000:1.0:1788838258.058712:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135140096 00000100:00100000:1.0:1788838258.058789:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788838258.058827:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60891c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:93213:x1875729135140096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838258.059016:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60891c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:93213:x1875729135140096:12345-0@lo:502:llog_process_th.0 Request processed in 217us (8924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838258.059025:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788838258.063415:0:93213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93213:1875729135140096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788838258.063470:0:93213:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838258.063494:0:93213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838258.063497:0:93213:0:(obd_config.c:1563:class_process_config()) marker 44 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1788838258.063504:0:93213:0:(obd_config.c:1472:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1788838258.063527:0:93213:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:0.0:1788838258.063572:0:93213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93213:1875729135140224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838258.063651:0:93213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838258.063687:0:93213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ecc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838258.063814:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135140224 00000100:00100000:1.0:1788838258.063831:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135140224 00000100:00100000:1.0:1788838258.063875:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788838258.063884:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:93213:x1875729135140224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838258.064016:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:93213:x1875729135140224:12345-0@lo:502:llog_process_th.0 Request processed in 132us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838258.064025:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788838258.064202:0:93213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93213:1875729135140224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788838258.064226:0:93213:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838258.064231:0:93213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838258.064234:0:93213:0:(obd_config.c:1563:class_process_config()) marker 44 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788838258.064238:0:93213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:1.0:1788838258.064507:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:1.0:1788838258.064537:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788838258.064547:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148fe00/0x88da08396ccc9abc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ac3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.064560:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148fe00/0x88da08396ccc9abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ac3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838258.064570:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788838258.064573:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff63f7ce800 from 55 10000000:01000000:1.0:1788838258.064576:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838258.064603:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.064612:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.064622:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838258.064638:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135140352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.064671:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.064716:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838258.065136:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135140352 00000100:00100000:3.0:1788838258.065143:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135140352 00000100:00100000:3.0:1788838258.065255:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788838258.065265:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135140352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838258.065295:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838258.065311:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601528e00/0x88da08396ccc9ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9aca expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838258.065335:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601528e00/0x88da08396ccc9ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9aca expref: 20 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838258.065346:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601528e00/0x88da08396ccc9ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9aca expref: 20 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838258.065355:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528e00, rc 0) 00000100:00100000:3.0:1788838258.065407:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135140352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838258.065414:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788838258.067391:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135140352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838258.067418:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ad1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.067431:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9ad1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838258.067513:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135140480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.067565:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.067602:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476900 going to sleep for 11 seconds 00000100:00100000:1.0:1788838258.067624:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135140480 00000100:00100000:1.0:1788838258.067629:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135140480 00000100:00100000:1.0:1788838258.067667:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788838258.067675:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135140480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.067791:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135140480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838258.067817:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788838258.069327:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135140480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.069379:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135140608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.069446:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.069473:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476900 going to sleep for 11 seconds 00000100:00100000:0.0:1788838258.075390:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135140608 00000100:00100000:0.0:1788838258.075407:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135140608 00000100:00100000:0.0:1788838258.075475:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788838258.075486:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135140608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.075662:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135140608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (6215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838258.075669:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788838258.080976:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135140608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838258.081425:0:93214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505931880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93214:1875729135140736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838258.081503:0:93214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838258.081546:0:93214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838258.081596:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135140736 00000100:00100000:0.0:1788838258.081603:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135140736 00000100:00100000:0.0:1788838258.081652:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788838258.081663:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:93214:x1875729135140736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838258.081790:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:93214:x1875729135140736:12345-0@lo:502:llog_process_th.0 Request processed in 129us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838258.081826:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788838258.082016:0:93214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505931880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93214:1875729135140736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838258.082059:0:93214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93214:1875729135140864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838258.082099:0:93214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.082126:0:93214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838258.082172:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135140864 00000100:00100000:3.0:1788838258.082177:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135140864 00000100:00100000:3.0:1788838258.082288:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788838258.082296:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:93214:x1875729135140864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838258.082376:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:93214:x1875729135140864:12345-0@lo:502:llog_process_th.0 Request processed in 79us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838258.082383:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788838258.082477:0:93214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93214:1875729135140864:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788838258.082498:0:93214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1788838258.082973:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1788838258.082998:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788838258.083008:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9aca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ad1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838258.083026:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ad1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838258.083034:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788838258.083037:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788838258.083040:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788838258.083063:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601528a00/0x88da08396ccc9ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838258.083071:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff601528a00/0x88da08396ccc9ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838258.083080:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff601528a00/0x88da08396ccc9ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838258.083093:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505933b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135140992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838258.083123:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838258.083925:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788838258.087051:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135140992 00000100:00100000:0.0:1788838258.087081:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135140992 00000100:00100000:1.0:1788838258.090156:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788838258.090169:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135140992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838258.090185:0:92477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838258.090205:0:92477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e400/0x88da08396ccc9adf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9ad8 expref: -99 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.090232:0:92477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e400/0x88da08396ccc9adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9ad8 expref: 21 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.090244:0:92477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e400/0x88da08396ccc9adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9ad8 expref: 21 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.090253:0:92477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e400, rc 0) 00000100:00100000:1.0:1788838258.090346:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135140992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (7221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838258.090353:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788838258.090437:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505933b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135140992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838258.090456:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff601528a00/0x88da08396ccc9ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9adf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.090466:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff601528a00/0x88da08396ccc9ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9adf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838258.090543:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135141120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838258.090574:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838258.096632:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788838258.100263:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135141120 00000100:00100000:3.0:1788838258.100286:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135141120 00000100:00100000:3.0:1788838258.100339:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788838258.100349:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135141120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838258.100567:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135141120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (9991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838258.100574:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788838258.101900:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639569500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135141120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838258.102034:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505930000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135141248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838258.102098:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838258.102137:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838258.102253:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135141248 00000100:00100000:2.0:1788838258.102259:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135141248 00000100:00100000:2.0:1788838258.102312:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788838258.102319:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135141248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838258.102425:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135141248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838258.102433:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788838258.102541:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505930000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135141248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788838258.105365:0:93215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788838258.105718:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788838258.105744:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788838258.105754:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601528a00/0x88da08396ccc9ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9adf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838258.105764:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff601528a00/0x88da08396ccc9ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9adf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838258.105774:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788838258.105777:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627f9a800 from 55 10000000:01000000:0.0:1788838258.105780:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788838258.105916:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504626a00/0x88da08396ccc9ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838258.105925:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff504626a00/0x88da08396ccc9ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838258.105937:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff504626a00/0x88da08396ccc9ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838258.105965:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135141376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.106031:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838258.106066:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6413f6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838258.106132:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135141376 00000100:00100000:2.0:1788838258.106139:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135141376 00000100:00100000:2.0:1788838258.106183:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788838258.106192:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135141376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838258.106206:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838258.106220:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9ae6 expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.106264:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9ae6 expref: 22 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.106285:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9ae6 expref: 22 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.106294:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8400, rc 0) 00000100:00100000:2.0:1788838258.106341:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135141376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838258.106348:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788838258.106464:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135141376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838258.106479:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff504626a00/0x88da08396ccc9ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9aed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838258.106488:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff504626a00/0x88da08396ccc9ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9aed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838258.106552:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135141504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.106577:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838258.106598:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6413f6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838258.106638:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135141504 00000100:00100000:3.0:1788838258.106642:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135141504 00000100:00100000:3.0:1788838258.106673:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788838258.106680:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135141504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.107058:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135141504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.107084:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135141632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.107122:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838258.107164:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135141504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838258.107174:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788838258.107211:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6413f6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838258.110767:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135141632 00000100:00100000:3.0:1788838258.110782:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135141632 00000100:00100000:1.0:1788838258.111045:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788838258.111965:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135141632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.112142:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135141632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1087us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838258.112150:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788838258.112730:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135141632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.113454:0:93216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93216:1875729135141760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838258.113516:0:93216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.113559:0:93216:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838258.113622:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135141760 00000100:00100000:2.0:1788838258.113629:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135141760 00000100:00100000:2.0:1788838258.113676:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788838258.113685:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:93216:x1875729135141760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838258.113793:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:93216:x1875729135141760:12345-0@lo:502:llog_process_th.0 Request processed in 109us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838258.113836:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788838258.114046:0:93216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93216:1875729135141760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838258.114096:0:93216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93216:1875729135141888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838258.114130:0:93216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.114160:0:93216:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838258.114205:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135141888 00000100:00100000:2.0:1788838258.114209:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135141888 00000100:00100000:2.0:1788838258.114228:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788838258.114234:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:93216:x1875729135141888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838258.114315:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:93216:x1875729135141888:12345-0@lo:502:llog_process_th.0 Request processed in 80us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838258.114322:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788838258.114671:0:93216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:93216:1875729135141888:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788838258.114694:0:93216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1788838258.114920:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1788838258.114942:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788838258.114951:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504626a00/0x88da08396ccc9ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9aed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838258.114963:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff504626a00/0x88da08396ccc9ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9aed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838258.114971:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788838258.114974:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1788838258.114977:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788838258.115000:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504627400/0x88da08396ccc9af4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838258.115018:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff504627400/0x88da08396ccc9af4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838258.115028:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff504627400/0x88da08396ccc9af4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838258.115044:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135142016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.115078:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838258.115110:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ecc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788838258.115200:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135142016 00000100:00100000:2.0:1788838258.115205:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135142016 00000100:00100000:2.0:1788838258.115245:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788838258.115252:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135142016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838258.115262:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838258.115282:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9afb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9af4 expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.115304:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9af4 expref: 23 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.115314:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9af4 expref: 23 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.115322:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9200, rc 0) 00000100:00100000:2.0:1788838258.115361:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135142016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838258.115367:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788838258.115433:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135142016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838258.115447:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff504627400/0x88da08396ccc9af4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9afb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.115456:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff504627400/0x88da08396ccc9af4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9afb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838258.115506:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135142144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.115535:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.115560:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838258.115603:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135142144 00000100:00100000:0.0:1788838258.115608:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135142144 00000100:00100000:0.0:1788838258.115629:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788838258.115635:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135142144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.115756:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135142144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838258.115762:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788838258.115966:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135142144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.115993:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135142272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.116032:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.116050:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503476e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838258.116118:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135142272 00000100:00100000:0.0:1788838258.116122:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135142272 00000100:00100000:0.0:1788838258.116154:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788838258.116161:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135142272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.116242:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135142272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838258.116249:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788838258.116379:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135142272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838258.127128:0:93217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788838258.127374:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788838258.127407:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788838258.127418:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504627400/0x88da08396ccc9af4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9afb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.127449:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff504627400/0x88da08396ccc9af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9afb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838258.127460:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788838258.127463:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ff610244d28 from 1 10000000:01000000:1.0:1788838258.127466:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788838258.127502:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.127510:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.127521:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838258.127547:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135142400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.127614:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.127658:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5034763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838258.127715:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135142400 00000100:00100000:2.0:1788838258.127722:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135142400 00000100:00100000:2.0:1788838258.127767:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788838258.127776:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135142400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838258.127788:0:92476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838258.127841:0:92476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9b09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9b02 expref: -99 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.127864:0:92476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9b02 expref: 24 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.127875:0:92476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9b02 expref: 24 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.127895:0:92476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8a00, rc 0) 00000100:00100000:2.0:1788838258.127933:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135142400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838258.127940:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788838258.128159:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135142400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838258.128174:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9b09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.128182:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9b09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838258.128233:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135142528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838258.128259:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838258.128297:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5034763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838258.128366:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135142528 00000100:00100000:0.0:1788838258.128371:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135142528 00000100:00100000:0.0:1788838258.128409:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788838258.128416:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135142528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838258.128492:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135142528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (232us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788838258.128499:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788838258.128621:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135142528:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788838258.128645:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788838258.128652:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9b09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838258.128660:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9b09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838258.752111:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838259.476872:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.477029:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116457984 00000100:00100000:3.0:1788838259.477040:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116457984 00000100:00100000:3.0:1788838259.477124:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1365 00000100:00100000:3.0:1788838259.477135:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+6:71940:x1875729116457984:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:3.0:1788838259.477156:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.477175:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccc9b10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cee4 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.477243:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.477258:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.477283:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838259.477350:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838259.477356:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838259.477396:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.477425:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccc9b10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cee4 expref: 8 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.477442:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cee4 expref: 7 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.477450:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:3.0:1788838259.477453:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838259.477457:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529800, rc 0) 00000100:00100000:3.0:1788838259.477525:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71940:x1875729116457984:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 391us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.477532:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1365 00000100:00080000:0.0:1788838259.477588:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838259.480113:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838259.480322:0:92466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116458112 00000100:00100000:0.0:1788838259.480332:0:92466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116458112 00000100:00100000:0.0:1788838259.480393:0:92466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:0.0:1788838259.480404:0:92466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71940:x1875729116458112:12345-192.168.203.30@tcp:700:mkdir.0 00000100:00100000:0.0:1788838259.480501:0:92466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71940:x1875729116458112:12345-192.168.203.30@tcp:700:mkdir.0 Request processed in 97us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838259.480509:0:92466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:1.0:1788838259.482201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838259.482487:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116458368 00000100:00100000:2.0:1788838259.482495:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116458368 00000100:00100000:2.0:1788838259.482549:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1366 00000100:00100000:2.0:1788838259.482559:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71940:x1875729116458368:12345-192.168.203.30@tcp:36:mkdir.0 00010000:00010000:2.0:1788838259.482608:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838259.482636:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cee4 expref: 7 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.482652:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:2.0:1788838259.482656:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838259.482735:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.482749:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.482759:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.482774:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.482795:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.482870:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.486862:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.486886:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.486898:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838259.486915:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064c6d2f3 reply state 0000000086caa4c3 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.486926:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.486933:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff60574c600) 00010000:00010000:2.0:1788838259.486936:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838259.486940:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788838259.486945:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788838259.486955:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.486962:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.486968:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.486988:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.486995:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838259.486999:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.487008:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.487019:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:2.0:1788838259.487022:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838259.487025:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.487031:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9b1e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838259.487044:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064c6d2f3 reply state 0000000086caa4c3 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.487052:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.487058:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8ff60574c100) 00010000:00010000:2.0:1788838259.487060:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838259.487062:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788838259.487163:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71940:x1875729116458368:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 4602us (4965us total) trans 120259084292 rc 0/0 00000100:00100000:2.0:1788838259.487172:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1366 00000100:00100000:2.0:1788838259.489254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.489859:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116458496 00000100:00100000:3.0:1788838259.489877:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116458496 00000100:00100000:3.0:1788838259.489941:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1367 00000100:00100000:3.0:1788838259.489951:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71940:x1875729116458496:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:3.0:1788838259.489971:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.489990:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccc9b33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005ceeb expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.490050:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528c00/0x88da08396ccc9b3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.490078:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528c00/0x88da08396ccc9b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.490090:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528c00/0x88da08396ccc9b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838259.490130:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838259.490134:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838259.490154:0:66255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528c00/0x88da08396ccc9b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.490180:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccc9b33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceeb expref: 10 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.490199:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528c00/0x88da08396ccc9b3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceeb expref: 9 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.490208:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:3.0:1788838259.490211:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838259.490214:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528c00, rc 0) 00000100:00100000:3.0:1788838259.490285:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+9:71940:x1875729116458496:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 335us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.490292:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1367 00000100:00100000:1.0:1788838259.494348:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.494422:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116458752 00000100:00100000:3.0:1788838259.494432:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116458752 00000100:00100000:3.0:1788838259.494493:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1368 00000100:00100000:3.0:1788838259.494505:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+9:71940:x1875729116458752:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:3.0:1788838259.494524:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.494557:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cef2 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494629:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494643:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494653:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494666:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494672:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494677:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838259.494785:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788838259.494895:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494904:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494910:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494916:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494932:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838259.494936:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494943:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494955:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:3.0:1788838259.494958:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838259.494961:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494968:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494982:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494988:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494993:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.494998:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838259.495001:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.495006:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.495021:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8ff60574c100) 00010000:00010000:3.0:1788838259.495024:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838259.495027:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.495033:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.495067:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cef2 expref: 11 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.495077:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:3.0:1788838259.495079:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788838259.495083:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cef2 expref: 11 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.495093:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529000, rc 0) 00000100:00100000:3.0:1788838259.495155:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71940:x1875729116458752:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 653us (816us total) trans 120259084293 rc 301/301 00000100:00100000:3.0:1788838259.495163:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1368 00000100:00100000:3.0:1788838259.498887:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838259.498982:0:66265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116458880 00000100:00100000:0.0:1788838259.498992:0:66265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116458880 00000100:00100000:0.0:1788838259.499070:0:66265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:0.0:1788838259.499082:0:66265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:efc561ba-875e-4857-b79b-9bd7023bd57c+5:71940:x1875729116458880:12345-192.168.203.30@tcp:900:mkdir.0 00000100:00080000:2.0:1788838259.499143:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838259.499179:0:66265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:efc561ba-875e-4857-b79b-9bd7023bd57c+5:71940:x1875729116458880:12345-192.168.203.30@tcp:900:mkdir.0 Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838259.499187:0:66265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:2.0:1788838259.506601:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838259.506706:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116459136 00000100:00100000:1.0:1788838259.506716:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116459136 00000100:00100000:1.0:1788838259.506771:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:1.0:1788838259.506780:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502464450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71940:x1875729116459136:12345-192.168.203.30@tcp:35:mkdir.0 00000100:00100000:1.0:1788838259.508349:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502464450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+11:71940:x1875729116459136:12345-192.168.203.30@tcp:35:mkdir.0 Request processed in 1559us (1747us total) trans 120259084294 rc 0/0 00000100:00100000:1.0:1788838259.508361:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:2.0:1788838259.516625:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.516719:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116459392 00000100:00100000:3.0:1788838259.516731:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116459392 00000100:00100000:3.0:1788838259.516793:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1369 00000100:00100000:3.0:1788838259.516838:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+5:71940:x1875729116459392:12345-192.168.203.30@tcp:36:mkdir.0 00000100:00100000:3.0:1788838259.516974:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505931f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135142656:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788838259.517042:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838259.517080:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611ab83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.517153:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135142656 00000100:00100000:1.0:1788838259.517159:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135142656 00000100:00100000:1.0:1788838259.517197:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4198 00000100:00100000:1.0:1788838259.517204:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75504:x1875729135142656:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788838259.517290:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75504:x1875729135142656:12345-0@lo:1000:mdt00_004.0 Request processed in 86us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.517297:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4198 00000100:00100000:0.0:1788838259.517467:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505931f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135142656:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.517532:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135142784:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.517562:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.517588:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.517646:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135142784 00000100:00100000:1.0:1788838259.517651:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135142784 00000100:00100000:1.0:1788838259.517692:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4199 00000100:00100000:1.0:1788838259.517700:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75504:x1875729135142784:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788838259.517770:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75504:x1875729135142784:12345-0@lo:1000:mdt00_004.0 Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.517777:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4199 00000100:00100000:0.0:1788838259.517900:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135142784:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.517946:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135142912:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.517970:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.517994:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.518047:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135142912 00000100:00100000:1.0:1788838259.518052:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135142912 00000100:00100000:1.0:1788838259.518084:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4200 00000100:00100000:1.0:1788838259.518091:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75504:x1875729135142912:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788838259.518167:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75504:x1875729135142912:12345-0@lo:1000:mdt00_004.0 Request processed in 76us (194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838259.518173:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4200 00000100:00100000:0.0:1788838259.518245:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135142912:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788838259.518298:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.518308:0:75504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.518319:0:75504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838259.518331:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143040:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1788838259.518356:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.518380:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838259.518430:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135143040 00000100:00100000:3.0:1788838259.518433:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135143040 00000100:00100000:3.0:1788838259.518463:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4201 00000100:00100000:3.0:1788838259.518469:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75504:x1875729135143040:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1788838259.518479:0:37907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.518493:0:37907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b64 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9b5d expref: -99 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.518514:0:37907:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 2/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.518524:0:37907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b64 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9b5d expref: 9 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.518539:0:37907:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1788838259.518563:0:37907:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1788838259.518602:0:37907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b64 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9b5d expref: 9 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.518611:0:37907:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff60574c600) 00010000:00010000:3.0:1788838259.518614:0:37907:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838259.518617:0:37907:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b64 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9b5d expref: 9 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.518625:0:37907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529000, rc 0) 00000100:00100000:3.0:1788838259.518662:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143040:12345-0@lo:101:mdt00_004.0 Request processed in 192us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.518668:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4201 00000100:00100000:0.0:1788838259.519023:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143040:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1788838259.519036:0:75504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.519045:0:75504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788838259.521387:0:92470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084294 is committed 00000001:00080000:1.0:1788838259.521416:0:92470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084291 is committed 00010000:00010000:0.0:1788838259.521487:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521498:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521519:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521526:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838259.521530:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521538:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521555:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8ff60574c100) 00010000:00010000:0.0:1788838259.521558:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838259.521563:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521569:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9b25 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521590:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521597:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521602:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521606:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838259.521609:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521626:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521634:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff60574c600) 00010000:00010000:0.0:1788838259.521636:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838259.521643:0:3630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b64 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9b5d expref: 7 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521652:0:3630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b64 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x88da08396ccc9b5d expref: 7 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521660:0:3630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b64 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x88da08396ccc9b5d expref: 7 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.521695:0:3630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b64 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9b5d expref: 7 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838259.521709:0:3630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3630:1875729135143168:0@lo:105: 00000100:00100000:0.0:1788838259.521767:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.521894:0:3630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.524894:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135143168 00000100:00100000:1.0:1788838259.524910:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135143168 00000100:00100000:1.0:1788838259.525036:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788838259.525047:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3630:x1875729135143168:12345-0@lo:105: 00010000:00010000:1.0:1788838259.525063:0:6529:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.525073:0:6529:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.525083:0:6529:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.525092:0:6529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.525114:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.525123:0:6529:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.525153:0:6529:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8ff504626800) 00000100:00100000:1.0:1788838259.525236:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3630:x1875729135143168:12345-0@lo:105: Request processed in 191us (3468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.525243:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788838259.525330:0:3630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64700 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3630:1875729135143168:0@lo:105: 00010000:00010000:3.0:1788838259.525354:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.525362:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9b2c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.527368:0:75504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.527387:0:75504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838259.527415:0:75504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1788838259.527466:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.527484:0:75504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.527496:0:75504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838259.527520:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143296:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1788838259.527581:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.527617:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838259.527700:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135143296 00000100:00100000:3.0:1788838259.527707:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135143296 00000100:00100000:3.0:1788838259.527758:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4202 00000100:00100000:3.0:1788838259.527766:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75504:x1875729135143296:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1788838259.527781:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.527817:0:8472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b72 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9b6b expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.527842:0:8472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b72 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9b6b expref: 9 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.527855:0:8472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b72 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9b6b expref: 9 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.527863:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff8ff606722200) 00010000:00010000:3.0:1788838259.527866:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838259.527869:0:8472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529800, rc 0) 00000100:00100000:3.0:1788838259.527903:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143296:12345-0@lo:101:mdt00_004.0 Request processed in 138us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.527915:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4202 00000100:00100000:0.0:1788838259.527989:0:75504:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084291 gen 3 00000004:00080000:0.0:1788838259.527995:0:75504:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084291 committed transno 120259084291 00000100:00100000:0.0:1788838259.528015:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143296:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1788838259.528028:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.528039:0:75504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838259.528048:0:75504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:0.0:1788838259.528076:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143424:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.528100:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.528122:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838259.528159:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135143424 00000100:00100000:3.0:1788838259.528163:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135143424 00000100:00100000:3.0:1788838259.528191:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4203 00000100:00100000:3.0:1788838259.528196:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143424:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788838259.528254:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143424:12345-0@lo:1000:mdt00_004.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.528271:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4203 00000100:00100000:0.0:1788838259.528330:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143424:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.528366:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143552:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.528391:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.528410:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838259.528453:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135143552 00000100:00100000:3.0:1788838259.528456:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135143552 00000100:00100000:3.0:1788838259.528481:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4204 00000100:00100000:3.0:1788838259.528487:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143552:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788838259.528555:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143552:12345-0@lo:1000:mdt00_004.0 Request processed in 67us (163us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788838259.528561:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4204 00000100:00100000:0.0:1788838259.528614:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143552:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.528675:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143680:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.528697:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.528720:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838259.528756:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135143680 00000100:00100000:3.0:1788838259.528759:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135143680 00000100:00100000:3.0:1788838259.528785:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4205 00000100:00100000:3.0:1788838259.528790:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143680:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788838259.528854:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143680:12345-0@lo:1000:mdt00_004.0 Request processed in 64us (156us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788838259.528861:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4205 00000100:00100000:0.0:1788838259.528921:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143680:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.528959:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143808:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.528978:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.528997:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838259.529030:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135143808 00000100:00100000:3.0:1788838259.529033:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135143808 00000100:00100000:3.0:1788838259.529058:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4206 00000100:00100000:3.0:1788838259.529063:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143808:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788838259.529112:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143808:12345-0@lo:1000:mdt00_004.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.529118:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4206 00000100:00100000:0.0:1788838259.529167:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143808:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.529198:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143936:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.529218:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.529236:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838259.529280:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135143936 00000100:00100000:3.0:1788838259.529284:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135143936 00000100:00100000:3.0:1788838259.529314:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4207 00000100:00100000:3.0:1788838259.529320:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143936:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788838259.529374:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135143936:12345-0@lo:1000:mdt00_004.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.529380:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4207 00000100:00100000:0.0:1788838259.529436:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135143936:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.529467:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135144064:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788838259.529488:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.529508:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838259.529547:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135144064 00000100:00100000:3.0:1788838259.529551:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135144064 00000100:00100000:3.0:1788838259.529578:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4208 00000100:00100000:3.0:1788838259.529583:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135144064:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788838259.529627:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75504:x1875729135144064:12345-0@lo:1000:mdt00_004.0 Request processed in 44us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.529633:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4208 00000100:00100000:0.0:1788838259.529688:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:75504:1875729135144064:0@lo:1000:mdt00_004.0 00000040:00080000:0.0:1788838259.530118:0:75504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].7, 968 off42272 00000040:00080000:0.0:1788838259.530166:0:75504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].6, 1120 off40984 00000004:00080000:0.0:1788838259.530172:0:75504:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8ff611edb840 with version 16 00000004:00080000:3.0:1788838259.530234:0:75683:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8ff626ae9780 version 16 rpc_version 16 00000020:00100000:3.0:1788838259.530256:0:75683:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788838259.530274:0:75683:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8ff505930700 x1875729135144320/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838259.530290:0:75683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505930700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135144320:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788838259.530324:0:75683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838259.530349:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838259.530393:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135144320 00000100:00100000:0.0:1788838259.530397:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135144320 00000100:00100000:0.0:1788838259.530434:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4209 00000100:00100000:0.0:1788838259.530441:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75683:x1875729135144320:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788838259.530779:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75683:x1875729135144320:12345-0@lo:1000:osp_up0-1.0 Request processed in 338us (454us total) trans 120259084295 rc 0/0 00000100:00100000:0.0:1788838259.530786:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4209 00000100:00100000:0.0:1788838259.530850:0:75683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505930700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135144320:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1788838259.530905:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.530920:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.530932:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838259.530947:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000439dd38e reply state 0000000002427ac7 transno 77309411458 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.530958:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.530965:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff6082c8700) 00010000:00010000:0.0:1788838259.530968:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838259.530970:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788838259.530976:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00080000:0.0:1788838259.530982:0:75504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1788838259.530990:0:75504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.530999:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.531017:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.531039:0:75504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788838259.531044:0:75504:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1788838259.531049:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.531056:0:75504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838259.531126:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71940:x1875729116459392:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 14289us (14510us total) trans 77309411458 rc 0/0 00000100:00100000:0.0:1788838259.531133:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1369 00010000:00010000:0.0:1788838259.531876:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838259.531885:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.531895:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626800 already unused, calling callback (ffffffffc19f7ee0) 00010000:00010000:0.0:1788838259.531901:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838259.531910:0:6534:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.531942:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.531960:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788838259.532012:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788838259.532076:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.532084:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504626800/0x88da08396ccc9b5d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9b64 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.532102:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838259.532104:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838259.532106:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838259.537014:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135144448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838259.537091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838259.539081:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135144448 00000100:00100000:1.0:1788838259.539093:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135144448 00000100:00100000:1.0:1788838259.539193:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1788838259.539202:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3644:x1875729135144448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838259.539216:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838259.539241:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b64 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9b5d expref: 10 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.539270:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff60574c600) 00010000:00010000:1.0:1788838259.539281:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838259.539350:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3644:x1875729135144448:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.539357:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1788838259.539421:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135144448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838259.542639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.542901:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116459648 00000100:00100000:3.0:1788838259.542924:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116459648 00000100:00100000:3.0:1788838259.543013:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1370 00000100:00100000:3.0:1788838259.543024:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71940:x1875729116459648:12345-192.168.203.30@tcp:36:mkdir.0 00010000:00010000:3.0:1788838259.543087:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838259.543114:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528c00/0x88da08396ccc9b3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ceeb expref: 7 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.543132:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:3.0:1788838259.543137:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838259.543280:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:71940:x1875729116459648:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 258us (648us total) trans 0 rc -17/-17 00000100:00100000:3.0:1788838259.543288:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1370 00000100:00100000:2.0:1788838259.548002:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.548071:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116459776 00000100:00100000:3.0:1788838259.548081:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116459776 00000100:00100000:3.0:1788838259.548168:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1371 00000100:00100000:3.0:1788838259.548180:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+6:71940:x1875729116459776:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:3.0:1788838259.548200:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.548218:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cef9 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.548294:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccc9b87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.548309:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccc9b87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.548320:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccc9b87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838259.548383:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838259.548387:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838259.548407:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccc9b87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.548433:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccc9b80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cef9 expref: 8 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.548451:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccc9b87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cef9 expref: 7 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.548459:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:3.0:1788838259.548462:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838259.548466:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528800, rc 0) 00000100:00100000:3.0:1788838259.548532:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71940:x1875729116459776:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 354us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.548539:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1371 00000100:00100000:2.0:1788838259.554376:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.554572:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116459904 00000100:00100000:3.0:1788838259.554582:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116459904 00000100:00100000:3.0:1788838259.554635:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1372 00000100:00100000:3.0:1788838259.554646:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71940:x1875729116459904:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:3.0:1788838259.554666:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.554686:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf00 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.554758:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.554787:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.554825:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.554840:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9b9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.554848:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.554854:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.554916:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.554924:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.554930:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838259.554964:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838259.554968:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838259.554985:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.554996:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555012:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555019:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555025:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555033:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838259.555038:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555046:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555058:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:3.0:1788838259.555061:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838259.555066:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555072:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4000/0x88da08396ccc9b95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555086:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555093:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9b9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555099:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9b9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555110:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838259.555113:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9b9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555120:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9b9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555127:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8ff606722d00) 00010000:00010000:3.0:1788838259.555129:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838259.555131:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9b9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555136:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a4c00/0x88da08396ccc9b9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555173:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529000/0x88da08396ccc9b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf00 expref: 9 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555186:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf00 expref: 8 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.555194:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff606722c00) 00010000:00010000:3.0:1788838259.555197:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838259.555199:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5400, rc 0) 00000100:00100000:2.0:1788838259.555347:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71940:x1875729116459904:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 701us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838259.555355:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1372 00000100:00100000:1.0:1788838259.557877:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838259.557956:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116460160 00000100:00100000:0.0:1788838259.557965:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116460160 00000100:00100000:0.0:1788838259.558011:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1373 00000100:00100000:0.0:1788838259.558019:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71940:x1875729116460160:12345-192.168.203.30@tcp:36:mkdir.0 00000100:00100000:0.0:1788838259.558115:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135144576:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788838259.558159:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.558192:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611edbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.558246:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135144576 00000100:00100000:1.0:1788838259.558250:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135144576 00000100:00100000:1.0:1788838259.558303:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4210 00000100:00100000:1.0:1788838259.558309:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66254:x1875729135144576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.558381:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66254:x1875729135144576:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.558388:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4210 00000100:00100000:2.0:1788838259.558524:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135144576:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788838259.558572:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135144704:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788838259.558600:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838259.558628:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.558674:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135144704 00000100:00100000:1.0:1788838259.558678:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135144704 00000100:00100000:1.0:1788838259.558706:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4211 00000100:00100000:1.0:1788838259.558712:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66254:x1875729135144704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.558781:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66254:x1875729135144704:12345-0@lo:1000:mdt00_001.0 Request processed in 68us (180us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838259.558787:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4211 00000100:00100000:2.0:1788838259.558943:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135144704:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788838259.558991:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.559001:0:66254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.559010:0:66254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838259.559021:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135144832:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1788838259.559042:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838259.559063:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.559106:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135144832 00000100:00100000:1.0:1788838259.559110:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135144832 00000100:00100000:1.0:1788838259.559136:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4212 00000100:00100000:1.0:1788838259.559142:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66254:x1875729135144832:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788838259.559150:0:8472:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838259.559162:0:8472:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9bb1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9baa expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.559184:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf00 expref: 7 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.559193:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9bb1 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9baa expref: 10 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.559213:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf00 expref: 7 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.559234:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf00 expref: 7 pid: 66253 timeout: 3753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838259.559245:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8472:1875729135144960:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788838259.559313:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503d3c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.561446:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8472:1875729135144960:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788838259.561481:0:8472:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9bb1 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9baa expref: 10 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.561495:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff606722c00) 00010000:00010000:1.0:1788838259.561497:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838259.561501:0:8472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9bb1 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9baa expref: 10 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.561511:0:8472:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e600, rc 0) 00000100:00100000:1.0:1788838259.561563:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66254:x1875729135144832:12345-0@lo:101:mdt00_001.0 Request processed in 2421us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.561571:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4212 00000100:00100000:2.0:1788838259.561662:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135144832:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788838259.561680:0:66254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.561705:0:66254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838259.565693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838259.565830:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116460288 00000100:00100000:2.0:1788838259.565840:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116460288 00010000:00010000:2.0:1788838259.565883:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf00 expref: 8 pid: 66253 timeout: 3753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838259.565926:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2576 00000100:00100000:2.0:1788838259.565936:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2404:x1875729116460288:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838259.565951:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838259.565958:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf00 expref: 8 pid: 66253 timeout: 3753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.565971:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf00 expref: 8 pid: 66253 timeout: 3753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.565992:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5400/0x88da08396ccc9ba3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf00 expref: 8 pid: 66253 timeout: 3753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.566007:0:26219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff606722c00) 00010000:00010000:2.0:1788838259.566014:0:26219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9bb1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9baa expref: 9 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.566025:0:26219:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9bb1 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x88da08396ccc9baa expref: 9 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.566052:0:26219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9bb1 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x88da08396ccc9baa expref: 9 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.566085:0:26219:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9bb1 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9baa expref: 9 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838259.566100:0:26219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505ac4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:26219:1875729135145088:0@lo:105: 00000100:00100000:2.0:1788838259.566148:0:26219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838259.566183:0:26219:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788838259.566307:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135145088 00000100:00100000:0.0:1788838259.566312:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135145088 00000100:00100000:0.0:1788838259.566349:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788838259.566357:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:26219:x1875729135145088:12345-0@lo:105: 00010000:00010000:0.0:1788838259.566367:0:10414:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.566384:0:10414:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.566392:0:10414:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.566399:0:10414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.566406:0:10414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.566414:0:10414:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.566441:0:10414:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8ff626ab8200) 00000100:00100000:0.0:1788838259.566489:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:26219:x1875729135145088:12345-0@lo:105: Request processed in 132us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838259.566496:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788838259.566580:0:26219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505ac4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:26219:1875729135145088:0@lo:105: 00010000:00010000:1.0:1788838259.566598:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838259.566646:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116460288:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 711us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.566653:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2576 00010000:00010000:3.0:1788838259.566754:0:66254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.566765:0:66254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788838259.566792:0:66254:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1788838259.566851:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.566859:0:66254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.566868:0:66254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838259.566882:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505933800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145216:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1788838259.566914:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838259.566941:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff627125240 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.566998:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135145216 00000100:00100000:1.0:1788838259.567002:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135145216 00000100:00100000:1.0:1788838259.567040:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4213 00000100:00100000:1.0:1788838259.567048:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66254:x1875729135145216:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788838259.567065:0:37907:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838259.567080:0:37907:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccc9bbf lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9bb8 expref: -99 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.567098:0:37907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccc9bbf lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9bb8 expref: 11 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.567109:0:37907:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccc9bbf lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9bb8 expref: 11 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.567116:0:37907:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff8ff612676000) 00010000:00010000:1.0:1788838259.567119:0:37907:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838259.567121:0:37907:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e800, rc 0) 00000100:00100000:1.0:1788838259.567155:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145216:12345-0@lo:101:mdt00_001.0 Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.567161:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4213 00000100:00100000:1.0:1788838259.567188:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505933800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145216:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788838259.567200:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.567209:0:66254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788838259.567222:0:66254:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:1.0:1788838259.567255:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145344:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.567290:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838259.567303:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503d3ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838259.567356:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135145344 00000100:00100000:3.0:1788838259.567360:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135145344 00000100:00100000:3.0:1788838259.567387:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4214 00000100:00100000:3.0:1788838259.567393:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788838259.567446:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145344:12345-0@lo:1000:mdt00_001.0 Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.567453:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4214 00000100:00100000:1.0:1788838259.567512:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145344:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.567548:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145472:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.567572:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838259.567595:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503d3ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.567609:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135145472 00000100:00100000:1.0:1788838259.567612:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135145472 00000100:00100000:1.0:1788838259.567633:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4215 00000100:00100000:1.0:1788838259.567638:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.567697:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145472:12345-0@lo:1000:mdt00_001.0 Request processed in 58us (124us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838259.567704:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4215 00000100:00100000:1.0:1788838259.567725:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145472:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.567782:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145600:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.567822:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838259.567834:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503d3ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.567843:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135145600 00000100:00100000:1.0:1788838259.567846:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135145600 00000100:00100000:1.0:1788838259.567862:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4216 00000100:00100000:1.0:1788838259.567867:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.567910:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145600:12345-0@lo:1000:mdt00_001.0 Request processed in 42us (87us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838259.567916:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4216 00000100:00100000:1.0:1788838259.567935:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145600:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.567977:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145728:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.567997:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838259.568008:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503d3ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.568017:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135145728 00000100:00100000:1.0:1788838259.568020:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135145728 00000100:00100000:1.0:1788838259.568036:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4217 00000100:00100000:1.0:1788838259.568041:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.568080:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145728:12345-0@lo:1000:mdt00_001.0 Request processed in 38us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.568085:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4217 00000100:00100000:1.0:1788838259.568105:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145728:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.568134:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145856:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.568153:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838259.568164:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503d3ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.568173:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135145856 00000100:00100000:1.0:1788838259.568176:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135145856 00000100:00100000:1.0:1788838259.568191:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4218 00000100:00100000:1.0:1788838259.568196:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145856:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.568243:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145856:12345-0@lo:1000:mdt00_001.0 Request processed in 46us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.568249:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4218 00000100:00100000:1.0:1788838259.568285:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145856:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.568316:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145984:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.568335:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838259.568346:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503d3ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.568360:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135145984 00000100:00100000:1.0:1788838259.568363:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135145984 00000100:00100000:1.0:1788838259.568380:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4219 00000100:00100000:1.0:1788838259.568385:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145984:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788838259.568422:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66254:x1875729135145984:12345-0@lo:1000:mdt00_001.0 Request processed in 37us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.568428:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4219 00000100:00100000:1.0:1788838259.568447:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66254:1875729135145984:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1788838259.568841:0:66254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x2:0x0].8, 968 off43240 00000040:00080000:1.0:1788838259.568888:0:66254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x2:0x0].7, 1120 off42104 00000004:00080000:1.0:1788838259.568893:0:66254:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8ff503d3c300 with version 17 00000004:00080000:0.0:1788838259.569112:0:75683:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8ff626ae9780 version 17 rpc_version 17 00000020:00100000:0.0:1788838259.569132:0:75683:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788838259.569140:0:75683:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8ff639c5c380 x1875729135146240/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838259.569156:0:75683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135146240:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788838259.569187:0:75683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.569209:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504be3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838259.569334:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135146240 00000100:00100000:0.0:1788838259.569339:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135146240 00000100:00100000:0.0:1788838259.569379:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4220 00000100:00100000:0.0:1788838259.569385:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75683:x1875729135146240:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788838259.569664:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75683:x1875729135146240:12345-0@lo:1000:osp_up0-1.0 Request processed in 277us (474us total) trans 120259084296 rc 0/0 00000100:00100000:0.0:1788838259.569672:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4220 00000100:00100000:3.0:1788838259.569777:0:75683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135146240:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1788838259.569976:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.569992:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.570003:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838259.570021:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000606485a8 reply state 00000000b7c140cc transno 77309411459 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.570032:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.570040:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8c00) 00010000:00010000:0.0:1788838259.570043:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838259.570047:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788838259.570053:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00080000:0.0:1788838259.570061:0:66254:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1788838259.570069:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.570077:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.570091:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.570115:0:66254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788838259.570122:0:66254:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1788838259.570128:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.570135:0:66254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.570270:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838259.570278:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.570284:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8200 already unused, calling callback (ffffffffc19f7ee0) 00010000:00010000:2.0:1788838259.570290:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838259.570297:0:6535:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.570325:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.570331:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838259.570352:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.570359:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8200/0x88da08396ccc9baa lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9bb1 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.570384:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838259.570386:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838259.570388:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838259.570395:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838259.570407:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135146368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838259.570446:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838259.570485:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135146368 00000100:00100000:2.0:1788838259.570491:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135146368 00000100:00100000:2.0:1788838259.570526:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1788838259.570533:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3643:x1875729135146368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838259.570542:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838259.570558:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9bb1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9baa expref: 12 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.570571:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff606722c00) 00010000:00010000:2.0:1788838259.570578:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838259.570608:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3643:x1875729135146368:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838259.570614:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1788838259.570645:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135146368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838259.570699:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+9:71940:x1875729116460160:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 12678us (12827us total) trans 77309411459 rc 0/0 00000100:00100000:0.0:1788838259.570706:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1373 00000100:00100000:1.0:1788838259.624325:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838259.624410:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116460416 00000100:00100000:0.0:1788838259.624420:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116460416 00000100:00100000:0.0:1788838259.624484:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1374 00000100:00100000:0.0:1788838259.624493:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71941:x1875729116460416:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838259.624515:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838259.624536:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627600/0x88da08396ccc9bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf07 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624598:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624611:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624634:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624648:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624654:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624661:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624753:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccc9be2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624761:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccc9be2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624767:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccc9be2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838259.624838:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788838259.624843:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788838259.624882:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccc9be2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624896:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624903:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624919:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624926:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624932:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838259.624936:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624944:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624955:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:0.0:1788838259.624958:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838259.624962:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624968:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624982:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624988:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624994:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.624999:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838259.625006:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.625012:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.625019:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8ff6082c8200) 00010000:00010000:0.0:1788838259.625021:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838259.625024:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.625029:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.625058:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627600/0x88da08396ccc9bcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf07 expref: 9 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.625070:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccc9be2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf07 expref: 8 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.625077:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff6082c8600) 00010000:00010000:0.0:1788838259.625079:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788838259.625081:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626600, rc 0) 00000100:00100000:0.0:1788838259.625272:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71941:x1875729116460416:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 770us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838259.625279:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1374 00000100:00100000:2.0:1788838259.631273:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838259.631350:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116460544 00000100:00100000:0.0:1788838259.631360:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116460544 00000100:00100000:0.0:1788838259.631412:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1375 00000100:00100000:0.0:1788838259.631420:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71941:x1875729116460544:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1788838259.631452:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838259.631471:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627600/0x88da08396ccc9be9 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf0e expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.631530:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.631543:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.631554:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.631564:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.631573:0:75504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b72 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9b6b expref: 10 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.631583:0:75504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838259.631611:0:75504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b72 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9b6b expref: 10 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838259.631626:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:75504:1875729135146496:0@lo:104: 00000100:00100000:0.0:1788838259.631672:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838259.631771:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639570840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838259.633314:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135146496 00000100:00100000:1.0:1788838259.633325:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135146496 00000100:00100000:1.0:1788838259.633429:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788838259.633440:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:75504:x1875729135146496:12345-0@lo:104: 00010000:00010000:1.0:1788838259.633457:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.633552:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788838259.633558:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:75504:x1875729135146496:12345-0@lo:104: Request processed in 122us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838259.633565:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788838259.633644:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:75504:1875729135146496:0@lo:104: 00010000:00010000:2.0:1788838259.633667:0:75504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.633750:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838259.633757:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.633765:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627000 already unused, calling callback (ffffffffc19f7ee0) 00010000:00010000:3.0:1788838259.633770:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838259.633790:0:15289:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.633846:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.633854:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838259.633884:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.633892:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff504627000/0x88da08396ccc9b6b lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9b72 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.633912:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838259.633914:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838259.633916:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838259.633923:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838259.633935:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135146624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838259.633974:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838259.634010:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135146624 00000100:00100000:3.0:1788838259.634014:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135146624 00010000:00010000:3.0:1788838259.634033:0:10364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b72 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x88da08396ccc9b6b expref: 11 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838259.634056:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:3.0:1788838259.634063:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3646:x1875729135146624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838259.634074:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1788838259.635655:0:92470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084296 is committed 00010000:00010000:2.0:1788838259.635781:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529800/0x88da08396ccc9b72 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9b6b expref: 9 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.635832:0:10364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff8ff606722200) 00010000:00010000:2.0:1788838259.635838:0:10364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.635847:0:10364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.635855:0:10364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.635880:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838259.635943:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3646:x1875729135146624:12345-0@lo:103:ldlm_bl.0 Request processed in 1878us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838259.635951:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:3.0:1788838259.636077:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135146624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838259.636101:0:75504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.636109:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838259.636215:0:75504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:75504:1875729135146752:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788838259.636250:0:75504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838259.636281:0:75504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff627125240 going to sleep for 11 seconds 00000100:00100000:2.0:1788838259.636378:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135146752 00000100:00100000:2.0:1788838259.636384:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135146752 00000100:00100000:2.0:1788838259.636422:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4221 00000100:00100000:2.0:1788838259.636429:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:75504:x1875729135146752:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788838259.636492:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:75504:x1875729135146752:12345-0@lo:1000:mdt00_004.0 Request processed in 63us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838259.636498:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4221 00000100:00100000:2.0:1788838259.636521:0:75504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:75504:1875729135146752:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788838259.636556:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc9bfe lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636566:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc9bfe lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636586:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc9bfe lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838259.636607:0:75504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc9bfe lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636619:0:75504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636626:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636633:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636640:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636646:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838259.636649:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636656:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636665:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff6082c8600) 00010000:00010000:2.0:1788838259.636668:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838259.636671:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636676:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627e00/0x88da08396ccc9bf0 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636694:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636700:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636705:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636711:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838259.636714:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636720:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636727:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff8ff606722200) 00010000:00010000:2.0:1788838259.636730:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838259.636733:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636750:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626c00/0x88da08396ccc9bf7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636785:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627600/0x88da08396ccc9be9 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf0e expref: 10 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636816:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc9bfe lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf0e expref: 9 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.636832:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff60574c800) 00010000:00010000:2.0:1788838259.636835:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788838259.636837:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9600, rc 0) 00000100:00100000:2.0:1788838259.636886:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:71941:x1875729116460544:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 5466us (5632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838259.636892:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1375 00000100:00100000:2.0:1788838259.639642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.639726:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116460672 00000100:00100000:3.0:1788838259.639892:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116460672 00000100:00100000:3.0:1788838259.639980:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1376 00000100:00100000:3.0:1788838259.639990:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+9:71941:x1875729116460672:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788838259.640015:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.640033:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c05 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf15 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.640083:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc9c0c lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.640096:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc9c0c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.640107:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc9c0c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838259.640165:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1788838259.640179:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788838259.640212:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c05 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf15 expref: 11 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.640228:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc9c0c lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf15 expref: 10 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.640236:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff6082c8700) 00010000:00010000:3.0:1788838259.640239:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788838259.640242:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4600, rc 0) 00000100:00100000:3.0:1788838259.640306:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71941:x1875729116460672:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 318us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.640314:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1376 00000100:00100000:0.0:1788838259.648502:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.648584:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116460928 00000100:00100000:3.0:1788838259.648594:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116460928 00000100:00100000:3.0:1788838259.648646:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1377 00000100:00100000:3.0:1788838259.648655:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71941:x1875729116460928:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788838259.648674:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.648696:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4e00/0x88da08396ccc9c13 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf1c expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838259.648794:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788838259.648912:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4e00/0x88da08396ccc9c13 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf1c expref: 12 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.648927:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff627601100) 00010000:00010000:3.0:1788838259.648931:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788838259.648948:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4e00/0x88da08396ccc9c13 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf1c expref: 12 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.648966:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4e00, rc 0) 00000100:00100000:3.0:1788838259.649021:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+11:71941:x1875729116460928:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 367us (528us total) trans 77309411460 rc 301/301 00000100:00100000:3.0:1788838259.649028:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1377 00000100:00100000:2.0:1788838259.651854:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.651961:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116461184 00000100:00100000:3.0:1788838259.651969:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116461184 00000100:00100000:3.0:1788838259.652020:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1378 00000100:00100000:3.0:1788838259.652029:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+11:71941:x1875729116461184:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1788838259.652086:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838259.652110:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc9c0c lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf15 expref: 11 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.652126:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff6082c8700) 00010000:00010000:3.0:1788838259.652130:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838259.652158:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.652170:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.652178:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838259.652318:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f607df5 reply state 00000000772dc9ae transno 77309411461 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.652346:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.652351:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff6082c8700) 00010000:00010000:3.0:1788838259.652354:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1788838259.652356:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788838259.652363:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000100:00100000:3.0:1788838259.652426:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+12:71941:x1875729116461184:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 397us (579us total) trans 77309411461 rc 0/0 00000100:00100000:3.0:1788838259.652432:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1378 00000100:00100000:2.0:1788838259.654893:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838259.654977:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116461440 00000100:00100000:0.0:1788838259.654997:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116461440 00000100:00100000:0.0:1788838259.655052:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 241 00000100:00100000:0.0:1788838259.655061:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+12:71941:x1875729116461440:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1788838259.655275:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+13:71941:x1875729116461440:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 214us (388us total) trans 77309411462 rc 0/0 00000100:00100000:0.0:1788838259.655282:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 241 00000100:00100000:0.0:1788838259.690448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838259.690550:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116461568 00000100:00100000:1.0:1788838259.690560:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116461568 00000100:00100000:1.0:1788838259.690622:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1379 00000100:00100000:1.0:1788838259.690634:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+9:71942:x1875729116461568:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788838259.690671:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838259.690693:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9c28 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf23 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.690769:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.690783:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.690829:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.690844:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.690855:0:66254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccc9bbf lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9bb8 expref: 7 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.690863:0:66254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838259.690898:0:66254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccc9bbf lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9bb8 expref: 7 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838259.690912:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66254:1875729135146880:0@lo:104: 00000100:00100000:1.0:1788838259.690963:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838259.691006:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503d3ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838259.691081:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135146880 00000100:00100000:2.0:1788838259.691086:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135146880 00000100:00100000:2.0:1788838259.691116:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788838259.691124:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66254:x1875729135146880:12345-0@lo:104: 00010000:00010000:2.0:1788838259.691137:0:6530:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.691205:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788838259.691212:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66254:x1875729135146880:12345-0@lo:104: Request processed in 89us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838259.691218:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:2.0:1788838259.691238:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838259.691244:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.691252:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4c00 already unused, calling callback (ffffffffc19f7ee0) 00010000:00010000:2.0:1788838259.691257:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838259.691284:0:63563:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.691311:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.691317:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838259.691339:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.691346:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff5059a4c00/0x88da08396ccc9bb8 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9bbf expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.691365:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838259.691367:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838259.691369:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838259.691377:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838259.691389:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135147008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838259.691419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838259.691452:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135147008 00000100:00100000:2.0:1788838259.691456:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135147008 00010000:00010000:2.0:1788838259.691474:0:6531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccc9bbf lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x88da08396ccc9bb8 expref: 8 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838259.691498:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:2.0:1788838259.691505:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3645:x1875729135147008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838259.691515:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788838259.692026:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66254:1875729135146880:0@lo:104: 00010000:00010000:1.0:1788838259.692047:0:66254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.692319:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccc9bbf lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9bb8 expref: 8 pid: 37907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.692333:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff8ff612676000) 00010000:00010000:2.0:1788838259.692337:0:6531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.692344:0:6531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.692350:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.692379:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838259.692420:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135147008:12345-0@lo:103:ldlm_bl.0 Request processed in 916us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838259.692428:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:2.0:1788838259.692461:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135147008:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838259.692517:0:66254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.692525:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838259.692626:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505931f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66254:1875729135147136:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788838259.692663:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838259.692686:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff627125840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838259.692746:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135147136 00000100:00100000:2.0:1788838259.692752:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135147136 00000100:00100000:2.0:1788838259.692791:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4222 00000100:00100000:2.0:1788838259.692821:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66254:x1875729135147136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788838259.692892:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66254:x1875729135147136:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838259.692898:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4222 00000100:00100000:2.0:1788838259.692923:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505931f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66254:1875729135147136:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788838259.692967:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9c3d lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.692989:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9c3d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.692998:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9c3d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838259.693018:0:66254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9c3d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693031:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693037:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693042:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693048:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693053:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838259.693057:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693063:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693072:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff6082c8600) 00010000:00010000:2.0:1788838259.693074:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838259.693077:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693089:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396ccc9c2f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693099:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693104:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693109:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693114:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838259.693116:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693122:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693129:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff8ff612676000) 00010000:00010000:2.0:1788838259.693131:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838259.693134:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693139:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396ccc9c36 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693206:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccc9c28 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf23 expref: 11 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693237:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9c3d lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf23 expref: 10 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838259.693244:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff60574c700) 00010000:00010000:2.0:1788838259.693247:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788838259.693249:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9e00, rc 0) 00000100:00100000:2.0:1788838259.693385:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71942:x1875729116461568:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 2751us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838259.693392:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1379 00000100:00100000:2.0:1788838259.697639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.697720:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116461696 00000100:00100000:3.0:1788838259.697730:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116461696 00000100:00100000:3.0:1788838259.697833:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1380 00000100:00100000:3.0:1788838259.697843:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+13:71942:x1875729116461696:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788838259.697868:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.697890:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc9c44 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf2a expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.697952:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4e00/0x88da08396ccc9c4b lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.697981:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4e00/0x88da08396ccc9c4b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.697992:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4e00/0x88da08396ccc9c4b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838259.698040:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788838259.698044:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788838259.698079:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc9c44 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf2a expref: 15 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.698098:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4e00/0x88da08396ccc9c4b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf2a expref: 14 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.698106:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8c00) 00010000:00010000:3.0:1788838259.698109:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788838259.698113:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4e00, rc 0) 00000100:00100000:3.0:1788838259.698177:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+14:71942:x1875729116461696:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 335us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838259.698184:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1380 00000100:00100000:2.0:1788838259.707447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.707537:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116461952 00000100:00100000:3.0:1788838259.707547:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116461952 00000100:00100000:3.0:1788838259.707605:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1381 00000100:00100000:3.0:1788838259.707615:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+14:71942:x1875729116461952:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788838259.707636:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838259.707660:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc9c52 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf31 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838259.707791:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788838259.707944:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc9c52 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf31 expref: 16 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.707959:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff627601100) 00010000:00010000:3.0:1788838259.707963:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788838259.707968:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4600/0x88da08396ccc9c52 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf31 expref: 16 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.707986:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4600, rc 0) 00000100:00100000:3.0:1788838259.708045:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+15:71942:x1875729116461952:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 431us (608us total) trans 77309411463 rc 301/301 00000100:00100000:3.0:1788838259.708052:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1381 00000100:00100000:0.0:1788838259.713388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.713474:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116462208 00000100:00100000:3.0:1788838259.713486:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116462208 00000100:00100000:3.0:1788838259.713548:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1382 00000100:00100000:3.0:1788838259.713559:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+15:71942:x1875729116462208:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1788838259.713620:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838259.713646:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4e00/0x88da08396ccc9c4b lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf2a expref: 15 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.713666:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8c00) 00010000:00010000:3.0:1788838259.713671:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838259.713692:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.713723:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.713734:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838259.713932:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c6f7b35 reply state 000000003d3293f8 transno 77309411464 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.713945:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838259.713952:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8c00) 00010000:00010000:3.0:1788838259.713954:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1788838259.713958:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788838259.713965:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1788838259.714033:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+16:71942:x1875729116462208:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 476us (656us total) trans 77309411464 rc 0/0 00000100:00100000:3.0:1788838259.714040:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1382 00000100:00100000:0.0:1788838259.716600:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838259.716680:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116462464 00000100:00100000:3.0:1788838259.716689:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116462464 00000100:00100000:3.0:1788838259.716750:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 242 00000100:00100000:3.0:1788838259.716762:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+16:71942:x1875729116462464:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788838259.717012:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+17:71942:x1875729116462464:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 251us (419us total) trans 77309411465 rc 0/0 00000100:00100000:3.0:1788838259.717020:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 242 00010000:00010000:0.0:1788838259.774299:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788838260.433783:0:75678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411465 is committed 00010000:00010000:3.0:1788838260.435959:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.435987:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.435994:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.435999:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838260.436004:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436011:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436030:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff6082c8700) 00010000:00010000:3.0:1788838260.436033:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838260.436038:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436044:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627a00/0x88da08396ccc9b79 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436063:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436070:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436076:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436081:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838260.436089:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436096:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436104:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8c00) 00010000:00010000:3.0:1788838260.436107:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838260.436109:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436115:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9bc6 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436126:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436132:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436137:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436142:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838260.436144:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436150:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436157:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff6082c8700) 00010000:00010000:3.0:1788838260.436159:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838260.436167:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436174:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9c21 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436194:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436200:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436206:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436210:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838260.436213:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436219:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436227:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8c00) 00010000:00010000:3.0:1788838260.436230:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838260.436233:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838260.436238:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9c60 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838260.544197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838260.544283:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116462592 00000100:00100000:3.0:1788838260.544294:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116462592 00000100:00100000:3.0:1788838260.544358:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1383 00000100:00100000:3.0:1788838260.544381:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71951:x1875729116462592:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838260.544418:0:76060:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445003264 avail 1298763776 00000100:00100000:3.0:1788838260.544493:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71951:x1875729116462592:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 112us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838260.544501:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1383 00000100:00100000:1.0:1788838260.547793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838260.548631:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116462720 00000100:00100000:3.0:1788838260.548643:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116462720 00000100:00100000:3.0:1788838260.548707:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1384 00000100:00100000:3.0:1788838260.548717:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+5:71951:x1875729116462720:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838260.548756:0:66253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:3.0:1788838260.548834:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+5:71951:x1875729116462720:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 118us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838260.548841:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1384 00000100:00100000:1.0:1788838260.558996:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838260.559064:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116462848 00000100:00100000:2.0:1788838260.559078:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116462848 00000100:00100000:2.0:1788838260.559133:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5977 00000100:00100000:2.0:1788838260.559142:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2403:x1875729116462848:12345-192.168.203.30@tcp:8:lfs.0 00010000:00080000:2.0:1788838260.559173:0:26218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp t0 exp 0000000000000000 cur 3654 last 0 00000020:00000080:2.0:1788838260.559202:0:26218:0:(genops.c:1385:class_connect()) connect: client efc561ba-875e-4857-b79b-9bd7023bd57c, cookie 0x88da08396ccc9c67 00002000:00100000:2.0:1788838260.559214:0:26218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli efc561ba-875e-4857-b79b-9bd7023bd57c/ffff8ff63f78f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788838260.559230:0:26218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788838260.559320:0:26218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788838260.559361:0:26218:0:(import.c:65:import_set_state_nolock()) ffff8ff63f78e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838260.559433:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116462848:12345-192.168.203.30@tcp:8:lfs.0 Request processed in 289us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.559453:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5977 00000100:00100000:3.0:1788838260.577399:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838260.577468:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116462976 00000100:00100000:0.0:1788838260.577479:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116462976 00000100:00080000:2.0:1788838260.577544:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838260.577560:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2102 00000100:00100000:0.0:1788838260.577569:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+6:71951:x1875729116462976:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:0.0:1788838260.577594:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838260.577683:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+6:71951:x1875729116462976:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 106us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838260.577690:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2102 00000100:00100000:0.0:1788838260.586100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838260.586169:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116463104 00000100:00100000:1.0:1788838260.586179:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116463104 00000100:00100000:1.0:1788838260.586265:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2103 00000100:00100000:1.0:1788838260.586277:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+5:71951:x1875729116463104:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:1.0:1788838260.586308:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838260.586374:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+5:71951:x1875729116463104:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 99us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838260.586384:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2103 00000100:00080000:0.0:1788838260.586646:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838260.605137:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135147392:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605278:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135147904:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605308:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605327:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135148416:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605350:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605377:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788838260.605383:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135147264:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605439:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135147776:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605481:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135148288:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605501:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605518:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135148800:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605537:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605567:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135147520:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605606:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135148032:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605629:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605648:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135148544:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605668:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605706:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788838260.605712:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135147648:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605744:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605759:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135148160:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605778:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605793:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135148672:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.605839:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.605874:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135147904 00000100:00100000:2.0:1788838260.605883:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135147904 00000100:00100000:2.0:1788838260.605929:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135148416 00000100:00100000:2.0:1788838260.605932:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135148416 00000100:00100000:2.0:1788838260.605953:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4223 00000100:00100000:2.0:1788838260.605962:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135147904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606020:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135147904:12345-0@lo:400:kworker.0 Request processed in 59us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606028:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4223 00000100:00100000:2.0:1788838260.606044:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4224 00000100:00100000:2.0:1788838260.606050:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135148416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606077:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135148416:12345-0@lo:400:kworker.0 Request processed in 27us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606083:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4224 00000100:00100000:2.0:1788838260.606103:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135147392 00000100:00100000:2.0:1788838260.606106:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135147392 00000100:00100000:2.0:1788838260.606131:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135147776 00000100:00100000:2.0:1788838260.606134:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135147776 00000100:00100000:2.0:1788838260.606144:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135148288 00000100:00100000:2.0:1788838260.606147:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135148288 00000100:00100000:2.0:1788838260.606156:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135148800 00000100:00100000:2.0:1788838260.606165:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135148800 00000100:00100000:2.0:1788838260.606182:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135147520 00000100:00100000:2.0:1788838260.606184:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135147520 00000100:00100000:2.0:1788838260.606195:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135147648 00000100:00100000:2.0:1788838260.606197:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135147648 00000100:00100000:2.0:1788838260.606210:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1788838260.606216:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135147392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606249:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135147392:12345-0@lo:400:kworker.0 Request processed in 33us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606266:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1788838260.606279:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1788838260.606285:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135147776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606312:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135147776:12345-0@lo:400:kworker.0 Request processed in 27us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606318:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1788838260.606332:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1788838260.606339:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135148288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606365:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135148288:12345-0@lo:400:kworker.0 Request processed in 27us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606371:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1788838260.606382:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1788838260.606389:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135148800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606415:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135148800:12345-0@lo:400:kworker.0 Request processed in 28us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606421:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1788838260.606431:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1788838260.606439:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135147520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606482:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135147520:12345-0@lo:400:kworker.0 Request processed in 44us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606489:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1788838260.606503:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1788838260.606509:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135147648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606536:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135147648:12345-0@lo:400:kworker.0 Request processed in 27us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606541:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1788838260.606573:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135148032 00000100:00100000:2.0:1788838260.606577:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135148032 00000100:00100000:2.0:1788838260.606602:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135148544 00000100:00100000:2.0:1788838260.606605:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135148544 00000100:00100000:2.0:1788838260.606622:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135148160 00000100:00100000:2.0:1788838260.606625:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135148160 00000100:00100000:2.0:1788838260.606643:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135148672 00000100:00100000:2.0:1788838260.606646:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135148672 00000100:00100000:2.0:1788838260.606664:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1788838260.606669:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135148032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606701:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135148032:12345-0@lo:400:kworker.0 Request processed in 31us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606706:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1788838260.606717:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1788838260.606723:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135148544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606752:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135148544:12345-0@lo:400:kworker.0 Request processed in 28us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606760:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1788838260.606774:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1788838260.606790:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135148160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606854:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135148160:12345-0@lo:400:kworker.0 Request processed in 64us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606861:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1788838260.606872:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:2.0:1788838260.606879:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135148672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.606913:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135148672:12345-0@lo:400:kworker.0 Request processed in 34us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.606920:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00080000:2.0:1788838260.606939:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838260.606943:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838260.606946:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838260.606948:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838260.606988:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135147648:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607000:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135148160:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607010:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135148672:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607020:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135147520:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607030:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135148032:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607039:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135148544:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607084:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135147776:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607094:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135148288:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607104:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135148800:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607126:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135147392:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607134:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000004:00080000:2.0:1788838260.607139:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084295 committed transno 120259084296 00000020:00080000:2.0:1788838260.607144:0:3644:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8ff611edb000 refcount 2 committed 0 result 0 batchid 73014444095 00000020:00080000:2.0:1788838260.607148:0:3644:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ff611ac3e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8ff611edb840 00000020:00080000:2.0:1788838260.607151:0:3644:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].6 00000020:00080000:2.0:1788838260.607153:0:3644:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ff611ac3800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ff62bc12200 00000020:00080000:2.0:1788838260.607156:0:3644:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].7 00000004:00080000:2.0:1788838260.607176:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084296 committed transno 120259084296 00000020:00080000:2.0:1788838260.607180:0:3644:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8ff503d3c3c0 refcount 2 committed 0 result 0 batchid 73014444096 00000020:00080000:2.0:1788838260.607183:0:3644:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ff639734900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8ff503d3c300 00000020:00080000:2.0:1788838260.607186:0:3644:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x2:0x0].7 00000020:00080000:2.0:1788838260.607188:0:3644:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ff639734000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ff64042ea00 00000020:00080000:2.0:1788838260.607190:0:3644:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x2:0x0].8 00000100:00100000:2.0:1788838260.607202:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135147904:0@lo:400:kworker.0 00000100:00100000:2.0:1788838260.607216:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135148416:0@lo:400:kworker.0 00000020:00080000:2.0:1788838260.607242:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444096 committed batchid 73014444094 00000020:00080000:2.0:1788838260.607322:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444094 00000100:00100000:1.0:1788838260.607996:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135147264 00000100:00100000:1.0:1788838260.608004:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135147264 00000100:00100000:1.0:1788838260.608053:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788838260.608062:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135147264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838260.608123:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135147264:12345-0@lo:400:kworker.0 Request processed in 63us (2709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838260.608130:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788838260.608176:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135147264:0@lo:400:kworker.0 00000100:00100000:1.0:1788838260.608779:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838260.608793:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135148928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838260.608883:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838260.608918:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135148928 00000100:00100000:1.0:1788838260.608922:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135148928 00000100:00100000:1.0:1788838260.608968:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4225 00000100:00100000:1.0:1788838260.608976:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135148928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838260.609011:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445003264 avail 1298763776 00000100:00100000:1.0:1788838260.609051:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135148928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838260.609058:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4225 00000100:00100000:1.0:1788838260.609096:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135148928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838260.611111:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135149056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838260.611174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838260.612331:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135149056 00000100:00100000:2.0:1788838260.612343:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135149056 00000100:00100000:2.0:1788838260.612393:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4226 00000100:00100000:2.0:1788838260.612404:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135149056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838260.612433:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:2.0:1788838260.612501:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135149056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.612514:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4226 00000100:00100000:2.0:1788838260.612652:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135149056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838260.612991:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838260.613001:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135149184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838260.613040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838260.613071:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135149184 00000100:00100000:3.0:1788838260.613075:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135149184 00000100:00100000:3.0:1788838260.613103:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:3.0:1788838260.613110:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135149184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838260.613124:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838260.613157:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135149184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838260.613172:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:3.0:1788838260.613205:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135149184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838260.662622:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838260.670529:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116463360 00000100:00100000:2.0:1788838260.670543:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116463360 00000100:00100000:2.0:1788838260.670599:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1385 00000100:00100000:2.0:1788838260.670609:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71958:x1875729116463360:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00010000:2.0:1788838260.670662:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838260.670702:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccc9b87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cef9 expref: 10 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.670848:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:2.0:1788838260.670854:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838260.670910:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.670925:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.670935:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.670950:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.670957:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.670964:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.671842:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.671855:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.671860:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.671866:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.671871:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838260.671875:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.671882:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.671893:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:2.0:1788838260.671896:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838260.671899:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.671905:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838260.671917:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019c40368 reply state 000000003882d998 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.671927:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.671945:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50b021f00) 00010000:00010000:2.0:1788838260.671947:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838260.671950:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838260.672056:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+11:71958:x1875729116463360:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 1447us (9442us total) trans 120259084297 rc 0/0 00000100:00100000:2.0:1788838260.672064:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1385 00000100:00100000:1.0:1788838260.708684:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838260.708762:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116463488 00000100:00100000:2.0:1788838260.708773:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116463488 00000100:00100000:2.0:1788838260.708862:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1386 00000100:00100000:2.0:1788838260.708872:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:71961:x1875729116463488:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1788838260.708894:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838260.708913:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf38 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.708970:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc9c83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.708984:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc9c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.708997:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc9c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838260.709036:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838260.709039:0:67312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838260.709055:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc9c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.709076:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf38 expref: 13 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.709106:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc9c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf38 expref: 12 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.709115:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:2.0:1788838260.709118:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838260.709121:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8800, rc 0) 00000100:00100000:2.0:1788838260.709165:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+12:71961:x1875729116463488:12345-192.168.203.30@tcp:101:rm.0 Request processed in 296us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838260.709172:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1386 00000100:00100000:0.0:1788838260.721422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838260.721541:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116463616 00000100:00100000:1.0:1788838260.721552:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116463616 00000100:00100000:1.0:1788838260.721623:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1387 00000100:00100000:1.0:1788838260.721633:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+12:71961:x1875729116463616:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:1.0:1788838260.721655:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838260.721674:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8000/0x88da08396ccc9c8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf3f expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.721736:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.721752:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.721763:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.721774:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396ccc9c98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.721780:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396ccc9c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.721851:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396ccc9c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.721928:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396ccc9c9f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.721936:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396ccc9c9f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.721944:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396ccc9c9f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838260.721986:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x3:0x0]: returning size 0 00000004:00200000:1.0:1788838260.721991:0:75504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788838260.722012:0:75504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396ccc9c9f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722023:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396ccc9c9f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722032:0:75504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722038:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722044:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722049:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722063:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838260.722067:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722075:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722086:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:1.0:1788838260.722101:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838260.722106:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722112:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8e00/0x88da08396ccc9c91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722126:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396ccc9c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722131:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396ccc9c98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722137:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396ccc9c98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722142:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838260.722144:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396ccc9c98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722150:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396ccc9c98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722168:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50b021f00) 00010000:00010000:1.0:1788838260.722170:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838260.722174:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396ccc9c98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722180:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396ccc9c98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722204:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8000/0x88da08396ccc9c8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf3f expref: 14 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722217:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396ccc9c9f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf3f expref: 13 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.722223:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff8ff60b5cf600) 00010000:00010000:1.0:1788838260.722225:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838260.722228:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e9000, rc 0) 00000100:00100000:1.0:1788838260.722300:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+13:71961:x1875729116463616:12345-192.168.203.30@tcp:101:rm.0 Request processed in 669us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838260.722307:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1387 00000100:00100000:0.0:1788838260.727329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838260.727416:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116463872 00000100:00100000:2.0:1788838260.727429:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116463872 00000100:00100000:2.0:1788838260.727499:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1388 00000100:00100000:2.0:1788838260.727509:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+13:71961:x1875729116463872:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1788838260.727569:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788838260.727597:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396ccc9c9f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf3f expref: 13 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.727618:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff8ff60b5cf600) 00010000:00010000:2.0:1788838260.727634:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc9c83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf38 expref: 12 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.727645:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:2.0:1788838260.727648:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838260.727670:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.727702:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.727712:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.727725:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.727733:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.727739:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.727869:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cb4 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.727878:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cb4 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.727886:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cb4 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728064:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728074:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728081:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728098:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728105:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728111:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728125:0:66254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838260.728143:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cb4 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728148:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cb4 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728154:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cb4 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728159:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838260.728163:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cb4 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728170:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cb4 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728179:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff8ff50b021600) 00010000:00010000:2.0:1788838260.728181:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788838260.728184:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cb4 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728200:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cb4 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728216:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728221:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728226:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728232:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728237:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838260.728240:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728246:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728264:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:2.0:1788838260.728267:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838260.728270:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728276:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9ca6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838260.728285:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000182046ae reply state 000000005472c672 transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728306:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838260.728312:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50b021f00) 00010000:00010000:2.0:1788838260.728315:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838260.728317:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838260.728390:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+13:71961:x1875729116463872:12345-192.168.203.30@tcp:36:rm.0 Request processed in 881us (1071us total) trans 120259084298 rc 0/0 00000100:00100000:2.0:1788838260.728398:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1388 00010000:00010000:1.0:1788838260.728668:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838260.728676:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.728683:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838260.728686:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.728704:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.728713:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff8ff50b021600) 00010000:00010000:1.0:1788838260.728715:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788838260.728718:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.728723:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8e00/0x88da08396ccc9cbb lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838260.728738:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838260.728739:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838260.728741:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838260.802382:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838261.118632:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135149312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838261.118700:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838261.122971:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135149312 00000100:00100000:2.0:1788838261.122986:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135149312 00000100:00100000:2.0:1788838261.123056:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:2.0:1788838261.123065:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135149312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788838261.123092:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838261.123171:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135149312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (4470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838261.123178:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:2.0:1788838261.123230:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135149312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788838261.823832:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838261.832346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838261.832398:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838261.832533:0:92476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116464000 00000100:00100000:2.0:1788838261.832543:0:92476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116464000 00000100:00100000:2.0:1788838261.832592:0:92476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 176 00000100:00100000:2.0:1788838261.832602:0:92476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116464000:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838261.832668:0:92476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116464000:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838261.832676:0:92476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 176 00000100:00100000:0.0:1788838261.832894:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116464128 00000100:00100000:0.0:1788838261.832899:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116464128 00000100:00100000:0.0:1788838261.832950:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1369 00000100:00100000:0.0:1788838261.832965:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+13:2407:x1875729116464128:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000080:0.0:1788838261.832989:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff610ad0700 x1875729116464128/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:162/0 lens 224/224 e 0 to 0 dl 1788838272 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838261.833020:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+13:2407:x1875729116464128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 57us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838261.833027:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1369 00000100:00080000:2.0:1788838261.833079:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838261.836194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838261.836241:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838261.836284:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838261.836313:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116464384 00000100:00100000:3.0:1788838261.836322:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116464384 00000100:00100000:3.0:1788838261.836368:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116464512 00000100:00100000:3.0:1788838261.836371:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116464512 00000100:00100000:3.0:1788838261.836404:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2670 00000100:00100000:3.0:1788838261.836412:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2406:x1875729116464384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838261.836473:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2406:x1875729116464384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 62us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838261.836480:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2670 00000100:00100000:3.0:1788838261.836496:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2671 00000100:00100000:3.0:1788838261.836502:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116464512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838261.836524:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116464512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838261.836531:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2671 00000100:00100000:2.0:1788838261.836631:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116464256 00000100:00100000:2.0:1788838261.836635:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116464256 00000100:00100000:2.0:1788838261.836683:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1370 00000100:00100000:2.0:1788838261.836689:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116464256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838261.836718:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116464256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838261.836724:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1370 00000100:00080000:3.0:1788838261.839449:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838262.144301:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff610ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135149440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838262.144374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838262.144957:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135149440 00000100:00100000:3.0:1788838262.144967:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135149440 00000100:00100000:3.0:1788838262.145042:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1788838262.145053:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135149440:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838262.145421:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838262.145434:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135149568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838262.145478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788838262.145577:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838262.145639:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135149440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 588us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838262.145646:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1788838262.149357:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135149568 00000100:00100000:3.0:1788838262.149372:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135149568 00000100:00100000:3.0:1788838262.149423:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:3.0:1788838262.149435:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135149568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838262.149467:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838262.149556:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135149568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (4078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838262.149563:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00080000:3.0:1788838262.149593:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838262.149597:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838262.149663:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135149568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838262.149874:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff610ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135149440:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788838262.847133:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838263.870440:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838264.894382:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838265.725040:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135149696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838265.725126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838265.725181:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135149696 00000100:00100000:1.0:1788838265.725188:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135149696 00000100:00100000:1.0:1788838265.725239:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4227 00000100:00100000:1.0:1788838265.725249:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135149696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838265.725294:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445003264 avail 1298763776 00010000:00000080:1.0:1788838265.725311:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff639542680 x1875729135149696/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 224/368 e 0 to 0 dl 1788838276 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838265.725354:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135149696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838265.725361:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4227 00000100:00100000:1.0:1788838265.725631:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135149696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838265.726025:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135149824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838265.726065:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838265.726102:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135149824 00000100:00100000:2.0:1788838265.726108:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135149824 00000100:00100000:2.0:1788838265.726135:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4228 00000100:00100000:2.0:1788838265.726142:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135149824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838265.726161:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:2.0:1788838265.726196:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135149824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.726203:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4228 00000100:00100000:2.0:1788838265.726242:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135149824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838265.727327:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135149952:0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.727376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838265.727406:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135150464:0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.727431:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838265.727445:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135150976:0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.727465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838265.727486:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788838265.727492:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135150336:0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.727512:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838265.727528:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135150848:0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.727549:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838265.727579:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135150976 00000100:00100000:1.0:1788838265.727585:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135150976 00000100:00100000:1.0:1788838265.727625:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:1.0:1788838265.727632:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135150976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.727673:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135150976:12345-0@lo:400:kworker.0 Request processed in 42us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.728208:0:92477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135149952 00000100:00100000:2.0:1788838265.728214:0:92477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135149952 00000100:00100000:2.0:1788838265.728255:0:92477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788838265.728271:0:92477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135149952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.728312:0:92477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135149952:12345-0@lo:400:kworker.0 Request processed in 42us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.728319:0:92477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788838265.728350:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135150464 00000100:00100000:2.0:1788838265.728354:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135150464 00000100:00100000:2.0:1788838265.728382:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135150336 00000100:00100000:2.0:1788838265.728386:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135150336 00000100:00100000:2.0:1788838265.728402:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135150848 00000100:00100000:2.0:1788838265.728405:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135150848 00000100:00100000:2.0:1788838265.728422:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1788838265.728428:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135150464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.728461:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135150464:12345-0@lo:400:kworker.0 Request processed in 33us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.728467:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1788838265.728480:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1788838265.728487:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135150336:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838265.728499:0:66254:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bd6df80 x1875729135150336/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:166/0 lens 224/224 e 0 to 0 dl 1788838276 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838265.728526:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135150336:12345-0@lo:400:kworker.0 Request processed in 41us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.728531:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1788838265.728543:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1788838265.728549:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135150848:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838265.728559:0:66254:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61fcd1f80 x1875729135150848/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:166/0 lens 224/224 e 0 to 0 dl 1788838276 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838265.728601:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135150848:12345-0@lo:400:kworker.0 Request processed in 51us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.728607:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:0.0:1788838265.729190:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135150080:0@lo:400:kworker.0 00000100:00100000:0.0:1788838265.729238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838265.729265:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135150592:0@lo:400:kworker.0 00000100:00100000:0.0:1788838265.729289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838265.729307:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135151104:0@lo:400:kworker.0 00000100:00100000:0.0:1788838265.729324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838265.729343:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788838265.729349:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135150208:0@lo:400:kworker.0 00000100:00100000:0.0:1788838265.729371:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838265.729382:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135150720:0@lo:400:kworker.0 00000100:00100000:0.0:1788838265.729398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838265.729409:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135151232:0@lo:400:kworker.0 00000100:00100000:0.0:1788838265.729424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1788838265.730594:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000100:00100000:2.0:1788838265.731325:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135150592 00000100:00100000:2.0:1788838265.731336:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135150592 00000100:00100000:2.0:1788838265.731385:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135151104 00000100:00100000:2.0:1788838265.731389:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135151104 00000100:00100000:2.0:1788838265.731411:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135150720 00000100:00100000:2.0:1788838265.731414:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135150720 00000100:00100000:2.0:1788838265.731438:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1788838265.731447:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135150592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.731531:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135150592:12345-0@lo:400:kworker.0 Request processed in 84us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.731538:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1788838265.731554:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:2.0:1788838265.731560:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135151104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.731590:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135151104:12345-0@lo:400:kworker.0 Request processed in 31us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.731596:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:2.0:1788838265.731607:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:2.0:1788838265.731612:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135150720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.731638:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135150720:12345-0@lo:400:kworker.0 Request processed in 26us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.731644:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:2.0:1788838265.731663:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135150080 00000100:00100000:2.0:1788838265.731667:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135150080 00000100:00100000:2.0:1788838265.731702:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135150208 00000100:00100000:2.0:1788838265.731706:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135150208 00000100:00100000:2.0:1788838265.731719:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135151232 00000100:00100000:2.0:1788838265.731722:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135151232 00000100:00100000:2.0:1788838265.731734:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1788838265.731740:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135150080:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838265.731754:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640668a80 x1875729135150080/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:166/0 lens 224/224 e 0 to 0 dl 1788838276 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838265.731787:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135150080:12345-0@lo:400:kworker.0 Request processed in 47us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.731792:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1788838265.731823:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1788838265.731830:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135150208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.731859:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135150208:12345-0@lo:400:kworker.0 Request processed in 30us (2487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.731865:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1788838265.731877:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:2.0:1788838265.731883:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135151232:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788838265.731895:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61fc28e00 x1875729135151232/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:166/0 lens 224/224 e 0 to 0 dl 1788838276 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838265.731921:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135151232:12345-0@lo:400:kworker.0 Request processed in 38us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.731928:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:2.0:1788838265.732033:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135150208:0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.732048:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135150720:0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.732071:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135151232:0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.732081:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135150080:0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.732090:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135150592:0@lo:400:kworker.0 00000100:00100000:2.0:1788838265.732100:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135151104:0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.732325:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:1.0:1788838265.732374:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135150336:0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.732386:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135150848:0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.732396:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135149952:0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.732406:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135150464:0@lo:400:kworker.0 00000100:00100000:1.0:1788838265.732416:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135150976:0@lo:400:kworker.0 00000100:00080000:3.0:1788838265.735489:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838265.735500:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838265.735504:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838265.735507:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838265.735881:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135151360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838265.735949:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838265.736294:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135151360 00000100:00100000:2.0:1788838265.736302:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135151360 00000100:00100000:2.0:1788838265.736359:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:2.0:1788838265.736370:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135151360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838265.736402:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838265.736455:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135151360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838265.736462:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:3.0:1788838265.736614:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135151360:0@lo:13:osp-pre-1-0.0 00000020:00080000:2.0:1788838265.740367:0:75678:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444096 batchid updated 00000020:00080000:3.0:1788838265.740581:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444096 00000004:00080000:3.0:1788838265.740642:0:75698:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8ff50a48de40 with version 18 00000020:00080000:3.0:1788838265.740650:0:75698:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444095 cancel update log [0x2000090a1:0x2:0x0].6: rc = 0 00000004:00080000:0.0:1788838265.740896:0:75683:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8ff626ae9780 version 18 rpc_version 18 00000020:00100000:0.0:1788838265.740932:0:75683:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788838265.740942:0:75683:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8ff61fc29c00 x1875729135151616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838265.741051:0:75683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135151616:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1788838265.741438:0:75698:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444095 cancel update log [0x2400088d0:0x2:0x0].7: rc = 0 00000004:00080000:3.0:1788838265.741471:0:75698:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8ff50a48db40 with version 19 00000020:00080000:3.0:1788838265.741475:0:75698:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444096 cancel update log [0x2000090a1:0x2:0x0].7: rc = 0 00000020:00080000:3.0:1788838265.741501:0:75698:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444096 cancel update log [0x2400088d0:0x2:0x0].8: rc = 0 00000020:00080000:3.0:1788838265.741508:0:75698:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444096 00000100:00100000:2.0:1788838265.741652:0:75683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838265.742280:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a2c79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838265.742420:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135151616 00000100:00100000:3.0:1788838265.742428:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135151616 00000100:00100000:3.0:1788838265.742471:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4229 00000100:00100000:3.0:1788838265.742480:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75683:x1875729135151616:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1788838265.917057:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838266.240292:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135151744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788838266.240362:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838266.243870:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135151744 00000100:00100000:3.0:1788838266.243886:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135151744 00000100:00100000:3.0:1788838266.243943:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:3.0:1788838266.243954:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135151744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838266.243987:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838266.247829:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135151744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3868us (7457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838266.247845:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:2.0:1788838266.247985:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135151744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788838266.948422:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838266.949225:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838266.949270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838266.949301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838266.949319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838266.949340:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838266.949374:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116465152 00000100:00100000:2.0:1788838266.949383:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116465152 00000100:00100000:2.0:1788838266.949431:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116465024 00000100:00100000:2.0:1788838266.949435:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116465024 00000100:00100000:2.0:1788838266.949456:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2676 00000100:00100000:2.0:1788838266.949466:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116465152:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838266.949499:0:92475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116464640 00000100:00100000:3.0:1788838266.949506:0:92475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116464640 00000100:00100000:2.0:1788838266.949546:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116465152:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838266.949548:0:92475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:3.0:1788838266.949563:0:92475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2406:x1875729116464640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838266.949569:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2676 00000100:00100000:2.0:1788838266.949595:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2677 00000100:00100000:3.0:1788838266.949599:0:92475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637e9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2406:x1875729116464640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838266.949608:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116465024:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838266.949612:0:92475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:2.0:1788838266.949643:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116465024:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00080000:3.0:1788838266.949648:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838266.949651:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2677 00000100:00080000:3.0:1788838266.949660:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838266.949675:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116464896 00000100:00100000:2.0:1788838266.949679:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116464896 00000100:00100000:2.0:1788838266.949712:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116464768 00000100:00100000:2.0:1788838266.949716:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116464768 00000100:00100000:2.0:1788838266.949741:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1377 00000100:00100000:2.0:1788838266.949749:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116464896:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838266.949771:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1378 00000100:00100000:2.0:1788838266.949780:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116464896:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838266.949780:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+13:2406:x1875729116464768:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838266.949786:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1377 00010000:00000080:0.0:1788838266.949795:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff624ebd180 x1875729116464768/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:167/0 lens 224/224 e 0 to 0 dl 1788838277 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838266.949843:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+13:2406:x1875729116464768:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 65us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838266.949851:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1378 00000100:00080000:3.0:1788838266.949861:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838266.949865:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00000080:3.0:1788838267.036243:0:37907:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff624ebe680 x1875729135151616/t120259084299(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:166/0 lens 488/4320 e 0 to 0 dl 1788838276 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838267.036349:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75683:x1875729135151616:12345-0@lo:1000:osp_up0-1.0 Request processed in 1293869us (1294697us total) trans 120259084299 rc 0/0 00000100:00100000:3.0:1788838267.036361:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4229 00000001:00080000:1.0:1788838267.036366:0:92470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00000100:00100000:3.0:1788838267.036432:0:75683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135151616:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788838267.036447:0:75683:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8ff626ae9780 version 19 rpc_version 19 00000020:00100000:3.0:1788838267.036473:0:75683:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788838267.036478:0:75683:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8ff505930e00 x1875729135152000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838267.036498:0:75683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135152000:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788838267.036535:0:75683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838267.036577:0:75683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a48d840 going to sleep for 11 seconds 00010000:00010000:3.0:1788838267.036598:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.036609:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838267.036679:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135152000 00000100:00100000:1.0:1788838267.036686:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135152000 00000100:00100000:1.0:1788838267.036727:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4230 00000100:00100000:1.0:1788838267.036735:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75683:x1875729135152000:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:1.0:1788838267.036852:0:23765:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff6244b7100 x1875729135152000/t120259084300(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:168/0 lens 488/4320 e 0 to 0 dl 1788838278 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838267.036889:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75683:x1875729135152000:12345-0@lo:1000:osp_up0-1.0 Request processed in 155us (354us total) trans 120259084300 rc 0/0 00000100:00100000:1.0:1788838267.036896:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4230 00010000:00010000:3.0:1788838267.038771:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038779:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838267.038784:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038830:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038850:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50b021f00) 00010000:00010000:3.0:1788838267.038853:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838267.038858:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038865:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9c75 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038896:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038903:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038910:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038915:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838267.038922:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038927:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038935:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50b021f00) 00010000:00010000:3.0:1788838267.038937:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838267.038940:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838267.038951:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccc9cad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838267.039034:0:75683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75683:1875729135152000:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788838267.270132:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135152128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838267.270219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838267.270278:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838267.270298:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135152256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838267.270323:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838267.270386:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135152128 00000100:00100000:1.0:1788838267.270396:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135152128 00000100:00100000:1.0:1788838267.270449:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135152256 00000100:00100000:1.0:1788838267.270452:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135152256 00000100:00100000:1.0:1788838267.270472:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:1.0:1788838267.270482:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135152128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838267.270513:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838267.270564:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135152128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838267.270572:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:1.0:1788838267.270588:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:1.0:1788838267.270595:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135152256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838267.270606:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838267.270631:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135152256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838267.270637:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00080000:1.0:1788838267.270657:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838267.270660:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838267.286164:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135152256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838267.286189:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135152128:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788838267.965054:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788838268.215593:0:93665:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1788838268.292097:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838268.297166:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116465280 00000100:00100000:1.0:1788838268.297180:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116465280 00000100:00100000:1.0:1788838268.297323:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1389 00000100:00100000:1.0:1788838268.297337:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+9:72028:x1875729116465280:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:1.0:1788838268.297360:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838268.297380:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396ccc9cc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf46 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.297450:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9800/0x88da08396ccc9cc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.297465:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9800/0x88da08396ccc9cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.297478:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9800/0x88da08396ccc9cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838268.297548:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788838268.297553:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788838268.297598:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9800/0x88da08396ccc9cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.297624:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396ccc9cc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf46 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.297639:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9800/0x88da08396ccc9cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf46 expref: 10 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.297647:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff6055e2100) 00010000:00010000:1.0:1788838268.297649:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788838268.297653:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e9800, rc 0) 00010000:00000080:1.0:1788838268.297661:0:66253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff624ebd500 x1875729116465280/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:169/0 lens 576/688 e 0 to 0 dl 1788838279 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838268.297732:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+10:72028:x1875729116465280:12345-192.168.203.30@tcp:101:touch.0 Request processed in 399us (5649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838268.297739:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1389 00000100:00080000:3.0:1788838268.297985:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838268.300915:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838268.300996:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116465408 00000100:00100000:2.0:1788838268.301007:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116465408 00000100:00100000:2.0:1788838268.301078:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1390 00000100:00100000:2.0:1788838268.301089:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+10:72028:x1875729116465408:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838268.301110:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838268.301130:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9cd0 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf4d expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301197:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301224:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301236:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301253:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cde lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301260:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cde lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301267:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cde lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301344:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9ce5 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301354:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9ce5 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301362:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9ce5 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838268.301388:0:66255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9ce5 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301403:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301410:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301416:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301423:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301430:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838268.301435:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301444:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301457:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff6082c8600) 00010000:00010000:2.0:1788838268.301466:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838268.301471:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301479:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9cd7 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301494:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cde lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301500:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cde lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301506:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cde lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301511:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838268.301514:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cde lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301520:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cde lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301528:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff8ff50b021900) 00010000:00010000:2.0:1788838268.301531:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838268.301534:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cde lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301540:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9800/0x88da08396ccc9cde lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301578:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9cd0 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf4d expref: 12 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301604:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9ce5 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf4d expref: 11 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.301612:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff60574c800) 00010000:00010000:2.0:1788838268.301614:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788838268.301617:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8200, rc 0) 00010000:00000080:2.0:1788838268.301625:0:66255:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff6244b4700 x1875729116465408/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:169/0 lens 576/584 e 0 to 0 dl 1788838279 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838268.301707:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:72028:x1875729116465408:12345-192.168.203.30@tcp:101:touch.0 Request processed in 619us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838268.301715:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1390 00000100:00100000:1.0:1788838268.307061:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838268.307184:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838268.307265:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116465664 00000100:00100000:0.0:1788838268.307275:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116465664 00000100:00100000:0.0:1788838268.307338:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 734 00000100:00100000:0.0:1788838268.307348:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116465664:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838268.307365:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838268.307396:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9ce5 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf4d expref: 11 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.307414:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff60574c800) 00010000:00010000:0.0:1788838268.307419:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838268.307469:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2405:x1875729116465664:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 122us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838268.307477:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 734 00000100:00100000:3.0:1788838268.312162:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116465536 00000100:00100000:3.0:1788838268.312177:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116465536 00000100:00100000:3.0:1788838268.312527:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1391 00000100:00100000:3.0:1788838268.312536:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+5:72028:x1875729116465536:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:3.0:1788838268.312554:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838268.312579:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9cec lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf54 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838268.312631:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9cf3 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838268.312643:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9cf3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838268.312655:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9cf3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838268.312705:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1788838268.312709:0:66254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788838268.312759:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4000/0x88da08396ccc9cec lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf54 expref: 7 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838268.312787:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff5059a4200/0x88da08396ccc9cf3 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf54 expref: 6 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838268.312817:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff606722d00) 00010000:00010000:3.0:1788838268.312820:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788838268.312824:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4200, rc 0) 00000100:00100000:3.0:1788838268.312882:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:72028:x1875729116465536:12345-192.168.203.30@tcp:101:touch.0 Request processed in 347us (5698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838268.312889:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1391 00000100:00080000:1.0:1788838268.325271:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838268.327823:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838268.327859:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116465920 00000100:00100000:1.0:1788838268.327869:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116465920 00000100:00100000:1.0:1788838268.327936:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1392 00000100:00100000:1.0:1788838268.327947:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+6:72028:x1875729116465920:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:1.0:1788838268.327978:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838268.327998:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8600/0x88da08396ccc9cfa lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf5b expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.328115:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.328130:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.328141:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.328154:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.328161:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.328167:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838268.328416:0:66253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135152384:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788838268.328471:0:66253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838268.328509:0:66253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624433a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838268.328565:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135152384 00000100:00100000:2.0:1788838268.328570:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135152384 00000100:00100000:2.0:1788838268.328671:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4231 00000100:00100000:2.0:1788838268.328687:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66253:x1875729135152384:12345-0@lo:1000:mdt00_000.0 00010000:00000080:2.0:1788838268.328730:0:8471:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61fcd3100 x1875729135152384/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:169/0 lens 328/4320 e 0 to 0 dl 1788838279 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838268.328781:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66253:x1875729135152384:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838268.328788:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4231 00000100:00100000:0.0:1788838268.328876:0:66253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66253:1875729135152384:0@lo:1000:mdt00_000.0 00000004:00080000:0.0:1788838268.329163:0:66253:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x603:0x0], index 1: 0 00010000:00010000:0.0:1788838268.329547:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626e00/0x88da08396ccc9d0f lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329562:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626e00/0x88da08396ccc9d0f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329573:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626e00/0x88da08396ccc9d0f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329614:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329621:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329628:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329634:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329640:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838268.329644:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329652:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329666:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff606722d00) 00010000:00010000:0.0:1788838268.329669:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838268.329674:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329690:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8a00/0x88da08396ccc9d01 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838268.329704:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a16e356d reply state 0000000059df43ac transno 77309411466 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329715:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329721:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff8ff612676400) 00010000:00010000:0.0:1788838268.329723:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838268.329726:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838268.329762:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8600/0x88da08396ccc9cfa lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf5b expref: 9 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329776:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626e00/0x88da08396ccc9d0f lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf5b expref: 8 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.329783:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8ff6082c8500) 00010000:00010000:0.0:1788838268.329785:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838268.329788:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626e00, rc 0) 00000100:00100000:0.0:1788838268.329864:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+9:72028:x1875729116465920:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1919us (2065us total) trans 77309411466 rc 0/0 00000100:00100000:0.0:1788838268.329872:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1392 00000100:00100000:0.0:1788838268.338477:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838268.338568:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116466176 00000100:00100000:2.0:1788838268.338580:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116466176 00000100:00100000:2.0:1788838268.338647:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1393 00000100:00100000:2.0:1788838268.338658:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:72028:x1875729116466176:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:2.0:1788838268.338742:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838268.338767:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626e00/0x88da08396ccc9d0f lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf5b expref: 9 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.338786:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8ff6082c8500) 00010000:00010000:2.0:1788838268.338817:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838268.338881:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.338895:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.338905:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838268.339017:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec0301c7 reply state 000000001a802ffd transno 77309411467 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.339029:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.339036:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8ff50b021900) 00010000:00010000:2.0:1788838268.339039:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838268.339042:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838268.339220:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+10:72028:x1875729116466176:12345-192.168.203.30@tcp:36:touch.0 Request processed in 563us (750us total) trans 77309411467 rc 0/0 00000100:00100000:2.0:1788838268.339227:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1393 00000100:00100000:1.0:1788838268.343935:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838268.344017:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116466304 00000100:00100000:2.0:1788838268.344028:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116466304 00000100:00100000:2.0:1788838268.344093:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1394 00000100:00100000:2.0:1788838268.344116:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+10:72028:x1875729116466304:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838268.344142:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838268.344163:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9800/0x88da08396ccc9d24 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf62 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.344231:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9800/0x88da08396ccc9d24 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf62 expref: 11 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.344248:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9800/0x88da08396ccc9d24 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf62 expref: 11 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.344267:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8ff50b021900) 00010000:00010000:2.0:1788838268.344271:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838268.344275:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9800, rc 0) 00000100:00100000:2.0:1788838268.344335:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+11:72028:x1875729116466304:12345-192.168.203.30@tcp:101:touch.0 Request processed in 222us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838268.344343:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1394 00000100:00100000:1.0:1788838268.352623:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838268.352707:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116466432 00000100:00100000:3.0:1788838268.352718:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116466432 00000100:00100000:3.0:1788838268.352789:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5978 00000100:00100000:3.0:1788838268.352818:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116466432:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:3.0:1788838268.353032:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2406:x1875729116466432:12345-192.168.203.30@tcp:2:touch.0 Request processed in 234us (419us total) trans 4294969456 rc 0/0 00000100:00100000:3.0:1788838268.353040:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5978 00000100:00080000:1.0:1788838268.353140:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838268.362412:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838268.363310:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116466688 00000100:00100000:0.0:1788838268.363321:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116466688 00000100:00100000:0.0:1788838268.363382:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:0.0:1788838268.363401:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:72028:x1875729116466688:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:0.0:1788838268.363698:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+12:72028:x1875729116466688:12345-192.168.203.30@tcp:35:touch.0 Request processed in 298us (1294us total) trans 77309411468 rc 0/0 00000100:00100000:0.0:1788838268.363705:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:1.0:1788838268.384693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838268.385286:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116466816 00000100:00100000:2.0:1788838268.385296:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116466816 00000100:00100000:2.0:1788838268.385364:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1395 00000100:00100000:2.0:1788838268.385376:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+10:72029:x1875729116466816:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838268.385397:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838268.385417:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc9d2b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf69 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385479:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385501:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385513:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385527:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9d39 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385535:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9d39 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385541:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9d39 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385591:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9d40 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385600:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9d40 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385607:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9d40 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838268.385626:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9d40 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385641:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385648:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385663:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385670:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385676:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838268.385680:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385687:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385699:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff6082c8600) 00010000:00010000:2.0:1788838268.385702:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838268.385706:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385712:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccc9d32 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385723:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9d39 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385728:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9d39 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385734:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9d39 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385739:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838268.385746:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9d39 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385752:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9d39 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385759:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff8ff50b021100) 00010000:00010000:2.0:1788838268.385761:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838268.385764:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9d39 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385769:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8000/0x88da08396ccc9d39 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385820:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccc9d2b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf69 expref: 12 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385833:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9d40 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf69 expref: 11 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838268.385840:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff60574c700) 00010000:00010000:2.0:1788838268.385842:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788838268.385845:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8200, rc 0) 00010000:00000080:2.0:1788838268.385852:0:76060:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61fcd0700 x1875729116466816/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:169/0 lens 576/584 e 0 to 0 dl 1788838279 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838268.385911:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+11:72029:x1875729116466816:12345-192.168.203.30@tcp:101:touch.0 Request processed in 537us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838268.385917:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1395 00000100:00100000:0.0:1788838268.411271:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838268.411311:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838268.413843:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116466944 00000100:00100000:0.0:1788838268.413859:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116466944 00000100:00100000:0.0:1788838268.413937:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1396 00000100:00100000:0.0:1788838268.413947:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+12:72029:x1875729116466944:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838268.413972:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838268.414007:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9d47 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf70 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.414079:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626c00/0x88da08396ccc9d4e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.416287:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626c00/0x88da08396ccc9d4e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.416309:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626c00/0x88da08396ccc9d4e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838268.416370:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788838268.416375:0:75504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788838268.416421:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9d47 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf70 expref: 14 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.416441:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626c00/0x88da08396ccc9d4e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf70 expref: 13 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.416457:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8900) 00010000:00010000:0.0:1788838268.416460:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1788838268.416463:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626c00, rc 0) 00000100:00100000:0.0:1788838268.416532:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+13:72029:x1875729116466944:12345-192.168.203.30@tcp:101:touch.0 Request processed in 2585us (5270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838268.416540:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1396 00000100:00100000:0.0:1788838268.416613:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116467072 00000100:00100000:0.0:1788838268.416620:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116467072 00000100:00100000:0.0:1788838268.416658:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 735 00000100:00100000:0.0:1788838268.416666:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116467072:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838268.416678:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838268.416694:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccc9d40 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf69 expref: 11 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.416706:0:10364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff60574c700) 00010000:00010000:0.0:1788838268.416710:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838268.416729:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2405:x1875729116467072:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 63us (5417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838268.416735:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 735 00000100:00100000:3.0:1788838268.428788:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838268.428904:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116467328 00000100:00100000:0.0:1788838268.428915:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116467328 00000100:00100000:0.0:1788838268.428975:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1397 00000100:00100000:0.0:1788838268.428987:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+13:72029:x1875729116467328:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838268.429009:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838268.429029:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9d55 lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf77 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429157:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429172:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429185:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429211:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429219:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429227:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838268.429550:0:66254:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x604:0x0], index 1: 0 00010000:00010000:0.0:1788838268.429689:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc9d6a lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429698:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc9d6a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429706:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc9d6a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429738:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429757:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429763:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429770:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429776:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838268.429781:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429789:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429831:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8900) 00010000:00010000:0.0:1788838268.429835:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838268.429839:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429846:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627800/0x88da08396ccc9d5c lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838268.429859:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ccc9428 reply state 00000000f93a6d52 transno 77309411469 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429869:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429875:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff8ff6082c8000) 00010000:00010000:0.0:1788838268.429882:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838268.429885:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838268.429913:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9d55 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf77 expref: 16 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429926:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc9d6a lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf77 expref: 15 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.429934:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8ff6082c8100) 00010000:00010000:0.0:1788838268.429936:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838268.429938:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626200, rc 0) 00000100:00100000:0.0:1788838268.430000:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+16:72029:x1875729116467328:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1015us (1220us total) trans 77309411469 rc 0/0 00000100:00100000:0.0:1788838268.430008:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1397 00000100:00100000:0.0:1788838268.438653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838268.441441:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116467584 00000100:00100000:1.0:1788838268.441464:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116467584 00000100:00100000:1.0:1788838268.441530:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1398 00000100:00100000:1.0:1788838268.441542:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+16:72029:x1875729116467584:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:1.0:1788838268.441600:0:76060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838268.441629:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504626200/0x88da08396ccc9d6a lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf77 expref: 16 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.441649:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8ff6082c8100) 00010000:00010000:1.0:1788838268.441663:0:76060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838268.441721:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.441735:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.441757:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838268.441892:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040bbca90 reply state 00000000dbf10d11 transno 77309411470 ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.441905:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838268.441911:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8ff612676b00) 00010000:00010000:1.0:1788838268.441914:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838268.441917:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838268.442031:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+17:72029:x1875729116467584:12345-192.168.203.30@tcp:36:touch.0 Request processed in 488us (3386us total) trans 77309411470 rc 0/0 00000100:00100000:1.0:1788838268.442039:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1398 00000100:00100000:1.0:1788838268.446577:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838268.446968:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116467712 00000100:00100000:0.0:1788838268.446979:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116467712 00000100:00100000:0.0:1788838268.447139:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1399 00000100:00100000:0.0:1788838268.447150:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+17:72029:x1875729116467712:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838268.447173:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838268.447193:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9d7f lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf7e expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.447259:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9d7f lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf7e expref: 18 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.447276:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627600/0x88da08396ccc9d7f lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf7e expref: 18 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838268.447320:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8ff612676b00) 00010000:00010000:0.0:1788838268.447323:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788838268.447327:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627600, rc 0) 00000100:00100000:0.0:1788838268.448500:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+18:72029:x1875729116467712:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1345us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838268.448509:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1399 00000100:00100000:1.0:1788838268.457775:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838268.458825:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116467840 00000100:00100000:3.0:1788838268.458838:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116467840 00000100:00100000:3.0:1788838268.458900:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5979 00000100:00100000:3.0:1788838268.458911:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2404:x1875729116467840:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:3.0:1788838268.459111:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116467840:12345-192.168.203.30@tcp:2:touch.0 Request processed in 201us (1346us total) trans 4294969457 rc 0/0 00000100:00100000:3.0:1788838268.459119:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5979 00000100:00100000:1.0:1788838268.468983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838268.469171:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116468096 00000100:00100000:2.0:1788838268.469196:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116468096 00000100:00100000:2.0:1788838268.469271:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:2.0:1788838268.469281:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+18:72029:x1875729116468096:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838268.469623:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+19:72029:x1875729116468096:12345-192.168.203.30@tcp:35:touch.0 Request processed in 342us (649us total) trans 77309411471 rc 0/0 00000100:00100000:2.0:1788838268.469630:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 244 00010000:00010000:1.0:1788838269.003600:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838270.013997:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788838270.579041:0:93762:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788838270.579183:0:93762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.579206:0:93762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.579214:0:93762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.579221:0:93762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.579295:0:93762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788838270.579301:0:93762:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788838270.579328:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788838270.579333:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788838270.579340:0:93762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788838270.579398:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff640eeb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788838270.579468:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135152512:0@lo:39:umount.0 00000100:00100000:3.0:1788838270.579551:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838270.583087:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135152512 00000100:00100000:0.0:1788838270.583102:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135152512 00000100:00100000:0.0:1788838270.583208:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1788838270.583218:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729135152512:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788838270.583249:0:67312:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc96ef 00000100:00080000:0.0:1788838270.583264:0:67312:0:(import.c:65:import_set_state_nolock()) ffff8ff5052d6800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788838270.588702:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838270.588717:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.588730:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148f600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838270.588733:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.588744:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838270.588750:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838270.588756:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838270.588759:0:6534:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788838270.588763:0:6534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788838270.588826:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.588833:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838270.588856:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.588863:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccc9a92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9a99 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.588896:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838270.588898:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838270.588900:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838270.589702:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838270.589727:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135152640:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838270.590157:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:0.0:1788838270.590225:0:67312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff6244b7480 x1875729135152512/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:171/0 lens 224/224 e 0 to 0 dl 1788838281 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838270.590327:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1875729135152512:12345-0@lo:39:umount.0 Request processed in 7110us (10775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838270.590339:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000020:00000080:0.0:1788838270.590354:0:67312:0:(genops.c:885:class_export_put()) final put ffff8ff5052d5800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788838270.592280:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5052d5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788838270.592360:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5052d6800 for lustre-MDT0000 00000100:00100000:2.0:1788838270.592925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.593043:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135152640 00000100:00100000:3.0:1788838270.593054:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135152640 00000100:00100000:3.0:1788838270.593134:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:3.0:1788838270.593145:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135152640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838270.593164:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838270.593196:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601529400/0x88da08396ccc9a99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9a92 expref: 24 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.593215:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838270.593282:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3644:x1875729135152640:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (3484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838270.593289:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1788838270.594357:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135152640:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788838270.596315:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff640eeb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788838270.596382:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135152512:0@lo:39:umount.0 00000100:00080000:0.0:1788838270.599340:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788838270.599350:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788838270.599357:0:93762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788838270.601590:0:93762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.601609:0:93762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.601616:0:93762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.601623:0:93762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.601718:0:93762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838270.601726:0:93762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.601733:0:93762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.601739:0:93762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.601746:0:93762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.603343:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838270.603355:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.603365:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838270.603369:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.603380:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838270.603388:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838270.603394:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838270.603396:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788838270.603436:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.603443:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838270.603479:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.603502:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccc9aa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9aa7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.603519:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838270.603587:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.603594:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838270.603598:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.603605:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838270.603612:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838270.603617:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788838270.603618:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1788838270.603632:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.603636:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788838270.603650:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.603795:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838270.603820:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838270.603822:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838270.605741:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135152896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838270.605846:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838270.605891:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135152896 00000100:00100000:1.0:1788838270.605900:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135152896 00000100:00100000:2.0:1788838270.605921:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135152768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838270.605946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838270.605957:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135152768 00000100:00100000:1.0:1788838270.605960:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135152768 00000100:00100000:1.0:1788838270.605982:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1788838270.605990:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135152896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838270.606004:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838270.606024:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50b8e4200/0x88da08396ccc961d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9616 expref: 24 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.606040:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838270.606084:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3645:x1875729135152896:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838270.606099:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1788838270.606145:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1788838270.606156:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3644:x1875729135152768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838270.606163:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838270.606172:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148e200/0x88da08396ccc9aa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9aa0 expref: 22 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.606180:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838270.606222:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3644:x1875729135152768:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838270.606228:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:3.0:1788838270.606284:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135152896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838270.606443:0:93762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788838270.606452:0:93762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712d600/0x88da08396ccc9616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc961d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838270.606466:0:93762:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788838270.606476:0:93762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.606484:0:93762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.606490:0:93762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.606497:0:93762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.606526:0:93762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838270.606532:0:93762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.606538:0:93762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.606544:0:93762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.606550:0:93762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838270.606562:0:93762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788838270.606565:0:93762:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788838270.606568:0:93762:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788838270.606605:0:93762:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788838270.606609:0:93762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1788838270.606614:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788838270.606619:0:93762:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1788838270.606747:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838270.606754:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.606762:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031c00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:3.0:1788838270.606765:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.606773:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838270.606780:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838270.606814:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788838270.606816:0:63563:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788838270.606819:0:63563:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788838270.606844:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.606850:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838270.606866:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.606872:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff600031c00/0x88da08396ccc95de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc95e5 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.606883:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838270.606885:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.606891:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030800 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:3.0:1788838270.606893:0:63563:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.606899:0:63563:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838270.606904:0:63563:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838270.606909:0:63563:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788838270.606910:0:63563:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788838270.606912:0:63563:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788838270.606931:0:63563:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.606937:0:63563:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788838270.606947:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.606953:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff600030800/0x88da08396ccc950c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9513 expref: -99 pid: 92469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838270.606962:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838270.606964:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838270.606965:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838270.606976:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135153024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838270.607009:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:0.0:1788838270.609448:0:93762:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:3.0:1788838270.610486:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135153152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838270.610546:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838270.612430:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135153024 00000100:00100000:2.0:1788838270.612445:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135153024 00000100:00100000:2.0:1788838270.612525:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1788838270.612536:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3646:x1875729135153024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838270.612552:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838270.612572:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5200/0x88da08396ccc95e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc95de expref: 21 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.612589:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838270.612660:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3646:x1875729135153024:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (5650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838270.612678:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1788838270.612751:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135152768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838270.613471:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838270.613480:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788838270.614249:0:92470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00000100:00100000:3.0:1788838270.616325:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135153024:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788838270.616449:0:93762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1788838270.616455:0:93762:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff5052d4800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788838270.616461:0:93762:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff640ee8000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788838270.616480:0:93762:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff640eec000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788838270.616486:0:93762:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff50d58c000 efc561ba-875e-4857-b79b-9bd7023bd57c 192.168.203.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 120259084298 stale:0 00000020:00080000:1.0:1788838270.616490:0:93762:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ff50d58f000 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 120259084300 stale:0 00000020:00080000:1.0:1788838270.616496:0:93762:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8ff6271cb370) has exports, disconnecting them 00000020:00080000:1.0:1788838270.616500:0:93762:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff5052d4800), last request at 1788838240 00000020:00000080:1.0:1788838270.616506:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc96e8 00000100:00080000:1.0:1788838270.616515:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff5052d0800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788838270.616613:0:93762:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff5052d4800): rc 0 00000020:00000080:1.0:1788838270.616616:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff5052d4800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788838270.616625:0:93762:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff640ee8000), last request at 1788838265 00000020:00000080:1.0:1788838270.616628:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc96e1 00000100:00080000:1.0:1788838270.616632:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff610297000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788838270.616640:0:93762:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff640ee8000): rc 0 00000020:00000080:1.0:1788838270.616642:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff640ee8000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788838270.616645:0:93762:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff640eec000), last request at 1788838265 00000020:00000080:1.0:1788838270.616647:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc96da 00000100:00080000:1.0:1788838270.616651:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff640eed800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788838270.616667:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788838270.616675:0:93762:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff640eec000): rc 0 00000020:00000080:1.0:1788838270.616677:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff640eec000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788838270.616681:0:93762:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.30@tcp (ffff8ff50d58c000), last request at 1788838268 00000100:00100000:2.0:1788838270.616783:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135153152 00000100:00100000:2.0:1788838270.616789:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135153152 00000100:00100000:2.0:1788838270.616865:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1788838270.616875:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3643:x1875729135153152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838270.616888:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838270.616908:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50b8e4c00/0x88da08396ccc9513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc950c expref: 20 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.616924:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838270.616982:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+19:3643:x1875729135153152:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (6435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838270.616989:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000020:00000080:1.0:1788838270.617666:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9560 00000020:00010000:1.0:1788838270.617682:0:93762:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff50d58c000: total 3 00000100:00080000:1.0:1788838270.617687:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a6000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788838270.617748:0:93762:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff50d58c000): rc 0 00000020:00080000:1.0:1788838270.617752:0:93762:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ff50d58f000), last request at 1788838234 00000020:00000080:1.0:1788838270.617765:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9559 00000020:00010000:1.0:1788838270.617770:0:93762:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff50d58f000: total 3 00000100:00080000:1.0:1788838270.617773:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff5052d5000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788838270.617787:0:6535:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff50d58c000: total 3 00010000:00010000:1.0:1788838270.617899:0:6535:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff50d58c000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788838270.617931:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccc9be2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf07 expref: 5 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.617987:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9800/0x88da08396ccc9cc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf46 expref: 4 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.618002:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9e00/0x88da08396ccc9c3d lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf23 expref: 3 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838270.618020:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9600/0x88da08396ccc9bfe lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf0e expref: 2 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1788838270.618024:0:6534:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff50d58f000: total 3 00010000:00010000:2.0:1788838270.618027:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838270.618032:0:6535:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff50d58c000, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1788838270.618063:0:6534:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff50d58f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788838270.618096:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff5059a5c00/0x88da08396ccc970b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9704 expref: 5 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.618113:0:6534:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff50d58f000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788838270.618232:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5052d4800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788838270.618294:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640ee8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788838270.618310:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640eec000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788838270.618325:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5052d0800 for lustre-MDT0000 00000020:00000080:3.0:1788838270.618328:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff610297000 for lustre-MDT0000 00000020:00000080:3.0:1788838270.618332:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff640eed800 for lustre-MDT0000 00010000:00010000:3.0:1788838270.618341:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838270.618345:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838270.618381:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135153152:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788838270.619905:0:93762:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff50d58f000): rc 0 00000004:00000080:0.0:1788838270.619916:0:93762:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f5181b3fae0 00000100:00080000:0.0:1788838270.619938:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788838270.619942:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788838270.621994:0:93762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788838270.622030:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff619428000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788838270.622156:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135153280:0@lo:39:umount.0 00000100:00100000:3.0:1788838270.622288:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838270.624296:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135153280 00000100:00100000:0.0:1788838270.624322:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135153280 00000100:00100000:0.0:1788838270.624382:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4232 00000100:00100000:0.0:1788838270.624391:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135153280:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788838270.624449:0:23765:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9591 00000100:00080000:0.0:1788838270.624458:0:23765:0:(import.c:65:import_set_state_nolock()) ffff8ff632f50800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788838270.624484:0:23765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411471 00010000:00010000:3.0:1788838270.630594:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838270.630710:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3642:x1875729135153280:12345-0@lo:39:umount.0 Request processed in 6313us (8416us total) trans 77309411472 rc 0/0 00000100:00100000:0.0:1788838270.630723:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4232 00000100:00080000:0.0:1788838270.630835:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788838270.630841:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 3 00000004:00080000:0.0:1788838270.630869:0:93762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788838270.630922:0:93762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788838270.630951:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff50a587800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788838270.630962:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788838270.630964:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 3 00000004:00080000:0.0:1788838270.630973:0:93762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788838270.631024:0:93762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788838270.631034:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff5031c1000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788838270.631233:0:93762:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff6271cb370) has no exports 00000100:00080000:3.0:1788838270.638840:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff619428000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788838270.638858:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135153280:0@lo:39:umount.0 00000100:00100000:3.0:1788838270.638997:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135153408:0@lo:9:umount.0 00000100:00100000:3.0:1788838270.640288:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.640366:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135153536:0@lo:9:umount.0 00000100:00100000:3.0:1788838270.640405:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.640434:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135153408 00000100:00100000:3.0:1788838270.640441:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135153408 00000100:00100000:3.0:1788838270.640492:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135153536 00000100:00100000:3.0:1788838270.640495:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135153536 00000100:00100000:3.0:1788838270.640516:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5980 00000100:00100000:3.0:1788838270.640523:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135153408:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788838270.640551:0:26220:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc95bb 00000100:00080000:3.0:1788838270.640558:0:26220:0:(import.c:65:import_set_state_nolock()) ffff8ff632f52800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788838270.640620:0:26220:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969455 00000100:00100000:0.0:1788838270.640769:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5981 00000100:00100000:0.0:1788838270.640780:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135153536:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788838270.640794:0:26207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc95d7 00000100:00080000:0.0:1788838270.640817:0:26207:0:(import.c:65:import_set_state_nolock()) ffff8ff5031c2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788838270.640850:0:26207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969457 00000100:00100000:0.0:1788838270.640964:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729135153536:12345-0@lo:9:umount.0 Request processed in 187us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838270.640972:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5981 00000100:00100000:3.0:1788838270.641843:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3642:x1875729135153408:12345-0@lo:9:umount.0 Request processed in 1316us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838270.641852:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5980 00000100:00080000:3.0:1788838270.641875:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838270.641879:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788838270.641893:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838270.641899:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838270.641927:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5031c1000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788838270.641935:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788838270.641937:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788838270.641940:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135153536:0@lo:9:umount.0 00000100:00080000:3.0:1788838270.641978:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff50a587800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788838270.641993:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788838270.641994:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788838270.641997:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135153408:0@lo:9:umount.0 00000020:00000080:1.0:1788838270.654933:0:6535:0:(genops.c:885:class_export_put()) final put ffff8ff50d58c000/efc561ba-875e-4857-b79b-9bd7023bd57c 00000020:00000080:1.0:1788838270.654967:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d58c000/efc561ba-875e-4857-b79b-9bd7023bd57c for lustre-MDT0000 00000020:00000080:1.0:1788838270.655021:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5021a6000 for lustre-MDT0000 00010000:00010000:1.0:1788838270.655034:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838270.655036:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838270.655039:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788838270.657387:0:93762:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ff6271cb370) has no exports 00000020:00000080:2.0:1788838270.674786:0:6534:0:(genops.c:885:class_export_put()) final put ffff8ff50d58f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788838270.674903:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d58f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788838270.674958:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5052d5000 for lustre-MDT0000 00010000:00010000:3.0:1788838270.674973:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838270.674976:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838270.674978:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838270.719331:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9575 00000020:00000080:1.0:1788838270.719345:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff609254800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788838270.719365:0:93762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788838270.719746:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff609254800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788838270.719769:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838270.719782:0:93762:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788838270.719787:0:93762:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ff61d0e0000) has no exports 00000020:00000080:0.0:1788838270.720757:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc956e 00000020:00000080:0.0:1788838270.720765:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff627d1c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788838270.723321:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d1c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788838270.723471:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838270.723485:0:93762:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788838270.723490:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff62c818000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788838270.723493:0:93762:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62c818000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788838270.723500:0:93762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788838270.723662:0:93762:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff627c83a20 - data ffff8ff633f92ca8/ffff8ff63952f800 00000020:01000000:2.0:1788838270.723836:0:93762:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff605185f60 - data ffff8ff63fe5d0d8/ffff8ff505a3f400 00000100:00080000:2.0:1788838270.782700:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788838270.782709:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788838270.782722:0:93762:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ff640736a00 x1875729135153280/t77309411472(77309411472) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838280 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838270.782746:0:93762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788838270.786368:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788838270.786377:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 4 00000004:00080000:2.0:1788838270.786397:0:93762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838270.786399:0:93762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788838270.786781:0:92487:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788838270.786786:0:92487:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x70:0x0] index 1 count 1 00000040:00080000:1.0:1788838270.786821:0:92487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 28 count 2 00000100:00080000:2.0:1788838270.787502:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788838270.787506:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 4 00000004:00080000:2.0:1788838270.787522:0:93762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788838270.787524:0:93762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788838270.788848:0:92489:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788838270.788854:0:92489:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x72:0x0] index 1 count 1 00000040:00080000:0.0:1788838270.788867:0:92489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 28 count 2 00000020:00000080:2.0:1788838270.790266:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc952f 00000020:00000080:2.0:1788838270.790277:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff50d51d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788838270.790952:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9544 00000020:00000080:2.0:1788838270.790959:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff50d51a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788838270.790964:0:93762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788838270.790969:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838270.790980:0:93762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788838270.790983:0:93762:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8ff6271c8000) has no exports 00000004:01000000:2.0:1788838270.791928:0:93762:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788838270.791940:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc95c2 00000020:00000080:2.0:1788838270.791946:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff50a580000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788838270.791953:0:93762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788838270.791958:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838270.791967:0:93762:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788838270.791970:0:93762:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8ff503ca4d28) has no exports 00000020:00000080:2.0:1788838270.791976:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc95b4 00000020:00000080:2.0:1788838270.791979:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff605443000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788838270.792172:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d51d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788838270.792181:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d51a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788838270.792193:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50a580000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788838270.792198:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff605443000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788838270.797006:0:93762:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788838270.797015:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788838270.797020:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 5 00000004:00080000:1.0:1788838270.797028:0:93762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788838270.797030:0:93762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788838270.797132:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838270.797148:0:93762:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788838270.797158:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc95a6 00000020:00000080:1.0:1788838270.797168:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff624a94800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838270.799284:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5031c1000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788838270.799302:0:27607:0:(genops.c:885:class_export_put()) final put ffff8ff624a95800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838270.799305:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff624a95800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788838270.799313:0:27607:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788838270.800778:0:93762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788838270.800791:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838270.800864:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff624a94800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788838270.800914:0:93762:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788838270.800920:0:93762:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8ff503ca0000) has no exports 00000020:00000080:1.0:1788838270.800930:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc959f 00000020:00000080:1.0:1788838270.800941:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff50a583000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788838270.801139:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50a583000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788838270.802231:0:93762:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788838270.802237:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788838270.802242:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 5 00000004:00080000:1.0:1788838270.802250:0:93762:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788838270.802252:0:93762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788838270.802345:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838270.802356:0:93762:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788838270.802371:0:93762:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788838270.802396:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc958a 00000020:00000080:1.0:1788838270.802403:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff624a92800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838270.804529:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50a587800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788838270.804547:0:27607:0:(genops.c:885:class_export_put()) final put ffff8ff624a96800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838270.804551:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff624a96800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788838270.804558:0:27607:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788838270.805864:0:93762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788838270.805876:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838270.805890:0:93762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788838270.805895:0:93762:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8ff503ca3370) has no exports 00000020:00000080:1.0:1788838270.805904:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9583 00000020:00000080:1.0:1788838270.805911:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff610297800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788838270.806778:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff624a92800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788838270.806790:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff610297800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788838270.813884:0:93762:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788838270.813893:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788838270.813898:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788838270.813907:0:93762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788838270.813975:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838270.813992:0:93762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838270.814018:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838270.814022:0:93762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838270.814044:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff604963800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838270.814049:0:93762:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff604963800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788838270.814062:0:93762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788838270.814180:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc954b 00000020:00000080:0.0:1788838270.814196:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff50d519000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788838270.814202:0:93762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788838270.814205:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838270.814211:0:93762:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788838270.814215:0:93762:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ff6271ccd28) has no exports 00000020:00000080:0.0:1788838270.814240:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838270.814244:0:93762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788838270.814249:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9552 00000020:00000080:0.0:1788838270.814253:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff50d518000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788838270.814260:0:93762:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff62ceaa000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788838270.814263:0:93762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff62ceaa000 3 00000020:01000004:0.0:1788838270.814266:0:93762:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff62ceaa000 from lustre-MDT0000 00000020:00000080:0.0:1788838270.814287:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838270.814291:0:93762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788838270.814293:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff50d518800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788838270.814295:0:93762:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d518800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788838270.814302:0:93762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788838270.814332:0:93762:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788838270.814336:0:93762:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788838270.814339:0:93762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788838270.814342:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838270.814344:0:93762:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788838270.814350:0:93762:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff50d58f800 57943c9a-ca27-46d8-8845-5d2bce640e45 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838270.814358:0:93762:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ff50711f000 2af93169-6705-472b-b7ff-fd7cc5c04782 192.168.203.30@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788838270.814361:0:93762:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8ff61d0e3370) has exports, disconnecting them 00000020:00080000:0.0:1788838270.814365:0:93762:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ff50d58f800), last request at 1788838234 00000020:00000080:0.0:1788838270.814389:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc94f0 00000020:00010000:0.0:1788838270.814400:0:93762:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff50d58f800: total 2 00000100:00080000:0.0:1788838270.814404:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff50d58e800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838270.814417:0:93762:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff50d58f800): rc 0 00000020:00080000:0.0:1788838270.814421:0:93762:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.30@tcp (ffff8ff50711f000), last request at 1788838228 00000020:00000080:0.0:1788838270.814468:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc94cd 00000020:00010000:0.0:1788838270.814472:0:93762:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff50711f000: total 2 00000100:00080000:0.0:1788838270.814475:0:93762:0:(import.c:65:import_set_state_nolock()) ffff8ff50711b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838270.814484:0:93762:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff50711f000): rc 0 00000020:00080000:0.0:1788838270.814488:0:93762:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ff61d0e3370) has no exports 00000100:00100000:2.0:1788838270.815227:0:92476:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ff62bd67800:92476] 1 exiting: rc = 0 00000020:00000080:2.0:1788838270.815315:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff619428000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788838270.815324:0:27607:0:(genops.c:885:class_export_put()) final put ffff8ff624a90000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788838270.815327:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff624a90000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788838270.815331:0:27607:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788838270.815393:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d519000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788838270.815397:0:27607:0:(genops.c:885:class_export_put()) final put ffff8ff50d51c800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788838270.815399:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d51c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788838270.815402:0:27607:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788838270.815426:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d518000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788838270.825232:0:15289:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff50d58f800: total 0 00010000:00010000:2.0:1788838270.825304:0:15289:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff50d58f800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788838270.825340:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148fc00/0x88da08396ccc9ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9aae expref: 14 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825359:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601529e00/0x88da08396ccc9ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9abc expref: 13 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825371:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712c000/0x88da08396ccc9639 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9632 expref: 12 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825384:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712c600/0x88da08396ccc96b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc96b0 expref: 11 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825394:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601528e00/0x88da08396ccc9ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9aca expref: 10 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825406:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50712d800/0x88da08396ccc96c5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc96be expref: 9 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825441:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148e400/0x88da08396ccc9adf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9ad8 expref: 8 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825454:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600031800/0x88da08396ccc9655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc964e expref: 7 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825465:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600030000/0x88da08396ccc9663 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc965c expref: 6 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825476:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9afb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9af4 expref: 5 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825485:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9ae6 expref: 4 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825496:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9b09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9b02 expref: 3 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825504:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff600030c00/0x88da08396ccc968d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9686 expref: 2 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825513:0:15289:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff50d58f800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788838270.825531:0:15289:0:(genops.c:885:class_export_put()) final put ffff8ff50d58f800/57943c9a-ca27-46d8-8845-5d2bce640e45 00000020:00010000:2.0:1788838270.825554:0:15289:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff50711f000: total 1 00010000:00010000:2.0:1788838270.825572:0:15289:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff50711f000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1788838270.825590:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff504627200/0x88da08396ccc9a84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ced6 expref: 5 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825602:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601528600/0x88da08396ccc9a8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cedd expref: 4 pid: 92475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825623:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50b8e4000/0x88da08396ccc94e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce6d expref: 3 pid: 92476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825633:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc960f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005ce7b expref: 2 pid: 92477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838270.825643:0:15289:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff50711f000, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1788838270.825656:0:15289:0:(genops.c:885:class_export_put()) final put ffff8ff50711f000/2af93169-6705-472b-b7ff-fd7cc5c04782 00010000:00010000:2.0:1788838270.825661:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838270.825663:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838270.825665:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838270.825674:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788838270.825715:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d58f800/57943c9a-ca27-46d8-8845-5d2bce640e45 for MGS 00000020:00000080:0.0:1788838270.825761:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50711f000/2af93169-6705-472b-b7ff-fd7cc5c04782 for MGS 00000020:00000080:0.0:1788838270.825775:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50d58e800 for MGS 00000020:00000080:0.0:1788838270.825779:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50711b000 for MGS 00000100:00100000:2.0:1788838270.827901:0:92475:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ff62bd67400:92475] 0 exiting: rc = 1 00000100:00100000:2.0:1788838270.830270:0:92477:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ff62bca3200:92477] 2 exiting: rc = 0 00000100:00100000:0.0:1788838270.830429:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830438:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830444:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830449:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830455:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830460:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830465:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830472:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830476:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830482:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830487:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830493:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830499:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830504:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830509:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830514:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830519:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830524:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830530:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830551:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830556:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830561:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830566:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830571:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830576:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830581:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830585:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830590:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830595:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830599:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830604:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830609:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830614:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830620:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830625:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830630:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830635:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830640:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830645:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830651:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830656:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830662:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830667:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830672:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830677:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830681:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830686:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830691:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830697:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830703:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830711:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830716:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830721:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830727:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830741:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830747:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830793:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830827:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830833:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830839:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830845:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830851:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830857:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788838270.830863:0:93762:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788838270.835735:0:93762:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff61dfda120 - data ffff8ff63fe4b438/ffff8ff640e6a000 00000020:01000000:2.0:1788838270.835926:0:93762:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff640e746c0 - data ffff8ff633dd2438/ffff8ff6411acc00 00000020:00000080:2.0:1788838270.836389:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc94c6 00000020:00000080:2.0:1788838270.836399:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff50d58a800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788838270.836416:0:93762:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff62ceaa000 from MGS, refs=2 00000020:01000004:2.0:1788838270.836420:0:93762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff62ceaa000 2 00000020:01000004:2.0:1788838270.836423:0:93762:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff62ceaa000 from MGS 00000020:00000080:2.0:1788838270.836445:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838270.836455:0:93762:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788838270.836457:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff50d58d800/MGS 00000020:00000080:2.0:1788838270.836460:0:93762:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d58d800/MGS for MGS 00000020:01000000:2.0:1788838270.836467:0:93762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788838270.836542:0:93762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788838270.836546:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838270.836556:0:93762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788838270.836563:0:93762:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ff640eef800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788838270.836583:0:93762:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8ff6395619b8) has exports, disconnecting them 00000020:00080000:2.0:1788838270.836588:0:93762:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ff640eef800), last request at 1788838234 00000020:00000080:2.0:1788838270.836593:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9601 00000020:00080000:2.0:1788838270.836605:0:93762:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff640eef800): rc 0 00000020:00000080:2.0:1788838270.836609:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff640eef800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788838270.837301:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d58a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788838270.837310:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff640eef800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788838270.843878:0:93762:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788838270.843890:0:93762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788838270.843895:0:93762:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788838270.843904:0:93762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788838270.843939:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff640eeb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788838270.844126:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788838270.844138:0:93762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788838270.844144:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff627d1b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788838270.844147:0:93762:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627d1b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788838270.844157:0:93762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788838270.844249:0:93762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff62ceaa000 1 00000020:00000080:0.0:1788838270.844256:0:93762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc94b8 00000020:00000080:0.0:1788838270.844261:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff50d58c800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788838270.844270:0:93762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788838270.844278:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50d58c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788838270.844286:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788838270.844290:0:93762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788838270.844294:0:93762:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ff503ca19b8) has no exports 00000100:00100000:3.0:1788838270.852862:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135154048:0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.852936:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.852977:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135154560:0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.853003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.853029:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788838270.853035:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135153664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838270.853059:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.853090:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135154176:0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.853113:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.853130:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135154688:0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.853151:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.853176:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135153920:0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.853209:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.853228:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135154432:0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.853248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.853265:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788838270.853285:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135153792:0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.853308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.853331:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135154304:0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.853349:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.853375:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135153664 00000100:00100000:3.0:1788838270.853384:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135153664 00000100:00100000:3.0:1788838270.853421:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135154304 00000100:00100000:3.0:1788838270.853423:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135154304 00000100:00100000:3.0:1788838270.853437:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4233 00000100:00100000:3.0:1788838270.853444:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875729135153664:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788838270.853452:0:37907:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838270.853488:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3643:x1875729135153664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (428us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838270.853495:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4233 00000100:00100000:3.0:1788838270.853510:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4234 00000100:00100000:3.0:1788838270.853515:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1875729135154304:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838270.853519:0:37907:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838270.853543:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3646:x1875729135154304:12345-0@lo:400:kworker.0 Request processed in 27us (193us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838270.853548:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4234 00000100:00100000:3.0:1788838270.853565:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135154048 00000100:00100000:3.0:1788838270.853568:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135154048 00000100:00100000:3.0:1788838270.853586:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135154176 00000100:00100000:3.0:1788838270.853589:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135154176 00000100:00100000:3.0:1788838270.853612:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135154688 00000100:00100000:3.0:1788838270.853614:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135154688 00000100:00100000:3.0:1788838270.853623:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135153920 00000100:00100000:3.0:1788838270.853625:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135153920 00000100:00100000:3.0:1788838270.853636:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135153792 00000100:00100000:3.0:1788838270.853644:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135153792 00000100:00100000:3.0:1788838270.853658:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1788838270.853678:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135154176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.853718:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135154176:12345-0@lo:400:kworker.0 Request processed in 54us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838270.853724:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1788838270.853737:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1788838270.853743:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135153920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.853770:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135153920:12345-0@lo:400:kworker.0 Request processed in 27us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838270.853776:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1788838270.853787:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1788838270.853790:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875729135154048:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838270.853795:0:66253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838270.853854:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875729135154048:12345-0@lo:400:kworker.0 Request processed in 62us (918us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838270.853861:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1788838270.853872:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1788838270.853876:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875729135154688:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838270.853880:0:66253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838270.853899:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1875729135154688:12345-0@lo:400:kworker.0 Request processed in 21us (748us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838270.853904:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1788838270.853914:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1788838270.853917:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875729135153792:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788838270.853921:0:66253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838270.853948:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875729135153792:12345-0@lo:400:kworker.0 Request processed in 29us (639us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838270.853954:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:02020000:3.0:1788838270.853999:0:3643:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788838270.854004:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838270.854009:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838270.854013:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788838270.854021:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838270.854026:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3634 00000100:00080000:3.0:1788838270.854032:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838270.854050:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135154560 00000100:00100000:2.0:1788838270.854057:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135154560 00000100:00100000:3.0:1788838270.854062:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63f744e00 x1875729135154816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838270.854094:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135154432 00000100:00100000:3.0:1788838270.854096:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135154176:0@lo:400:kworker.0 00000100:00100000:2.0:1788838270.854099:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135154432 00000100:00080000:3.0:1788838270.854110:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838270.854114:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838270.854117:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788838270.854121:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838270.854125:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3634 00000100:00080000:3.0:1788838270.854130:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838270.854135:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:2.0:1788838270.854145:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135154560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.854146:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff63f746680 x1875729135154944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838270.854162:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135154688:0@lo:400:kworker.0 00000100:00080000:3.0:1788838270.854175:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838270.854194:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838270.854198:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788838270.854201:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838270.854206:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3634 00000100:00100000:2.0:1788838270.854210:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135154560:12345-0@lo:400:kworker.0 Request processed in 65us (1203us total) trans 0 rc 0/0 00000100:00080000:3.0:1788838270.854214:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838270.854224:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1788838270.854235:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504d7bb80 x1875729135155072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838270.854243:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:3.0:1788838270.854252:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135154048:0@lo:400:kworker.0 00000100:00100000:2.0:1788838270.854255:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135154432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.854273:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135154560:0@lo:400:kworker.0 00000100:00100000:2.0:1788838270.854296:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135154432:12345-0@lo:400:kworker.0 Request processed in 44us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838270.854304:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00080000:3.0:1788838270.854320:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838270.854324:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838270.854328:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788838270.854331:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838270.854335:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3634 00000100:00080000:3.0:1788838270.854340:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838270.854354:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504d7b800 x1875729135155200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838270.854364:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135153792:0@lo:400:kworker.0 00000100:00080000:3.0:1788838270.854375:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838270.854378:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8ff6061da800 already not connected (conn 71, was 70): CONNECTING 00000100:00100000:3.0:1788838270.854381:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135154304:0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.854391:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135153920:0@lo:400:kworker.0 00000100:00100000:3.0:1788838270.854411:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135154432:0@lo:400:kworker.0 00000100:00080000:3.0:1788838270.854436:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838270.854440:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838270.854443:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838270.854452:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135154816:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788838270.854488:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.856910:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135154944:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788838270.856976:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.856996:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135155072:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788838270.857016:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.857033:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135155200:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788838270.857052:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838270.857181:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135154944 00000100:00100000:3.0:1788838270.857197:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135154944 00000100:00100000:3.0:1788838270.857231:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135155072 00000100:00100000:3.0:1788838270.857234:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135155072 00000100:00100000:3.0:1788838270.857246:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135155200 00000100:00100000:3.0:1788838270.857248:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135155200 00000100:00100000:3.0:1788838270.857264:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1788838270.857271:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135154944:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788838270.857292:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838270.857331:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135154944:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 58us (354us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838270.857338:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1788838270.857354:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1788838270.857357:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135155072:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788838270.857382:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838270.857405:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135155072:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 46us (388us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838270.857411:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1788838270.857421:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:3.0:1788838270.857424:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135155200:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788838270.857432:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838270.857453:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135155200:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 26us (399us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838270.857459:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00080000:3.0:1788838270.857496:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838270.857502:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838270.857505:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135154944:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788838270.857513:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838270.857516:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838270.857519:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135155072:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788838270.857526:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838270.857529:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838270.857532:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135155200:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788838270.859035:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135154816 00000100:00100000:0.0:1788838270.859055:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135154816 00000100:00100000:0.0:1788838270.859111:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4235 00000100:00100000:0.0:1788838270.859117:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135154816:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788838270.859135:0:37907:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838270.859213:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135154816:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 95us (4730us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838270.859221:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4235 00000100:00080000:0.0:1788838270.859277:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838270.859283:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838270.859287:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135154816:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1788838271.038989:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838271.149330:0:93762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838271.149345:0:93762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788838271.149353:0:93762:0:(genops.c:885:class_export_put()) final put ffff8ff627f2d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788838271.149621:0:93762:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627f2d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788838271.149633:0:93762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788838271.150321:0:93762:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ff627f28000 00000020:02000400:1.0:1788838271.153460:0:93762:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:2.0:1788838271.872472:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788838271.872488:0:75678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411472 is committed 00000020:00000080:2.0:1788838271.872493:0:75678:0:(genops.c:885:class_export_put()) final put ffff8ff632f55800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788838271.872564:0:75678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411471 is committed 00000020:00000080:3.0:1788838271.874260:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632f55800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788838271.874321:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff632f50800 for lustre-MDT0001 00010000:00010000:1.0:1788838271.881197:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881213:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881222:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881228:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838271.881233:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881241:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881256:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff8ff612676400) 00010000:00010000:1.0:1788838271.881270:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838271.881274:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881281:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e9e00/0x88da08396ccc9d08 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881307:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881314:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881329:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881334:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838271.881337:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881343:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881351:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8ff50b021900) 00010000:00010000:1.0:1788838271.881353:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838271.881356:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881362:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff626ab9c00/0x88da08396ccc9d1d lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881372:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881387:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881392:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881396:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838271.881399:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881405:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881412:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff8ff6082c8000) 00010000:00010000:1.0:1788838271.881414:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838271.881418:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881424:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff504627e00/0x88da08396ccc9d63 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881440:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881446:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881452:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881457:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838271.881463:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881470:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881478:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8ff612676b00) 00010000:00010000:1.0:1788838271.881480:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838271.881482:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838271.881488:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50a2e8200/0x88da08396ccc9d78 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838272.066402:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838272.076304:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838272.076350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838272.076422:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116468352 00000100:00100000:3.0:1788838272.076432:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116468352 00000100:00100000:3.0:1788838272.076483:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1407 00000100:00100000:3.0:1788838272.076491:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2407:x1875729116468352:12345-192.168.203.30@tcp:400:kworker.0 00000020:00080000:3.0:1788838272.076500:0:66253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.30@tcp 00000100:00100000:3.0:1788838272.076556:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2407:x1875729116468352:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 64us (262us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838272.076564:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1407 00000400:00000100:1.0:1788838272.076866:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116468224 offset 0 length 224: 4 00000100:00100000:1.0:1788838272.076888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838272.076914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838272.077015:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116468480 00000100:00100000:3.0:1788838272.077019:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116468480 00000100:00100000:3.0:1788838272.077077:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1381 00000100:00100000:3.0:1788838272.077084:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2407:x1875729116468480:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838272.077135:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2407:x1875729116468480:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 51us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838272.077141:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1381 00000100:00080000:3.0:1788838272.077159:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838272.083531:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838272.085241:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116468608 00000100:00100000:0.0:1788838272.085255:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116468608 00000100:00100000:0.0:1788838272.085357:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116468736 00000100:00100000:0.0:1788838272.085361:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116468736 00000100:00100000:3.0:1788838272.085584:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2680 00000100:00100000:3.0:1788838272.085596:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116468608:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838272.085687:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116468608:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 93us (9335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838272.085694:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2680 00000100:00080000:2.0:1788838272.090024:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838272.090033:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838272.093362:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2681 00000100:00100000:0.0:1788838272.093377:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116468736:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838272.093461:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116468736:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 88us (16546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838272.093470:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2681 00000100:00100000:0.0:1788838272.093501:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116468864 00000100:00100000:0.0:1788838272.093508:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116468864 00000100:00100000:0.0:1788838272.093530:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1408 00000100:00100000:0.0:1788838272.093535:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116468864:12345-192.168.203.30@tcp:38:ptlrpcd_01_01.0 00010000:00020000:0.0:1788838272.093555:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838272.093580:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116468864:12345-192.168.203.30@tcp:38:ptlrpcd_01_01.0 Request processed in 44us (10060us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838272.093595:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1408 00000100:00100000:2.0:1788838272.381266:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135155328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838272.381349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838272.381857:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135155328 00000100:00100000:1.0:1788838272.381867:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135155328 00000100:00100000:1.0:1788838272.381928:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:1.0:1788838272.381937:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135155328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838272.381965:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838272.382016:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135155328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838272.382023:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000100:00100000:1.0:1788838272.382069:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135155328:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788838272.382408:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838272.382593:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838272.382603:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135155456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838272.382638:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838272.382701:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135155456 00000100:00100000:3.0:1788838272.382706:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135155456 00000100:00100000:3.0:1788838272.382742:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:3.0:1788838272.382749:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135155456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838272.382776:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838272.382845:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135155456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838272.382860:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00080000:2.0:1788838272.382952:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838272.382975:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135155456:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788838273.085372:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788838273.938903:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788838273.938913:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff5031c7000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788838273.939002:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969457 is committed 00000020:00000080:2.0:1788838273.943962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5031c7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788838273.944052:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5031c2000 for lustre-OST0001 00010000:00010000:2.0:1788838274.112061:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838275.133055:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838275.964984:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838275.964990:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838275.964993:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838275.965002:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3664 00000100:00080000:0.0:1788838275.965007:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838275.965014:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838275.965037:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd1f80 x1875729135155712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838275.965063:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838275.965066:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838275.965068:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838275.965071:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3664 00000100:00080000:0.0:1788838275.965073:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838275.965076:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838275.965087:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd1c00 x1875729135155968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838275.965108:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838275.965112:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838275.965114:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838275.965118:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3664 00000100:00100000:3.0:1788838275.965133:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135155840:0@lo:400:kworker.0 00000100:00080000:0.0:1788838275.965133:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838275.965137:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838275.965161:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd3100 x1875729135156224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838275.965181:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838275.965184:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838275.965186:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838275.965189:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3664 00000100:00080000:0.0:1788838275.965192:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838275.965194:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838275.965203:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd2680 x1875729135156608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838275.965209:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838275.965239:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135155712:0@lo:38:kworker.0 00000100:00100000:3.0:1788838275.965251:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788838275.965256:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135155584:0@lo:400:kworker.0 00000100:00100000:0.0:1788838275.965270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1788838275.965271:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135155584 offset 0 length 224: 4 00000100:00100000:3.0:1788838275.965293:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135156480:0@lo:400:kworker.0 00000100:00100000:0.0:1788838275.965293:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135155968:0@lo:38:kworker.0 00000100:00100000:3.0:1788838275.965314:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838275.965314:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838275.965328:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135156224:0@lo:38:kworker.0 00000100:00100000:3.0:1788838275.965344:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135155840 00000100:00100000:0.0:1788838275.965351:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838275.965352:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135155840 00000100:00100000:0.0:1788838275.965379:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135156608:0@lo:38:kworker.0 00000100:00100000:0.0:1788838275.965400:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838275.965469:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135156352:0@lo:400:kworker.0 00000100:00100000:1.0:1788838275.965498:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838275.965525:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838275.965529:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135156096:0@lo:400:kworker.0 00000100:00100000:1.0:1788838275.965548:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838275.965667:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135156480 00000100:00100000:2.0:1788838275.965673:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135156480 00000100:00100000:2.0:1788838275.965702:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135156352 00000100:00100000:2.0:1788838275.965704:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135156352 00000100:00100000:2.0:1788838275.965737:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:2.0:1788838275.965748:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135156480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838275.965819:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135156480:12345-0@lo:400:kworker.0 Request processed in 73us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838275.965826:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:2.0:1788838275.965844:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:2.0:1788838275.965851:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135156352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838275.965879:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135156352:12345-0@lo:400:kworker.0 Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838275.965885:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:2.0:1788838275.965904:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135156224 00000100:00100000:2.0:1788838275.965908:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135156224 00000100:00100000:2.0:1788838275.965945:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4236 00000100:00100000:2.0:1788838275.965950:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135156224:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838275.965969:0:8471:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838275.966024:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135156224:12345-0@lo:38:kworker.0 Request processed in 72us (671us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838275.966030:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4236 00000100:00080000:2.0:1788838275.966046:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838275.966050:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838275.966053:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838275.966085:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838275.966089:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838275.966092:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135156224:0@lo:38:kworker.0 00000100:00100000:3.0:1788838275.975515:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135155712 00000100:00100000:3.0:1788838275.975746:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135155712 00000100:00100000:3.0:1788838275.975833:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135155968 00000100:00100000:3.0:1788838275.975837:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135155968 00000100:00100000:3.0:1788838275.975848:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135156608 00000100:00100000:3.0:1788838275.975850:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135156608 00000100:00100000:3.0:1788838275.975866:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1788838275.975883:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135155840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838275.976030:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135156352:0@lo:400:kworker.0 00000100:00100000:1.0:1788838275.976121:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135156096 00000100:00100000:1.0:1788838275.976126:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135156096 00000100:00100000:1.0:1788838275.976173:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1788838275.976180:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135156096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838275.976249:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1788838275.976256:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135155712:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838275.976275:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838275.978466:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135155840:12345-0@lo:400:kworker.0 Request processed in 2584us (13248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838275.978480:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1788838275.978515:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:2.0:1788838275.978959:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1788838275.978965:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135156608:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788838275.978987:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838275.979074:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135155968:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838275.979084:0:66253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838275.979136:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135155968:12345-0@lo:38:kworker.0 Request processed in 62us (13821us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838275.979167:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1788838275.979230:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135156480:0@lo:400:kworker.0 00000100:00100000:3.0:1788838275.979244:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135155840:0@lo:400:kworker.0 00000100:00080000:3.0:1788838275.979288:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838275.979313:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838275.979318:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838275.979322:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135155968:0@lo:38:kworker.0 00000100:00100000:1.0:1788838275.981350:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135156096:12345-0@lo:400:kworker.0 Request processed in 5161us (15790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838275.981363:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1788838275.981442:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135156096:0@lo:400:kworker.0 00000100:00080000:1.0:1788838275.981624:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838275.981630:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838275.981633:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135156608:0@lo:38:kworker.0 00000100:00100000:0.0:1788838275.982741:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135155712:12345-0@lo:38:kworker.0 Request processed in 6479us (17465us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838275.982768:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00080000:1.0:1788838275.982926:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838275.982931:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838275.982934:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135155712:0@lo:38:kworker.0 00000100:00100000:2.0:1788838275.984777:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135156608:12345-0@lo:38:kworker.0 Request processed in 5803us (19368us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838275.984791:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000001:00100000:1.0:1788838275.986310:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788838275.986320:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff632f53000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788838275.987342:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632f53000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788838275.987402:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff632f52800 for lustre-OST0000 00010000:00010000:3.0:1788838276.157070:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838277.181051:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1788838277.181085:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838277.181093:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838277.181112:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838277.181115:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116469120 00000100:00100000:2.0:1788838277.181124:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116469120 00000400:00000100:3.0:1788838277.181127:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116468992 offset 0 length 224: 4 00000100:00100000:2.0:1788838277.181171:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116469248 00000100:00100000:2.0:1788838277.181174:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116469248 00000100:00100000:3.0:1788838277.181178:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00080000:3.0:1788838277.181209:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838277.181219:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1384 00000100:00100000:2.0:1788838277.181230:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2406:x1875729116469248:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838277.181282:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1412 00000100:00100000:1.0:1788838277.181300:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116469120:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:1.0:1788838277.181322:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838277.181323:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2406:x1875729116469248:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 96us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838277.181339:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1384 00000100:00100000:1.0:1788838277.181349:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116469120:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 49us (309us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838277.181355:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1412 00000100:00100000:0.0:1788838277.181614:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116469504 00000100:00100000:0.0:1788838277.181619:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116469504 00000100:00100000:0.0:1788838277.181668:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116469376 00000100:00100000:0.0:1788838277.181671:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116469376 00000100:00100000:0.0:1788838277.181701:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2684 00000100:00100000:0.0:1788838277.181709:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116469504:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838277.181748:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116469504:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838277.181754:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2684 00000100:00100000:0.0:1788838277.181769:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2685 00000100:00100000:0.0:1788838277.181775:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116469376:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838277.181823:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116469376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 48us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838277.181829:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2685 00000100:00080000:3.0:1788838277.181957:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838277.181961:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838277.501751:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135156736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838277.501853:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838277.501952:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135156736 00000100:00100000:2.0:1788838277.501960:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135156736 00000100:00100000:0.0:1788838277.501962:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135156864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838277.502002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788838277.502158:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838277.502269:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135156864 00000100:00100000:2.0:1788838277.502274:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135156864 00000100:00100000:2.0:1788838277.502319:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1788838277.502329:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135156736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838277.502359:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838277.502412:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135156736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838277.502419:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1788838277.502436:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1788838277.502442:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135156864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838277.502469:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838277.502503:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135156864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838277.502509:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1788838277.502559:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135156736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838277.502604:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135156864:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788838277.502729:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788838278.206198:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838279.229009:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838280.254750:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788838281.085816:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838281.085822:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838281.085826:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838281.085833:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3669 00000100:00080000:2.0:1788838281.085838:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788838281.085860:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838281.085885:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd6ca80 x1875729135157120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838281.085912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838281.085915:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838281.085917:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838281.085920:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3669 00000100:00080000:2.0:1788838281.085922:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788838281.085926:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838281.085937:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd6c380 x1875729135157376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838281.085953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838281.085957:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838281.085958:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838281.085963:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3669 00000100:00080000:2.0:1788838281.085965:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788838281.085969:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838281.085980:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5048d0000 x1875729135157632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838281.086000:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838281.086003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788838281.086005:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838281.086009:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3669 00000100:00080000:2.0:1788838281.086011:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788838281.086020:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838281.086032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff639541180 x1875729135158016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838281.086205:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135157760:0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.086275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838281.086331:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788838281.086338:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135156992:0@lo:400:kworker.0 00000400:00000100:2.0:1788838281.086358:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135156992 offset 0 length 224: 4 00000100:00100000:2.0:1788838281.086379:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135157888:0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.086400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838281.086431:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135157504:0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.086457:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838281.086490:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838281.086496:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135157248:0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.086519:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838281.086615:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135157760 00000100:00100000:2.0:1788838281.086622:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135157760 00000100:00100000:2.0:1788838281.086664:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135157888 00000100:00100000:2.0:1788838281.086667:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135157888 00000100:00100000:2.0:1788838281.086689:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:2.0:1788838281.086698:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135157760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.086749:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135157760:12345-0@lo:400:kworker.0 Request processed in 52us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838281.086756:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:2.0:1788838281.086770:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:2.0:1788838281.086776:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135157888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.086844:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135157888:12345-0@lo:400:kworker.0 Request processed in 69us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838281.086851:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:2.0:1788838281.086872:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135157504 00000100:00100000:2.0:1788838281.086875:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135157504 00000100:00100000:2.0:1788838281.086899:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135157248 00000100:00100000:2.0:1788838281.086902:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135157248 00000100:00100000:2.0:1788838281.086919:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1788838281.086925:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135157504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.086959:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135157504:12345-0@lo:400:kworker.0 Request processed in 34us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838281.086965:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1788838281.086977:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:2.0:1788838281.086983:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135157248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.087008:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135157248:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838281.087014:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:2.0:1788838281.087054:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135157248:0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.087065:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135157504:0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.087092:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135157888:0@lo:400:kworker.0 00000100:00100000:2.0:1788838281.087101:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135157760:0@lo:400:kworker.0 00000100:00080000:3.0:1788838281.087193:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838281.087198:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838281.087200:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838281.087924:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135157120:0@lo:38:kworker.0 00000100:00100000:1.0:1788838281.087970:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838281.087997:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135157376:0@lo:38:kworker.0 00000100:00100000:1.0:1788838281.088018:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838281.088041:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135157632:0@lo:38:kworker.0 00000100:00100000:1.0:1788838281.088064:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838281.088090:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135158016:0@lo:38:kworker.0 00000100:00100000:1.0:1788838281.088112:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838281.088156:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135157120 00000100:00100000:1.0:1788838281.088161:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135157120 00000100:00100000:1.0:1788838281.088186:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135157376 00000100:00100000:1.0:1788838281.088189:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135157376 00000100:00100000:1.0:1788838281.088198:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135158016 00000100:00100000:1.0:1788838281.088200:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135158016 00000100:00100000:1.0:1788838281.088211:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1788838281.088216:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135157120:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838281.088235:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838281.088271:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135157120:12345-0@lo:38:kworker.0 Request processed in 53us (300us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838281.088290:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1788838281.088406:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135157632 00000100:00100000:3.0:1788838281.088410:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135157632 00000100:00100000:3.0:1788838281.088433:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4237 00000100:00100000:3.0:1788838281.088438:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135157632:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838281.088455:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838281.088497:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135157632:12345-0@lo:38:kworker.0 Request processed in 57us (431us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838281.088504:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4237 00000100:00100000:1.0:1788838281.088551:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1788838281.088559:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135157376:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838281.088570:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838281.088605:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135157376:12345-0@lo:38:kworker.0 Request processed in 36us (576us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838281.088965:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1788838281.088971:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135158016:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838281.088982:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838281.089011:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135158016:12345-0@lo:38:kworker.0 Request processed in 39us (898us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838281.089017:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:1.0:1788838281.090782:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00080000:1.0:1788838281.090868:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838281.090874:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838281.090878:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135157120:0@lo:38:kworker.0 00000100:00080000:1.0:1788838281.090890:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838281.090893:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838281.090896:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135157376:0@lo:38:kworker.0 00000100:00080000:1.0:1788838281.090906:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838281.090910:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838281.090912:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135157632:0@lo:38:kworker.0 00000100:00080000:1.0:1788838281.090921:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838281.090924:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788838281.090927:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135158016:0@lo:38:kworker.0 00010000:00010000:2.0:1788838281.278281:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838282.301382:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838282.305924:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:1.0:1788838282.305962:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116469632 offset 0 length 224: 4 00000100:00100000:1.0:1788838282.305982:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838282.306012:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116469888 00000100:00100000:1.0:1788838282.306020:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838282.306023:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116469888 00000100:00100000:1.0:1788838282.306080:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838282.306090:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116469760 00000100:00100000:3.0:1788838282.306095:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116469760 00000100:00080000:1.0:1788838282.306136:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838282.306137:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1387 00000100:00100000:3.0:1788838282.306150:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2406:x1875729116469888:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838282.306158:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1416 00000100:00100000:1.0:1788838282.306166:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116469760:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:1.0:1788838282.306189:0:76060:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838282.306223:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2406:x1875729116469888:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838282.306231:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1387 00000100:00100000:0.0:1788838282.306251:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116470144 00000100:00100000:0.0:1788838282.306257:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116470144 00000100:00100000:0.0:1788838282.306295:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116470016 00000100:00100000:0.0:1788838282.306298:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116470016 00000100:00100000:0.0:1788838282.306324:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2688 00000100:00100000:0.0:1788838282.306332:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116470144:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838282.306393:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5982 00000100:00100000:2.0:1788838282.306403:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116470016:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1788838282.306430:0:8657:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9c67 00000100:00080000:2.0:1788838282.306440:0:8657:0:(import.c:65:import_set_state_nolock()) ffff8ff63f78e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788838282.306482:0:8657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969455 00000100:00100000:1.0:1788838282.309280:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2403:x1875729116469760:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 3101us (3247us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838282.309294:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1416 00010000:00010000:1.0:1788838282.309337:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788838282.309347:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838282.309352:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838282.312655:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+2:2403:x1875729116470016:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 6240us (6567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838282.312677:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5982 00000100:00100000:0.0:1788838282.312812:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116470144:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 6462us (6810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838282.312839:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2688 00000100:00100000:0.0:1788838282.621422:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135158272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838282.621774:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838282.621868:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838282.621875:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135158144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838282.621901:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838282.622102:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135158272 00000100:00100000:2.0:1788838282.622118:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135158272 00000100:00100000:2.0:1788838282.622163:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135158144 00000100:00100000:2.0:1788838282.622166:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135158144 00000100:00100000:2.0:1788838282.622180:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1788838282.622187:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135158272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788838282.622215:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838282.622258:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135158272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838282.622265:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1788838282.622290:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1788838282.622296:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135158144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838282.622310:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838282.622331:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135158144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838282.622336:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:0.0:1788838282.623642:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135158144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838282.623662:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135158272:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788838283.325500:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838284.357240:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838285.390624:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838286.209826:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838286.209833:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838286.209837:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838286.209845:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3675 00000100:00080000:0.0:1788838286.209850:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788838286.209858:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838286.209880:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd1c00 x1875729135158528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838286.209907:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838286.209910:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838286.209911:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838286.209914:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3675 00000100:00080000:0.0:1788838286.209917:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788838286.209920:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838286.209943:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd3b80 x1875729135158784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838286.209967:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838286.209970:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838286.209972:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838286.209976:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3675 00000100:00080000:0.0:1788838286.209978:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788838286.209982:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838286.209995:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd3100 x1875729135159040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838286.210017:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838286.210020:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838286.210022:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838286.210025:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3675 00000100:00080000:0.0:1788838286.210027:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788838286.210031:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838286.210040:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6407a9880 x1875729135159424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838286.210108:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135158400:0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.217204:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135158528:0@lo:38:kworker.0 00000100:00100000:0.0:1788838286.217286:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838286.217324:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135158784:0@lo:38:kworker.0 00000100:00100000:0.0:1788838286.217347:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838286.217365:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135159040:0@lo:38:kworker.0 00000100:00100000:0.0:1788838286.217397:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838286.217418:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135159424:0@lo:38:kworker.0 00000100:00100000:0.0:1788838286.217438:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838286.217477:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135158912:0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.217501:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838286.217520:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838286.217526:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135159168:0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.217550:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838286.217586:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135158528 00000100:00100000:0.0:1788838286.217594:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135158528 00000100:00100000:0.0:1788838286.217627:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1788838286.217634:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135158528:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838286.217662:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838286.217704:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135158528:12345-0@lo:38:kworker.0 Request processed in 68us (418us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838286.217711:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1788838286.217726:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135158784 00000100:00100000:0.0:1788838286.217730:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135158784 00000100:00100000:0.0:1788838286.217742:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135159424 00000100:00100000:0.0:1788838286.217745:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135159424 00000100:00100000:0.0:1788838286.217751:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135158912 00000100:00100000:0.0:1788838286.217753:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135158912 00000100:00100000:0.0:1788838286.217781:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1788838286.217788:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135158912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.217856:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135158912:12345-0@lo:400:kworker.0 Request processed in 68us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838286.217863:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1788838286.217885:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1788838286.217889:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135158784:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838286.217900:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838286.217926:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135158784:12345-0@lo:38:kworker.0 Request processed in 35us (577us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838286.217932:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1788838286.217942:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1788838286.217946:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135159424:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838286.217954:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838286.217977:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875729135159424:12345-0@lo:38:kworker.0 Request processed in 29us (537us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838286.217982:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1788838286.218005:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135159040 00000100:00100000:0.0:1788838286.218009:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135159040 00000100:00100000:0.0:1788838286.218029:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4238 00000100:00100000:0.0:1788838286.218034:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135159040:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838286.218043:0:8472:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838286.218066:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135159040:12345-0@lo:38:kworker.0 Request processed in 31us (668us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838286.218072:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4238 00000400:00000100:0.0:1788838286.218116:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135158400 offset 0 length 224: 4 00000100:00100000:0.0:1788838286.218142:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135159296:0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.218166:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838286.218187:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838286.218193:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135158656:0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.218224:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838286.218251:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135159168 00000100:00100000:0.0:1788838286.218254:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135159168 00000100:00100000:0.0:1788838286.218280:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135159296 00000100:00100000:0.0:1788838286.218283:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135159296 00000100:00100000:0.0:1788838286.218302:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1788838286.218308:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135159168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.218340:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135159168:12345-0@lo:400:kworker.0 Request processed in 33us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838286.218346:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1788838286.218358:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690 00000100:00100000:0.0:1788838286.218363:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135159296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.218389:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135159296:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838286.218394:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690 00000100:00100000:0.0:1788838286.218438:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135159168:0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.218452:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135158912:0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.218485:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135159296:0@lo:400:kworker.0 00000100:00080000:0.0:1788838286.218506:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838286.218511:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838286.218514:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135158528:0@lo:38:kworker.0 00000100:00080000:0.0:1788838286.218522:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838286.218525:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838286.218528:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135158784:0@lo:38:kworker.0 00000100:00080000:0.0:1788838286.218548:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838286.218552:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838286.218554:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135159040:0@lo:38:kworker.0 00000100:00080000:0.0:1788838286.218562:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838286.218565:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838286.218567:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135159424:0@lo:38:kworker.0 00000100:00100000:0.0:1788838286.218592:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135158656 00000100:00100000:0.0:1788838286.218595:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135158656 00000100:00100000:0.0:1788838286.218619:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1788838286.218626:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135158656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838286.218658:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135158656:12345-0@lo:400:kworker.0 Request processed in 33us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838286.218665:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1788838286.218690:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135158656:0@lo:400:kworker.0 00000100:00080000:1.0:1788838286.218983:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838286.218988:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838286.218990:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788838286.397137:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838287.240402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000400:00000100:0.0:1788838287.240440:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.203.30@tcp portal 26 match 1875729116470272 offset 0 length 520: 4 00000100:00100000:0.0:1788838287.240463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838287.240507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838287.240550:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116470528 00000100:00100000:0.0:1788838287.240565:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116470528 00000100:00100000:0.0:1788838287.240626:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116470400 00000100:00100000:0.0:1788838287.240630:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116470400 00000100:00100000:0.0:1788838287.240649:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1390 00000100:00100000:0.0:1788838287.240659:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2404:x1875729116470528:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838287.240739:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2404:x1875729116470528:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 81us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838287.240761:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1390 00000100:00100000:0.0:1788838287.240780:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1420 00000100:00100000:0.0:1788838287.240785:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116470400:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:0.0:1788838287.240832:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838287.240862:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116470400:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 75us (354us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838287.240869:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1420 00000100:00080000:0.0:1788838287.240887:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838287.241175:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116470656 00000100:00100000:2.0:1788838287.241180:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116470656 00000100:00100000:2.0:1788838287.241225:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2691 00000100:00100000:2.0:1788838287.241232:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2404:x1875729116470656:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838287.241276:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2404:x1875729116470656:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 44us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838287.241283:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2691 00000100:00080000:0.0:1788838287.241731:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788838287.420948:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788838287.746735:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000020:00000080:1.0:1788838287.746746:0:8455:0:(genops.c:885:class_export_put()) final put ffff8ff63f78f800/efc561ba-875e-4857-b79b-9bd7023bd57c 00000020:00000080:2.0:1788838287.747057:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff63f78f800/efc561ba-875e-4857-b79b-9bd7023bd57c for lustre-OST0000 00000020:00000080:2.0:1788838287.747125:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff63f78e000 for lustre-OST0000 00000100:00100000:0.0:1788838287.748547:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135159552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838287.748629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838287.748770:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135159552 00000100:00100000:1.0:1788838287.748779:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135159552 00000100:00100000:1.0:1788838287.748847:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:1.0:1788838287.748856:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135159552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838287.748884:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838287.748930:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135159552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838287.748937:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:1.0:1788838287.748989:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135159552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838287.749147:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838287.749157:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135159680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838287.749186:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838287.749217:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135159680 00000100:00100000:2.0:1788838287.749221:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135159680 00000100:00100000:2.0:1788838287.749243:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1788838287.749248:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135159680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838287.749262:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838287.749291:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135159680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838287.749297:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1788838287.749319:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135159680:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788838288.456732:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838289.479665:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838290.494032:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838291.328141:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838291.328147:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838291.328151:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838291.329834:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3680 00000100:00080000:0.0:1788838291.329839:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838291.329847:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838291.329880:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef0a80 x1875729135159936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838291.329919:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838291.329923:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838291.329925:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838291.329929:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3680 00000100:00080000:0.0:1788838291.329944:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838291.329949:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838291.329962:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef3b80 x1875729135160192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838291.329980:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838291.329983:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838291.329984:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838291.329988:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3680 00000100:00080000:0.0:1788838291.329991:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838291.329994:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838291.330004:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef1180 x1875729135160448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838291.330026:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838291.330029:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838291.330030:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838291.330034:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3680 00000100:00080000:0.0:1788838291.330036:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838291.330039:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838291.330702:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135159936:0@lo:38:kworker.0 00000100:00100000:3.0:1788838291.330777:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838291.330834:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135160192:0@lo:38:kworker.0 00000100:00100000:3.0:1788838291.330871:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838291.330889:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135160448:0@lo:38:kworker.0 00000100:00100000:3.0:1788838291.330918:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838291.330960:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135160064:0@lo:400:kworker.0 00000100:00100000:3.0:1788838291.330985:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838291.331005:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838291.331011:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135160320:0@lo:400:kworker.0 00000100:00100000:3.0:1788838291.331032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838291.331077:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135159936 00000100:00100000:3.0:1788838291.331085:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135159936 00000100:00100000:3.0:1788838291.331121:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135160192 00000100:00100000:3.0:1788838291.331124:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135160192 00000100:00100000:3.0:1788838291.331137:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135160064 00000100:00100000:3.0:1788838291.331139:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135160064 00000100:00100000:3.0:1788838291.331182:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135160320 00000100:00100000:3.0:1788838291.331185:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135160320 00000100:00100000:3.0:1788838291.331203:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:3.0:1788838291.331212:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135160064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838291.331265:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135160064:12345-0@lo:400:kworker.0 Request processed in 54us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838291.331272:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:3.0:1788838291.331288:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:3.0:1788838291.331294:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135160320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838291.331322:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135160320:12345-0@lo:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838291.331327:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:3.0:1788838291.331339:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1788838291.331350:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135159936:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838291.331368:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838291.331401:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135159936:12345-0@lo:38:kworker.0 Request processed in 50us (625us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838291.331408:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1788838291.331419:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1788838291.331423:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135160192:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838291.331432:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838291.331639:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135160192:12345-0@lo:38:kworker.0 Request processed in 214us (767us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838291.331645:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1788838291.331667:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135160448 00000100:00100000:3.0:1788838291.331671:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135160448 00000100:00100000:3.0:1788838291.331690:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4239 00000100:00100000:3.0:1788838291.331695:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135160448:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838291.331706:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838291.331732:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135160448:12345-0@lo:38:kworker.0 Request processed in 36us (813us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838291.331739:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4239 00000100:00080000:3.0:1788838291.331986:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838291.332019:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135160320:0@lo:400:kworker.0 00000100:00100000:3.0:1788838291.332031:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135160064:0@lo:400:kworker.0 00000100:00080000:3.0:1788838291.332075:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838291.332080:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838291.332090:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135159936:0@lo:38:kworker.0 00000100:00080000:3.0:1788838291.332102:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838291.332105:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838291.332107:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135160192:0@lo:38:kworker.0 00000100:00080000:3.0:1788838291.332115:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838291.332119:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838291.332121:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135160448:0@lo:38:kworker.0 00000100:00100000:0.0:1788838291.332256:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef2680 x1875729135160832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838291.332303:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135160576:0@lo:400:kworker.0 00000100:00100000:0.0:1788838291.332339:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838291.332366:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788838291.332373:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135159808:0@lo:400:kworker.0 00000400:00000100:0.0:1788838291.332404:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135159808 offset 0 length 224: 4 00000100:00100000:0.0:1788838291.332427:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135160704:0@lo:400:kworker.0 00000100:00100000:0.0:1788838291.332519:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838291.332623:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135160576 00000100:00100000:0.0:1788838291.332628:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135160576 00000100:00100000:0.0:1788838291.332664:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135160704 00000100:00100000:0.0:1788838291.332667:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135160704 00000100:00100000:0.0:1788838291.332690:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:0.0:1788838291.332697:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135160576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838291.332738:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135160576:12345-0@lo:400:kworker.0 Request processed in 41us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838291.332745:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:0.0:1788838291.332759:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:0.0:1788838291.332764:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135160704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838291.332791:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135160704:12345-0@lo:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838291.332814:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:0.0:1788838291.332847:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135160704:0@lo:400:kworker.0 00000100:00100000:0.0:1788838291.332856:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135160576:0@lo:400:kworker.0 00000100:00080000:3.0:1788838291.333000:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838291.333003:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838291.333012:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135160832:0@lo:38:kworker.0 00000100:00100000:3.0:1788838291.333042:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838291.333600:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135160832 00000100:00100000:0.0:1788838291.333606:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135160832 00000100:00100000:0.0:1788838291.333637:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:0.0:1788838291.333642:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135160832:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838291.333657:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838291.333784:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135160832:12345-0@lo:38:kworker.0 Request processed in 140us (741us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838291.333832:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00080000:2.0:1788838291.339895:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838291.339907:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838291.339912:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135160832:0@lo:38:kworker.0 00010000:00010000:3.0:1788838291.524319:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788838291.820932:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838275/real 1788838275] req@ffff8ff62bcd0700 x1875729135155584/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838291 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838291.820964:0:3644:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8ff62bcd0700 x1875729135155584/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838291 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838291.821001:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788838291.821006:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788838291.821009:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788838291.821010:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788838291.821015:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff62bcd0700 x1875729135155584/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788838291 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838291.821024:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff62bd6e680 x1875729135156992/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838297 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838291.821056:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff62bcd3480 x1875729135158400/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838302 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838291.821063:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ff640ef3480 x1875729135159808/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838307 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788838291.821082:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788838291.821085:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788838291.821086:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788838291.821088:0:3644:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788838291.821120:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135155584:0@lo:400:kworker.0 00000100:00100000:0.0:1788838291.821273:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135159808:0@lo:400:kworker.0 00000100:00100000:3.0:1788838291.821364:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135158400:0@lo:400:kworker.0 00000100:00100000:3.0:1788838291.821374:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135156992:0@lo:400:kworker.0 00000100:00080000:1.0:1788838291.821450:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838291.821461:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788838291.821464:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838291.821468:0:63434:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3628 00000100:00080000:1.0:1788838291.821475:0:63434:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838291.821503:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff50475c000 x1875729135160960/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838291.821686:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135160960:0@lo:250:kworker.0 00000400:00000100:2.0:1788838291.821731:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729135160960 offset 0 length 520: 4 00000100:00100000:1.0:1788838292.543352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838292.543401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838292.543863:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838292.543904:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116470912 00000100:00100000:1.0:1788838292.543916:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116470912 00000100:00100000:1.0:1788838292.543991:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116470784 00000100:00100000:1.0:1788838292.543995:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116470784 00000100:00100000:1.0:1788838292.544017:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1393 00000100:00100000:1.0:1788838292.544031:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2404:x1875729116470912:12345-192.168.203.30@tcp:400:kworker.0 00010000:00010000:0.0:1788838292.544179:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838292.544227:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1424 00000100:00100000:2.0:1788838292.544236:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116470784:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:2.0:1788838292.544266:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838292.544346:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116470784:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 109us (944us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788838292.544354:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1424 00000100:00100000:2.0:1788838292.544396:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116471040 00000100:00100000:2.0:1788838292.544400:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116471040 00000100:00100000:2.0:1788838292.544439:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5983 00000100:00100000:2.0:1788838292.544447:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116471040:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1788838292.544473:0:26207:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc98a1 00000100:00080000:2.0:1788838292.544483:0:26207:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788838292.544561:0:26207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969457 00000100:00100000:2.0:1788838292.544918:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+2:2403:x1875729116471040:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 471us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838292.544927:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5983 00000100:00100000:1.0:1788838292.549497:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2404:x1875729116470912:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 5456us (6147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838292.549652:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1393 00010000:00010000:2.0:1788838292.549779:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788838292.550774:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838292.550784:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838292.861182:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838292.861215:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135161088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838292.861312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838292.861378:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135161088 00000100:00100000:0.0:1788838292.861389:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135161088 00000100:00100000:0.0:1788838292.861451:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1788838292.861461:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135161088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838292.861499:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838292.861626:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135161088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 165us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838292.861633:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1788838292.861697:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135161088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838292.864314:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135161216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838292.864401:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838292.868258:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135161216 00000100:00100000:1.0:1788838292.868283:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135161216 00000100:00100000:1.0:1788838292.868400:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:1.0:1788838292.868414:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135161216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838292.868466:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838292.868596:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135161216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 185us (4194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838292.868620:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1788838292.871709:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135161216:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788838293.567321:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788838294.205733:0:94386:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788838294.205740:0:94386:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788838294.205741:0:94386:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788838294.206028:0:94386:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ff50a9bc000 00000020:01000004:1.0:1788838294.206053:0:94386:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788838294.206067:0:94386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788838294.206082:0:94386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ff6395619b8) 00000020:00000080:1.0:1788838294.206101:0:94386:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788838294.318767:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788838294.322615:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788838294.324055:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788838294.324572:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788838294.325046:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788838294.325293:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788838294.326605:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788838294.327880:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788838294.329080:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788838294.329684:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788838294.330411:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788838294.331016:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788838294.331819:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788838294.332326:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788838294.342178:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788838294.344607:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788838294.344992:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788838294.345308:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788838294.345657:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788838294.345900:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788838294.346214:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788838294.346584:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788838294.346789:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788838294.347141:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788838294.347335:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788838294.347592:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788838294.348085:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788838294.348331:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788838294.348767:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.349354:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788838294.349701:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.349987:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788838294.350203:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.350451:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788838294.350925:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788838294.351259:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788838294.351617:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.351856:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.352156:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.352362:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788838294.352700:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.353041:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.353234:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.353676:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.354018:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788838294.354589:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.354789:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788838294.356246:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00100000:10000000:2.0:1788838294.356282:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:2.0:1788838294.356310:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:2.0:1788838294.360235:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788838294.360739:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788838294.361087:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788838294.362244:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788838294.362635:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788838294.363488:0:94386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788838294.364227:0:94386:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788838294.365569:0:94386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788838294.365580:0:94386:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788838294.365593:0:94386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc9d8d 00000020:01000004:2.0:1788838294.365601:0:94386:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788838294.365614:0:94386:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788838294.365619:0:94386:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff50a9bc000 from MGS 00000020:01000004:2.0:1788838294.365623:0:94386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788838294.365635:0:94386:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ff61d0e3370) 00000020:00000080:2.0:1788838294.365648:0:94386:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1788838294.365715:0:94386:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff50a9bc000 from MGS, refs=2 00080000:01000000:2.0:1788838294.365720:0:94386:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788838294.365725:0:94386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc9d9b 00010000:00010000:2.0:1788838294.365883:0:94386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788838294.376094:0:94386:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788838294.382150:0:94390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788838294.382225:0:94386:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788838294.382278:0:94386:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788838294.384185:0:94386:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788838294.384660:0:94386:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788838294.384862:0:94386:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788838294.384869:0:94386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788838294.395931:0:94386:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788838294.395945:0:94386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788838294.400316:0:94386:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788838294.400330:0:94386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788838294.400927:0:94386:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788838294.400954:0:94386:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788838294.400956:0:94386:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788838294.400959:0:94386:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788838294.400964:0:94386:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 66, was 0): CONNECTING 00000100:00100000:1.0:1788838294.400970:0:94386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:3.0:1788838294.589055:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838295.613439:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838296.638065:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838296.960612:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838296.960623:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788838296.960627:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838296.960630:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838296.960635:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838296.960643:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3685 00000100:00080000:0.0:1788838296.960647:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838296.960655:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838296.960695:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef2a00 x1875729135161344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838296.960760:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838296.960771:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838296.960773:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838296.960777:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3685 00000100:00080000:0.0:1788838296.960779:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1788838296.960891:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838296.960905:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135161472:0@lo:400:kworker.0 00000100:00100000:1.0:1788838296.960979:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838296.961083:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135161344:0@lo:38:kworker.0 00000100:00100000:2.0:1788838296.961124:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838296.961206:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135161472 00000100:00100000:1.0:1788838296.961215:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135161472 00000100:00100000:1.0:1788838296.961271:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135161344 00000100:00100000:1.0:1788838296.961274:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135161344 00000100:00100000:1.0:1788838296.961296:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1788838296.961306:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135161472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838296.961361:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135161472:12345-0@lo:400:kworker.0 Request processed in 57us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838296.961381:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1788838296.961401:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1788838296.961404:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135161344:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838296.961423:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838296.961456:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135161344:12345-0@lo:38:kworker.0 Request processed in 49us (331us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838296.961462:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1788838296.961510:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135161472:0@lo:400:kworker.0 00000100:00080000:2.0:1788838296.961641:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838296.961667:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838296.961671:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838296.961675:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135161344:0@lo:38:kworker.0 00000100:00080000:0.0:1788838296.961947:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838296.961969:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef2a00 x1875729135161600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838296.962022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838296.962026:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838296.962028:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838296.962032:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3685 00000100:00080000:0.0:1788838296.962036:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838296.962039:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838296.962052:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef2680 x1875729135161856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838296.962083:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838296.962087:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838296.962089:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838296.962092:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3685 00000100:00080000:0.0:1788838296.962094:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838296.962097:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838296.962108:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640ef0a80 x1875729135162240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838296.962135:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135162112:0@lo:400:kworker.0 00000100:00100000:0.0:1788838296.962166:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838296.962188:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838296.962194:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135161984:0@lo:400:kworker.0 00000100:00100000:0.0:1788838296.962215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838296.962293:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838296.962302:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135161728:0@lo:400:kworker.0 00000100:00100000:3.0:1788838296.962331:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838296.962409:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135162112 00000100:00100000:2.0:1788838296.962415:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135162112 00000100:00100000:2.0:1788838296.962459:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135161984 00000100:00100000:2.0:1788838296.962462:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135161984 00000100:00100000:2.0:1788838296.962485:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:2.0:1788838296.962501:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135162112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838296.962552:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135162112:12345-0@lo:400:kworker.0 Request processed in 60us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838296.962558:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:2.0:1788838296.962571:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:2.0:1788838296.962576:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135161984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838296.962600:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135161984:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838296.962606:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:2.0:1788838296.962639:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135161984:0@lo:400:kworker.0 00000100:00100000:2.0:1788838296.962650:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135162112:0@lo:400:kworker.0 00000100:00100000:2.0:1788838296.962671:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135161600:0@lo:38:kworker.0 00000100:00100000:2.0:1788838296.962695:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838296.962713:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135161856:0@lo:38:kworker.0 00000100:00100000:2.0:1788838296.962791:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838296.962844:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135162240:0@lo:38:kworker.0 00000100:00100000:2.0:1788838296.962868:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838296.963222:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135161728 00000100:00100000:1.0:1788838296.963227:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135161728 00000100:00100000:1.0:1788838296.963267:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135161600 00000100:00100000:1.0:1788838296.963271:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135161600 00000100:00100000:1.0:1788838296.963286:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135162240 00000100:00100000:1.0:1788838296.963289:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135162240 00000100:00100000:1.0:1788838296.963300:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1788838296.963307:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135161728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838296.963350:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135161728:12345-0@lo:400:kworker.0 Request processed in 44us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838296.963357:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1788838296.963370:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1788838296.963374:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135161600:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838296.963391:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838296.963419:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135161600:12345-0@lo:38:kworker.0 Request processed in 43us (723us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838296.963425:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1788838296.963442:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1788838296.963446:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135162240:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788838296.963456:0:75504:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838296.963482:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135162240:12345-0@lo:38:kworker.0 Request processed in 34us (613us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838296.963487:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00080000:3.0:1788838296.963656:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838296.963661:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838296.963663:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838296.963687:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135161728:0@lo:400:kworker.0 00000100:00100000:0.0:1788838296.963914:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135161856 00000100:00100000:0.0:1788838296.963919:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135161856 00000100:00100000:0.0:1788838296.963952:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4240 00000100:00100000:0.0:1788838296.963957:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135161856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838296.963967:0:8472:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838296.963997:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135161856:12345-0@lo:38:kworker.0 Request processed in 38us (1205us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838296.964003:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4240 00000100:00080000:2.0:1788838296.964318:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838296.964324:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838296.964327:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135161600:0@lo:38:kworker.0 00000100:00080000:2.0:1788838296.964336:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838296.964340:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838296.964342:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135161856:0@lo:38:kworker.0 00000100:00080000:2.0:1788838296.964350:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838296.964353:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838296.964356:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135162240:0@lo:38:kworker.0 00000100:00100000:1.0:1788838297.661241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838297.661281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838297.661316:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838297.661347:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116471296 00000100:00100000:1.0:1788838297.661355:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116471296 00000100:00100000:1.0:1788838297.661409:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116471168 00000100:00100000:1.0:1788838297.661412:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116471168 00000100:00100000:1.0:1788838297.661431:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1396 00000100:00100000:1.0:1788838297.661442:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2407:x1875729116471296:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838297.661509:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2407:x1875729116471296:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 69us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838297.661517:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1396 00000100:00100000:1.0:1788838297.661535:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1428 00000100:00100000:1.0:1788838297.661539:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116471168:12345-192.168.203.30@tcp:38:kworker.0 00010000:00020000:1.0:1788838297.661557:0:67312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788838297.661582:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875729116471168:12345-192.168.203.30@tcp:38:kworker.0 Request processed in 41us (301us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838297.661588:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1428 00000100:00080000:1.0:1788838297.661607:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788838297.661928:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116471424 00000100:00100000:2.0:1788838297.661932:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116471424 00000100:00100000:2.0:1788838297.661952:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1788838297.661957:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1875729116471424:12345-192.168.203.30@tcp:250:kworker.0 00010000:00080000:2.0:1788838297.661973:0:94392:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp t0 exp 0000000000000000 cur 3691 last 0 00000020:00000080:2.0:1788838297.662024:0:94392:0:(genops.c:1385:class_connect()) connect: client 2af93169-6705-472b-b7ff-fd7cc5c04782, cookie 0x88da08396ccc9da2 00000100:00080000:2.0:1788838297.662151:0:94392:0:(import.c:65:import_set_state_nolock()) ffff8ff61d4bb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788838297.662188:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+5:2403:x1875729116471424:12345-192.168.203.30@tcp:250:kworker.0 Request processed in 229us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838297.662195:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00010000:00010000:3.0:1788838297.664401:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838297.981740:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838297.981767:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135162368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838297.981870:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838297.981907:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135162368 00000100:00100000:0.0:1788838297.981914:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135162368 00000100:00100000:0.0:1788838297.981965:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:0.0:1788838297.981975:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135162368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788838297.982019:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838297.982057:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135162496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838297.982059:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135162368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838297.982067:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:2.0:1788838297.982084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838297.982099:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135162496 00000100:00100000:0.0:1788838297.982103:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135162496 00000100:00100000:2.0:1788838297.982124:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135162368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838297.982162:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:0.0:1788838297.982169:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135162496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838297.982185:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838297.982228:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135162496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838297.982234:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:2.0:1788838297.982285:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5048d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135162496:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788838297.983327:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000020:00000080:0.0:1788838297.983335:0:9540:0:(genops.c:885:class_export_put()) final put ffff8ff62c81a000/efc561ba-875e-4857-b79b-9bd7023bd57c 00000020:00000080:1.0:1788838297.983424:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff62c81a000/efc561ba-875e-4857-b79b-9bd7023bd57c for lustre-OST0001 00000020:00000080:1.0:1788838297.983490:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff62c81d000 for lustre-OST0001 00010000:00010000:3.0:1788838298.685056:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838299.327525:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838299.327653:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116471552 00000100:00100000:3.0:1788838299.327667:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116471552 00000100:00100000:3.0:1788838299.327839:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1788838299.327851:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+5:70927:x1875729116471552:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838299.327875:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838299.327901:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9da9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf85 expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838299.327949:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9da9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf85 expref: 6 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838299.327984:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9da9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf85 expref: 6 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838299.328004:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4000, rc 0) 00000100:00100000:3.0:1788838299.328085:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70927:x1875729116471552:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 235us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838299.328093:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1788838299.342119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838299.342249:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116471680 00000100:00100000:1.0:1788838299.342265:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116471680 00000100:00100000:1.0:1788838299.342336:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:1.0:1788838299.342348:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70927:x1875729116471680:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788838299.342458:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70927:x1875729116471680:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 Request processed in 112us (367us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838299.342467:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1788838299.370084:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838299.370242:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116471808 00000100:00100000:2.0:1788838299.370256:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116471808 00000100:00100000:2.0:1788838299.370337:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1788838299.370351:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+6:70927:x1875729116471808:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838299.370377:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838299.370409:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc9db0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf8c expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838299.370445:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc9db0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf8c expref: 7 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838299.370460:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc9db0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf8c expref: 7 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838299.370471:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8200, rc 0) 00000100:00100000:2.0:1788838299.370572:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+7:70927:x1875729116471808:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 224us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838299.370580:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1788838299.384102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838299.384200:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116471936 00000100:00100000:3.0:1788838299.384213:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116471936 00000100:00100000:3.0:1788838299.384280:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1788838299.384290:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+7:70927:x1875729116471936:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788838299.385002:0:94396:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788838299.385147:0:94395:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 125 20000000:01000000:2.0:1788838299.387976:0:94397:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788838299.387987:0:94397:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788838299.387990:0:94397:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788838299.387993:0:94397:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788838299.388020:0:94397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:0.0:1788838299.388346:0:94395:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788838299.388452:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116471936:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 4155us (4357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838299.388472:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1788838299.400287:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838299.400894:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116472064 00000100:00100000:1.0:1788838299.400906:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116472064 00000100:00100000:1.0:1788838299.400982:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:1.0:1788838299.401002:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116472064:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838299.401219:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116472064:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 226us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838299.401228:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1788838299.408356:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838299.408679:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116472192 00000100:00100000:0.0:1788838299.408694:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116472192 00000100:00100000:0.0:1788838299.408775:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1788838299.408787:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116472192:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838299.408853:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838299.408883:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9db7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf93 expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838299.408919:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf93 expref: 9 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838299.408933:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf93 expref: 9 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838299.408944:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627e00, rc 0) 00000100:00100000:0.0:1788838299.409029:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116472192:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 244us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838299.409037:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1788838299.417008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838299.417114:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116472320 00000100:00100000:2.0:1788838299.417129:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116472320 00000100:00100000:2.0:1788838299.417219:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1788838299.417232:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116472320:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838299.417457:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116472320:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 228us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838299.417465:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1788838299.420041:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838299.420241:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116472448 00000100:00100000:1.0:1788838299.420253:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116472448 00000100:00100000:1.0:1788838299.420315:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1788838299.420326:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116472448:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838299.420514:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116472448:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 189us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838299.420533:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1788838299.425901:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838299.426194:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116472576 00000100:00100000:0.0:1788838299.426207:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116472576 00000100:00100000:0.0:1788838299.426279:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1788838299.426291:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116472576:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838299.426326:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838299.426350:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504627200/0x88da08396ccc9dbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cf9a expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838299.426386:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504627200/0x88da08396ccc9dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf9a expref: 10 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838299.426398:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504627200/0x88da08396ccc9dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf9a expref: 10 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838299.426409:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627200, rc 0) 00000100:00100000:0.0:1788838299.426475:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116472576:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 187us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838299.426490:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1788838299.428928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838299.429045:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116472704 00000100:00100000:2.0:1788838299.429055:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116472704 00000100:00100000:2.0:1788838299.429133:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:2.0:1788838299.429145:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116472704:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838299.429294:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116472704:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 152us (379us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788838299.429303:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00010000:00010000:0.0:1788838299.709714:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838300.734742:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838301.053124:0:3642:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788838291/real 1788838291] req@ffff8ff50475c000 x1875729135160960/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838301 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838301.053158:0:3642:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ff50475c000 x1875729135160960/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788838301 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838301.053171:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838301.053199:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788838301.053212:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135160960:0@lo:250:kworker.0 10000000:01000000:3.0:1788838301.053268:0:94386:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788838301.053287:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5400/0x88da08396ccc96be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc96c5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.053499:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5400/0x88da08396ccc96be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc96c5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.053505:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788838301.053610:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1788838301.053618:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:3.0:1788838301.053622:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5400/0x88da08396ccc96be lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc96c5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.053660:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9ab5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.053667:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9ab5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.053671:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:1.0:1788838301.053701:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788838301.053704:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838301.053709:0:63434:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3685 00000100:00080000:1.0:1788838301.053714:0:63434:0:(import.c:589:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788838301.053720:0:63434:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838301.053751:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071c8380 x1875729135162624/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838301.053782:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838301.053786:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838301.053787:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838301.053791:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3690 00000100:00080000:1.0:1788838301.053793:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838301.053823:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00020000:2.0:1788838301.053982:0:3642:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8ff5071c8380 x1875729135162624/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838301.054592:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071cb800 x1875729135162752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838301.054727:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838301.054732:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838301.054735:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838301.054739:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3690 00000100:00080000:1.0:1788838301.054742:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838301.054746:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838301.054763:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071c8700 x1875729135163008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838301.054791:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838301.054794:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838301.054821:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838301.054826:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3690 00000100:00080000:1.0:1788838301.054829:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838301.054907:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838301.054922:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071c9f80 x1875729135163264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838301.054953:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838301.054956:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788838301.054958:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838301.054960:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3690 00000100:00080000:1.0:1788838301.054962:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788838301.054966:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838301.054978:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071ca300 x1875729135163648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838301.055086:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135163520:0@lo:400:kworker.0 00000100:00100000:1.0:1788838301.055152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.055197:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788838301.055204:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135163392:0@lo:400:kworker.0 00000100:00100000:1.0:1788838301.055226:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.055266:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135163520 00000100:00100000:1.0:1788838301.055273:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135163520 00000100:00100000:1.0:1788838301.055323:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135163392 00000100:00100000:1.0:1788838301.055337:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135163392 00000100:00100000:1.0:1788838301.055365:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:1.0:1788838301.055374:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135163520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838301.055426:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135163520:12345-0@lo:400:kworker.0 Request processed in 54us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.055434:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:0.0:1788838301.055897:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:0.0:1788838301.055909:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135163392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838301.055950:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135163392:12345-0@lo:400:kworker.0 Request processed in 45us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.055966:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000100:00080000:0.0:1788838301.056001:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838301.056006:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838301.056062:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135163392:0@lo:400:kworker.0 00000100:00100000:0.0:1788838301.056073:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135163520:0@lo:400:kworker.0 00000100:00100000:0.0:1788838301.056292:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135163136:0@lo:400:kworker.0 00000100:00100000:0.0:1788838301.056327:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838301.056352:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838301.056359:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135162880:0@lo:400:kworker.0 00000100:00100000:0.0:1788838301.056381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838301.056408:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135163136 00000100:00100000:0.0:1788838301.056413:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135163136 00000100:00100000:0.0:1788838301.056448:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135162880 00000100:00100000:0.0:1788838301.056464:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135162880 00000100:00100000:0.0:1788838301.056495:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1788838301.056503:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135163136:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1788838301.056504:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056520:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9ab5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.056538:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148fe00/0x88da08396ccc9abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9ac3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.056546:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148fe00/0x88da08396ccc9abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9ac3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838301.056546:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135163136:12345-0@lo:400:kworker.0 Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.056559:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1788838301.056573:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1788838301.056579:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135162880:12345-0@lo:400:kworker.0 10000000:01000000:3.0:1788838301.056598:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838301.056606:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056613:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148fe00/0x88da08396ccc9abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9ac3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838301.056613:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135162880:12345-0@lo:400:kworker.0 Request processed in 32us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.056628:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00010000:00010000:3.0:1788838301.056632:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9ad1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.056641:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9ad1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.056647:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838301.056660:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056666:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148e000/0x88da08396ccc9aca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9ad1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.056675:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff601528a00/0x88da08396ccc9ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9adf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.056682:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff601528a00/0x88da08396ccc9ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9adf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.056688:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838301.056691:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056694:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff601528a00/0x88da08396ccc9ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9adf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.056703:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff504626a00/0x88da08396ccc9ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9aed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.056709:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff504626a00/0x88da08396ccc9ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9aed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.056713:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838301.056716:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056719:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff504626a00/0x88da08396ccc9ae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9aed expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.056727:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff504627400/0x88da08396ccc9af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9afb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.056734:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff504627400/0x88da08396ccc9af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9afb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.056747:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838301.056750:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056754:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff504627400/0x88da08396ccc9af4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9afb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.056761:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9b09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.056767:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9b09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.056771:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838301.056774:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056779:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccc9b02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9b09 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788838301.056779:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788838301.056814:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4400/0x88da08396ccc9632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9639 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.056822:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4400/0x88da08396ccc9632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9639 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.056828:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838301.056831:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056837:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e4400/0x88da08396ccc9632 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9639 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838301.056837:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135162880:0@lo:400:kworker.0 00000100:00100000:0.0:1788838301.056857:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135163136:0@lo:400:kworker.0 00010000:00010000:3.0:1788838301.056858:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50712d000/0x88da08396ccc964e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9655 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.056879:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50712d000/0x88da08396ccc964e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9655 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.056884:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788838301.056888:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056892:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50712d000/0x88da08396ccc964e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9655 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.056905:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc965c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc9663 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.056911:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc965c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc9663 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.056917:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788838301.056928:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056932:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc965c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc9663 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.056942:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5a00/0x88da08396ccc9686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc968d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.056949:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5a00/0x88da08396ccc9686 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc968d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.056955:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788838301.056961:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.056964:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5a00/0x88da08396ccc9686 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc968d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.056982:0:94386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5c00/0x88da08396ccc96b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x88da08396ccc96b7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788838301.057210:0:94386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5c00/0x88da08396ccc96b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x88da08396ccc96b7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.057215:0:94386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788838301.057228:0:94386:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788838301.057232:0:94386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50b8e5c00/0x88da08396ccc96b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x88da08396ccc96b7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788838301.101902:0:94386:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ff605445000 already not connected (conn 67, was 0): CONNECTING 00000100:00080000:3.0:1788838301.101913:0:94386:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1788838301.103921:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838301.103958:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1788838301.103972:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:0:1875729135162624:0@lo:250:kworker.0 00000100:00100000:2.0:1788838301.104023:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135162752:0@lo:38:kworker.0 00000100:00100000:2.0:1788838301.104099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838301.104206:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135163008:0@lo:38:kworker.0 00000100:00100000:2.0:1788838301.104233:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788838301.104283:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838301.104288:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788838301.104291:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838301.104296:0:63434:0:(import.c:510:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 3695 00000100:00080000:1.0:1788838301.104301:0:63434:0:(import.c:589:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788838301.104308:0:63434:0:(import.c:624:import_select_connection()) MGC192.168.203.130@tcp: import ffff8ff605445000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838301.104336:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071c9500 x1875729135163776/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838301.106515:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135163264:0@lo:38:kworker.0 00000100:00100000:2.0:1788838301.106593:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838301.106904:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135163264 00000100:00100000:3.0:1788838301.106913:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135163264 00000100:00100000:3.0:1788838301.106952:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4241 00000100:00100000:3.0:1788838301.106961:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135163264:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788838301.106993:0:23765:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838301.107036:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135163264:12345-0@lo:38:kworker.0 Request processed in 75us (443us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838301.107044:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4241 00000100:00080000:2.0:1788838301.107111:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838301.107117:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788838301.107122:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135163264:0@lo:38:kworker.0 00000100:00100000:2.0:1788838301.107128:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135163648:0@lo:38:kworker.0 00000100:00100000:2.0:1788838301.107155:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838301.108950:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135162752 00000100:00100000:0.0:1788838301.108965:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135162752 00000100:00100000:0.0:1788838301.109032:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135163008 00000100:00100000:0.0:1788838301.109036:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135163008 00000100:00100000:0.0:1788838301.109058:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1788838301.109065:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135162752:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838301.109088:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838301.109158:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135162752:12345-0@lo:38:kworker.0 Request processed in 92us (5058us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838301.109165:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1788838301.109182:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:0.0:1788838301.109186:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135163008:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838301.109195:0:66254:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838301.109223:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135163008:12345-0@lo:38:kworker.0 Request processed in 35us (4990us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838301.109230:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:0.0:1788838301.111898:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135163648 00000100:00100000:3.0:1788838301.111899:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135163776:0@lo:250:kworker.0 00000100:00100000:0.0:1788838301.111910:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135163648 00000100:00100000:0.0:1788838301.111961:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:3.0:1788838301.111966:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838301.111972:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135163648:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788838301.112005:0:66255:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788838301.112030:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838301.112037:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838301.112042:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135162752:0@lo:38:kworker.0 00000100:00100000:0.0:1788838301.112054:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875729135163648:12345-0@lo:38:kworker.0 Request processed in 81us (4896us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838301.112066:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00080000:3.0:1788838301.112080:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838301.112086:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838301.112090:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135163008:0@lo:38:kworker.0 00000100:00080000:3.0:1788838301.112100:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838301.112105:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838301.112108:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135163648:0@lo:38:kworker.0 00000100:00100000:1.0:1788838301.112220:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135163776 00000100:00100000:1.0:1788838301.112225:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135163776 00000100:00100000:1.0:1788838301.112254:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788838301.112261:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3642:x1875729135163776:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1788838301.112279:0:94393:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo t0 exp 0000000000000000 cur 3695 last 0 00000020:00000080:1.0:1788838301.112307:0:94393:0:(genops.c:1385:class_connect()) connect: client 57943c9a-ca27-46d8-8845-5d2bce640e45, cookie 0x88da08396ccc9dc5 00000100:00080000:1.0:1788838301.112441:0:94393:0:(import.c:65:import_set_state_nolock()) ffff8ff632fea800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838301.112505:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+5:3642:x1875729135163776:12345-0@lo:250:kworker.0 Request processed in 244us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.112513:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788838301.114245:0:3642:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 29 00000100:00080000:3.0:1788838301.114259:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:3.0:1788838301.114269:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788838301.114275:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788838301.114280:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff605445000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788838301.114284:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788838301.114620:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788838301.114635:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57943c9a-ca27-46d8-8845-5d2bce640e45:3642:1875729135163776:0@lo:250:kworker.0 00000100:00080000:3.0:1788838301.114671:0:94386:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1788838301.114683:0:94386:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788838301.114726:0:94386:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788838301.114732:0:94386:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000000:1.0:1788838301.114740:0:63434:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.130@tcp 10000000:01000000:1.0:1788838301.114759:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788838301.114763:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788838301.114770:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788838301.114772:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838301.114773:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838301.114775:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838301.114776:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838301.114778:0:63434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838301.114780:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838301.114782:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000040:01000000:3.0:1788838301.114858:0:94386:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788838301.114884:0:94386:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788838301.114888:0:94386:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788838301.114889:0:94386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838301.114891:0:94386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838301.114892:0:94386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838301.114893:0:94386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838301.114895:0:94386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838301.114896:0:94386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838301.114897:0:94386:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838301.114899:0:94386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838301.114904:0:94386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788838301.114907:0:94386:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788838301.114911:0:94386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788838301.114912:0:94386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838301.114914:0:94386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838301.114915:0:94386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838301.114916:0:94386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000000:1.0:1788838301.114917:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000020:01000004:3.0:1788838301.114918:0:94386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838301.114920:0:94386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838301.114922:0:94386:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838301.114924:0:94386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838301.114925:0:94386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788838301.114928:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788838301.114931:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788838301.114932:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788838301.114934:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838301.114935:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838301.114937:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 10000000:01000000:3.0:1788838301.114938:0:94386:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000020:01000004:1.0:1788838301.114939:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838301.114942:0:63434:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788838301.114944:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838301.114945:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788838301.114955:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135164032:0@lo:253:mount.lustre.0 00000020:01000000:1.0:1788838301.114963:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788838301.114967:0:63434:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1788838301.114969:0:63434:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788838301.114970:0:63434:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788838301.114971:0:63434:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788838301.114973:0:63434:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788838301.114974:0:63434:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788838301.114975:0:63434:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788838301.114977:0:63434:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788838301.114978:0:63434:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788838301.114980:0:63434:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788838301.115012:0:63434:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788838301.115033:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.115038:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135163904:0@lo:253:kworker.0 00000100:00100000:3.0:1788838301.115071:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff601375a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838301.115080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.115105:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838301.115111:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135164160:0@lo:253:kworker.0 00000100:00100000:1.0:1788838301.115135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.115171:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135164032 00000100:00100000:1.0:1788838301.115182:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135164032 00000100:00100000:1.0:1788838301.115216:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135163904 00000100:00100000:1.0:1788838301.115219:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135163904 00000100:00100000:1.0:1788838301.115229:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135164160 00000100:00100000:1.0:1788838301.115231:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135164160 00000100:00100000:1.0:1788838301.115244:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788838301.115251:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:94386:x1875729135164032:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788838301.115287:0:94392:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788838301.115290:0:94392:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788838301.115293:0:94392:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1788838301.115299:0:94392:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788838301.115583:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838301.115595:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135164288:0@lo:253:kworker.0 00000100:00100000:0.0:1788838301.115643:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838301.115667:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135164288 00000100:00100000:0.0:1788838301.115671:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135164288 00000100:00100000:0.0:1788838301.115692:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788838301.115698:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3645:x1875729135163904:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788838301.115716:0:94395:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788838301.115727:0:94395:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788838301.125924:0:94395:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788838301.125938:0:94395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788838301.126091:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94386:x1875729135164032:12345-0@lo:253:mount.lustre.0 Request processed in 10568us (10787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.126107:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788838301.126159:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788838301.126169:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:3645:x1875729135164160:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788838301.126196:0:94392:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788838301.126209:0:94392:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788838301.126268:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135164032:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788838301.126284:0:94386:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788838301.126300:0:94386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788838301.126302:0:94386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788838301.126303:0:94386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838301.126305:0:94386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838301.126306:0:94386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838301.126308:0:94386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838301.126310:0:94386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788838301.126311:0:94386:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788838301.126313:0:94386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838301.126314:0:94386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788838301.126334:0:94386:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff50a9bc000 from lustre-MDT0000 10000000:01000000:3.0:1788838301.126362:0:94386:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788838301.126365:0:94386:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788838301.126375:0:94386:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ff50a9bc000 10000000:01000000:3.0:1788838301.126380:0:94386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788838301.126385:0:94386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ff50a9bc000 10000000:01000000:3.0:1788838301.126387:0:94386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788838301.126391:0:94386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff50a9bc000 from 1 10000000:01000000:3.0:1788838301.126408:0:94386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788838301.126441:0:94386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4600/0x88da08396ccc9dcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.126453:0:94386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4600/0x88da08396ccc9dcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.126463:0:94386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4600/0x88da08396ccc9dcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838301.126482:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135164416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838301.126522:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838301.126573:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff601375f00 going to sleep for 11 seconds 20000000:01000000:1.0:1788838301.126911:0:94396:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788838301.126915:0:94396:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788838301.126931:0:94396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.126947:0:94396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9da9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf85 expref: 9 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.126955:0:94396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.126981:0:94396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9da9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf85 expref: 9 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.127005:0:94396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9da9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf85 expref: 9 pid: 94395 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838301.127015:0:94396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94396:1875729135164544:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788838301.127065:0:94396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504937000 going to sleep for 11 seconds 00000100:00100000:0.0:1788838301.127864:0:94393:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788838301.127875:0:94393:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1788838301.128582:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135164416 00000100:00100000:1.0:1788838301.128604:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135164416 00000100:00100000:0.0:1788838301.128858:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788838301.128868:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3644:x1875729135164288:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788838301.128897:0:94398:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788838301.134365:0:94392:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788838301.134375:0:94392:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788838301.134573:0:94398:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788838301.135033:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:3645:x1875729135164160:12345-0@lo:253:kworker.0 Request processed in 8862us (19892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.135044:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788838301.135088:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788838301.135100:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:94386:x1875729135164416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838301.135116:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838301.135137:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50a2e9400/0x88da08396ccc9dda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9dcc expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.135167:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50a2e9400/0x88da08396ccc9dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9dcc expref: 8 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.135179:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50a2e9400/0x88da08396ccc9dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9dcc expref: 8 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.135187:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e9400, rc 0) 00000100:00100000:1.0:1788838301.135220:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94386:x1875729135164416:12345-0@lo:101:mount.lustre.0 Request processed in 124us (8697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.135226:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000004:0.0:1788838301.135314:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788838301.135317:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788838301.135318:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838301.135319:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838301.135321:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838301.135322:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838301.135324:0:3645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788838301.135326:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838301.135342:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788838301.135346:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135164160:0@lo:253:kworker.0 00000100:00100000:1.0:1788838301.136612:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+7:3645:x1875729135163904:12345-0@lo:253:kworker.0 Request processed in 20908us (21529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.136635:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788838301.137104:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135164416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838301.137125:0:94386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4600/0x88da08396ccc9dcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9dda expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.137138:0:94386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4600/0x88da08396ccc9dcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9dda expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838301.137159:0:94386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788838301.137178:0:94386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4600/0x88da08396ccc9dcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9dda expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.137186:0:94386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4600/0x88da08396ccc9dcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9dda expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838301.137195:0:94386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788838301.137201:0:94386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788838301.137207:0:94386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ff50a9bc000 10000000:01000000:2.0:1788838301.137209:0:94386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788838301.137213:0:94386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788838301.137216:0:94386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788838301.137247:0:94386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.137268:0:94386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.137277:0:94386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838301.137298:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135164672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788838301.137340:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838301.137372:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7ec00 going to sleep for 11 seconds 00000020:01000004:3.0:1788838301.139707:0:3645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788838301.139713:0:3645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788838301.139715:0:3645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838301.139716:0:3645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838301.139717:0:3645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838301.139719:0:3645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838301.139721:0:3645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788838301.139722:0:3645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838301.139723:0:3645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788838301.139728:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135163904:0@lo:253:kworker.0 20000000:01000000:3.0:1788838301.141093:0:94398:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788838301.141100:0:94398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788838301.141764:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135164672 00000100:00100000:1.0:1788838301.141773:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135164672 00000100:00100000:1.0:1788838301.141853:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788838301.141864:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+7:94386:x1875729135164672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838301.141895:0:94393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838301.141913:0:94393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50a2e8a00/0x88da08396ccc9de8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9de1 expref: -99 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.141943:0:94393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50a2e8a00/0x88da08396ccc9de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9de1 expref: 8 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.141953:0:94393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50a2e8a00/0x88da08396ccc9de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9de1 expref: 8 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.141963:0:94393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e8a00, rc 0) 00000100:00100000:1.0:1788838301.142015:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94386:x1875729135164672:12345-0@lo:101:mount.lustre.0 Request processed in 153us (4674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.142022:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788838301.142130:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838301.142153:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116472832 00000100:00100000:1.0:1788838301.142156:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116472832 00010000:00010000:1.0:1788838301.142174:0:6533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9da9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf85 expref: 10 pid: 94395 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838301.142194:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2579 00000100:00100000:1.0:1788838301.142201:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116472832:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838301.142211:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838301.142216:0:6533:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9da9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf85 expref: 10 pid: 94395 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142226:0:6533:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9da9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf85 expref: 10 pid: 94395 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142251:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142259:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788838301.142271:0:6533:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015355409s 00010000:00010000:1.0:1788838301.142276:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142283:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142289:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142296:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142302:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838301.142306:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142314:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142323:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142333:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838301.142379:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116472832:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 177us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.142386:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2579 00010000:00010000:1.0:1788838301.142510:0:94396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9da9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf85 expref: 9 pid: 94395 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838301.142523:0:94396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94396:1875729135164544:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788838301.142542:0:94396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142549:0:94396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142555:0:94396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.142561:0:94396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9dd3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838301.142788:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+7:3644:x1875729135164288:12345-0@lo:253:kworker.0 Request processed in 13919us (27142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838301.142816:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788838301.144526:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135164672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838301.144551:0:94386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.144581:0:94386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838301.144683:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135164800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838301.144737:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838301.144784:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838301.145491:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135164800 00000100:00100000:1.0:1788838301.145499:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135164800 00000100:00100000:1.0:1788838301.145551:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788838301.145573:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+7:94386:x1875729135164800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838301.145756:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94386:x1875729135164800:12345-0@lo:501:mount.lustre.0 Request processed in 196us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.145763:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:01000004:0.0:1788838301.145940:0:3644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788838301.145944:0:3644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788838301.145945:0:3644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838301.145947:0:3644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838301.145948:0:3644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838301.145950:0:3644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838301.145951:0:3644:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838301.145953:0:3644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838301.145954:0:3644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788838301.145957:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135164288:0@lo:253:kworker.0 00000100:00100000:1.0:1788838301.146148:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135164800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838301.146191:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135164928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838301.146246:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.146278:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff639731a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838301.146296:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135164928 00000100:00100000:0.0:1788838301.146525:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135164928 00000100:00100000:1.0:1788838301.148997:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788838301.149011:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94386:x1875729135164928:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838301.149200:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94386:x1875729135164928:12345-0@lo:503:mount.lustre.0 Request processed in 191us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.149207:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788838301.149322:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135164928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838301.149909:0:94399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94399:1875729135165056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838301.149957:0:94399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838301.150006:0:94399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788838301.150021:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135165056 00000100:00100000:0.0:1788838301.150029:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135165056 00000100:00100000:0.0:1788838301.150068:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788838301.150076:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94399:x1875729135165056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838301.150948:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94399:x1875729135165056:12345-0@lo:502:llog_process_th.0 Request processed in 869us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.150957:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788838301.157895:0:94399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94399:1875729135165056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788838301.158242:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838301.158259:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838301.158261:0:94399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788838301.158266:0:94399:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788838301.158270:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838301.158291:0:94399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ff639560000) 00000020:00000080:1.0:1788838301.158329:0:94399:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1788838301.158337:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788838301.158441:0:94399:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788838301.158450:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc9df6 00000020:00000080:1.0:1788838301.158701:0:94399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788838301.158706:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838301.158710:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838301.158711:0:94399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788838301.158714:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838301.158718:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838301.158719:0:94399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788838301.158722:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788838301.158730:0:94399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ff608223370) 00000020:00000080:1.0:1788838301.158742:0:94399:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1788838301.158745:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788838301.158747:0:94399:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788838301.158750:0:94399:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788838301.158766:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788838301.158845:0:94399:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff50a9bc000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788838301.158859:0:94399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ff608220000) 00000020:00000080:1.0:1788838301.158871:0:94399:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1788838301.158922:0:94399:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788838301.158927:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc9e0b 00000020:00000080:1.0:1788838301.159026:0:94399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788838301.159033:0:94399:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788838301.159037:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x88da08396ccc9e12 00080000:01000000:1.0:1788838301.159042:0:94399:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788838301.159046:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc9e19 00010000:00010000:2.0:1788838301.224733:0:94399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788838301.225214:0:94399:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 115964116995 srv lr: 120259084288 lx: 0 gen 22 00000001:00080000:2.0:1788838301.225258:0:94399:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: efc561ba-875e-4857-b79b-9bd7023bd57c idx: 2 lr: 0 srv lr: 120259084288 lx: 0 gen 24 00000001:00000004:2.0:1788838301.225282:0:94399:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 120259084288 00000001:00080000:2.0:1788838301.225382:0:94399:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788838301.225439:0:94399:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff639731a80: xid 1875729135146240, transno 120259084296, client gen 22, slot idx 0 00000001:00080000:2.0:1788838301.225448:0:94399:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff639731300: xid 1875729135144320, transno 120259084295, client gen 22, slot idx 1 00000001:00080000:2.0:1788838301.225453:0:94399:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff5034efd80: xid 1875729116459136, transno 120259084294, client gen 24, slot idx 2 00000001:00080000:2.0:1788838301.225457:0:94399:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8ff5034ef840: xid 1875729116458752, transno 120259084293, client gen 24, slot idx 3 00000020:00000080:2.0:1788838301.226267:0:94399:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ff61d0e0000) 00000020:00000080:2.0:1788838301.226296:0:94399:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788838301.226375:0:94399:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788838301.226383:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc9e35 00000020:00000080:3.0:1788838301.231934:0:94399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788838301.235231:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x88da08396ccc9e3c 00000020:00000080:2.0:1788838301.235556:0:94399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788838301.235580:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838301.235587:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.235590:0:94399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788838301.235594:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788838301.235597:0:94399:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788838301.235599:0:94399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788838301.235601:0:94399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788838301.235602:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788838301.235605:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.235606:0:94399:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788838301.235609:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838301.235614:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.235615:0:94399:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788838301.235620:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788838301.235673:0:94399:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788838301.235692:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838301.235703:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.235704:0:94399:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788838301.235708:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838301.235712:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.235713:0:94399:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788838301.235716:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788838301.235721:0:94399:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:2.0:1788838301.235750:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788838301.235765:0:94399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ff61d0e4d28) 00000020:00000080:2.0:1788838301.235783:0:94399:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788838301.235789:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788838301.236243:0:94399:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788838301.236251:0:94399:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788838301.236258:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc9e4a 00010000:00080000:2.0:1788838301.236291:0:94399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff6271d7800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1788838301.238789:0:94399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788838301.240515:0:94399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788838301.240531:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788838301.240574:0:94399:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788838301.240602:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc9e51 00000100:00080000:3.0:1788838301.240613:0:94399:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838301.240619:0:94399:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ff6271d7800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838301.240657:0:94399:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff504d7b800 x1875729135165184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838301.240720:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135165184:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838301.240792:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838301.242841:0:94399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788838301.242947:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838301.242954:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838301.242956:0:94399:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788838301.242959:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788838301.242962:0:94399:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788838301.242964:0:94399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788838301.242965:0:94399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788838301.242967:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788838301.242969:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838301.242970:0:94399:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788838301.242973:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788838301.242979:0:94399:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788838301.242994:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838301.242995:0:94399:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788838301.242999:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788838301.243003:0:94399:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1788838301.243029:0:94399:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788838301.243031:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788838301.243047:0:94399:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ff6271ccd28) 00000020:00000080:3.0:1788838301.243073:0:94399:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788838301.243078:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788838301.243163:0:94399:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788838301.243168:0:94399:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788838301.243175:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc9e5f 00010000:00080000:3.0:1788838301.243207:0:94399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff62c81b000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788838301.243435:0:94399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:3.0:1788838301.244443:0:94399:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788838301.244534:0:94399:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788838301.244932:0:94399:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000100:00100000:2.0:1788838301.245233:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135165184 00000100:00100000:2.0:1788838301.245244:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135165184 00000100:00100000:2.0:1788838301.245283:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4242 00000100:00100000:2.0:1788838301.245292:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135165184:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788838301.245321:0:8472:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3695 last 0 00000020:00000080:2.0:1788838301.245355:0:8472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc9e66 00000004:00100000:2.0:1788838301.245372:0:8472:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788838301.245443:0:8472:0:(import.c:65:import_set_state_nolock()) ffff8ff624a95800 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788838301.245978:0:94399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838301.246020:0:94399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].29, 64 off10048 00000040:00080000:3.0:1788838301.246167:0:94399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].1, 64 off8256 00000040:00080000:1.0:1788838301.246698:0:94405:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:1.0:1788838301.246703:0:94405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788838301.247129:0:94405:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:1.0:1788838301.247150:0:94405:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788838301.247276:0:94405:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:1.0:1788838301.247280:0:94405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788838301.247893:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135165184:12345-0@lo:38:llog_process_th.0 Request processed in 2595us (7094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838301.247906:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4242 00000020:00000080:3.0:1788838301.248390:0:94399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788838301.248401:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788838301.248442:0:94399:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788838301.248479:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc9e6d 00000100:00080000:3.0:1788838301.248490:0:94399:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788838301.248496:0:94399:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff62c81b000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838301.248532:0:94399:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff61d27ea00 x1875729135165312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788838301.248547:0:94399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788838301.248747:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788838301.248751:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838301.248753:0:94399:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788838301.248756:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788838301.248758:0:94399:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788838301.248760:0:94399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788838301.248761:0:94399:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788838301.248763:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788838301.248765:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838301.248766:0:94399:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788838301.248769:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788838301.248773:0:94399:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788838301.248776:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788838301.248777:0:94399:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788838301.248780:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788838301.248790:0:94399:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1788838301.248851:0:94399:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788838301.248855:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788838301.248865:0:94399:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ff6271cb370) 00000020:00000080:3.0:1788838301.248882:0:94399:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788838301.248887:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788838301.248956:0:94399:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788838301.248962:0:94399:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788838301.248970:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x88da08396ccc9e7b 00010000:00080000:3.0:1788838301.249010:0:94399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff619428000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1788838301.249205:0:94399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1788838301.249274:0:94399:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788838301.249289:0:94399:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788838301.249891:0:94399:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:3.0:1788838301.250631:0:94399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838301.250664:0:94399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].29, 64 off10048 00000040:00080000:3.0:1788838301.250777:0:94399:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x76:0x0].1, 64 off8256 00000100:00100000:1.0:1788838301.251170:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788838301.251182:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1788838301.251191:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788838301.251198:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788838301.251202:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6271d7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788838301.251220:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135165184:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788838301.251257:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135165312:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788838301.251334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.251375:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135165312 00000100:00100000:1.0:1788838301.251381:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135165312 00000100:00100000:1.0:1788838301.251415:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5984 00000100:00100000:1.0:1788838301.251422:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3642:x1875729135165312:12345-0@lo:8:llog_process_th.0 00000040:00080000:3.0:1788838301.251791:0:94407:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:3.0:1788838301.251824:0:94407:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788838301.252227:0:94407:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000040:00080000:3.0:1788838301.252247:0:94407:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788838301.252379:0:94407:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:3.0:1788838301.252383:0:94407:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00010000:00080000:1.0:1788838301.252458:0:20253:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3695 last 0 00000020:00000080:1.0:1788838301.252565:0:20253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc9e82 00002000:00100000:1.0:1788838301.252580:0:20253:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ff632f53000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788838301.252584:0:20253:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788838301.252587:0:20253:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788838301.252644:0:20253:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788838301.252672:0:20253:0:(import.c:65:import_set_state_nolock()) ffff8ff632f51000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838301.252748:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135165312:12345-0@lo:8:llog_process_th.0 Request processed in 1324us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.252758:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5984 00000100:00100000:1.0:1788838301.253047:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788838301.253057:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788838301.253064:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788838301.253068:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788838301.253071:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788838301.253218:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135165440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838301.253262:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838301.253301:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135165440 00000100:00100000:0.0:1788838301.253307:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135165440 00000100:00100000:0.0:1788838301.253349:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:0.0:1788838301.253357:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135165440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838301.253377:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838301.253428:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135165440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.253435:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00080000:0.0:1788838301.253456:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838301.253494:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135165440:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788838301.253686:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788838301.253693:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135165312:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788838301.253748:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135165568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838301.253778:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788838301.253951:0:94405:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788838301.254023:0:94405:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3695273224326ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788838301.254030:0:94405:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788838301.254086:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135165568 00000100:00100000:1.0:1788838301.254091:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135165568 00000100:00100000:1.0:1788838301.254130:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4243 00000100:00100000:1.0:1788838301.254139:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135165568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838301.254165:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:1.0:1788838301.254202:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135165568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.254216:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4243 00000100:00100000:1.0:1788838301.254249:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135165568:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1788838301.254708:0:94399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788838301.254720:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788838301.254773:0:94399:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788838301.254826:0:94399:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc9e89 00000100:00080000:2.0:1788838301.254945:0:94399:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788838301.254950:0:94399:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ff619428000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1788838301.254979:0:94399:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff637f8ed80 x1875729135165696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788838301.255009:0:94399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788838301.255100:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838301.255104:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.255106:0:94399:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788838301.255109:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838301.255114:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.255115:0:94399:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788838301.255118:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788838301.255121:0:94399:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788838301.255123:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838301.255126:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.255127:0:94399:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788838301.255129:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838301.255132:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.255133:0:94399:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788838301.255136:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788838301.255142:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838301.255144:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.255146:0:94399:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1788838301.255148:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838301.255152:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.255153:0:94399:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1788838301.255156:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1788838301.255198:0:94399:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:2.0:1788838301.255604:0:94399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94399:1875729135165824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838301.255678:0:94399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838301.255732:0:94399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b501780 going to sleep for 11 seconds 00000100:00100000:1.0:1788838301.256565:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135165696:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788838301.256617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.256664:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135165696 00000100:00100000:1.0:1788838301.256671:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135165696 00000100:00100000:1.0:1788838301.256703:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5985 00000100:00100000:1.0:1788838301.256710:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3642:x1875729135165696:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788838301.256741:0:8462:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3695 last 0 00000020:00000080:1.0:1788838301.256768:0:8462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x88da08396ccc9e90 00002000:00100000:1.0:1788838301.256780:0:8462:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ff632f51800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788838301.256784:0:8462:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788838301.256787:0:8462:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788838301.256888:0:8462:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788838301.256913:0:8462:0:(import.c:65:import_set_state_nolock()) ffff8ff603c56800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788838301.256960:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875729135165696:12345-0@lo:8:llog_process_th.0 Request processed in 249us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.256968:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5985 00000100:00100000:1.0:1788838301.257019:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788838301.257027:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788838301.257035:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788838301.257040:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788838301.257042:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff619428000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788838301.257055:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788838301.257060:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135165696:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788838301.257096:0:94407:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788838301.257175:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135165952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838301.257205:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.257240:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135165952 00000100:00100000:1.0:1788838301.257244:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135165952 00000100:00100000:1.0:1788838301.257278:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:1.0:1788838301.257285:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135165952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838301.257305:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838301.257339:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135165952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.257345:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:1.0:1788838301.257375:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135165952:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788838301.258282:0:94407:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3695277482679ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788838301.258290:0:94407:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788838301.258617:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135165824 00000100:00100000:0.0:1788838301.258627:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135165824 00000100:00100000:0.0:1788838301.258667:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788838301.258675:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94399:x1875729135165824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838301.258841:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94399:x1875729135165824:12345-0@lo:502:llog_process_th.0 Request processed in 155us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.258848:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788838301.258891:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838301.259065:0:94399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94399:1875729135165824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838301.259097:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838301.259104:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.259107:0:94399:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:2.0:1788838301.259111:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838301.259118:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.259119:0:94399:0:(obd_config.c:1563:class_process_config()) marker 43 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1788838301.259123:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1788838301.259141:0:94399:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000004:00080000:0.0:1788838301.259523:0:94387:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788838301.260051:0:94399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94399:1875729135166080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838301.260116:0:94399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838301.260157:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135166080 00000100:00100000:2.0:1788838301.260163:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135166080 00000100:00100000:2.0:1788838301.260196:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838301.260204:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94399:x1875729135166080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838301.260292:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94399:x1875729135166080:12345-0@lo:502:llog_process_th.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838301.260299:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788838301.260344:0:94399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ce34000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838301.260362:0:94399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94399:1875729135166080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838301.260383:0:94399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838301.260389:0:94399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838301.260391:0:94399:0:(obd_config.c:1563:class_process_config()) marker 43 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1788838301.260395:0:94399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:3.0:1788838301.260723:0:94386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:3.0:1788838301.260753:0:94386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788838301.260769:0:94386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.260793:0:94386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.260836:0:94386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff50a9bc000 from 1 10000000:01000000:3.0:1788838301.260839:0:94386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788838301.260868:0:94386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.260876:0:94386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.260886:0:94386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838301.260899:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135166208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838301.260934:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838301.260948:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611a2d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788838301.261089:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135166208 00000100:00100000:0.0:1788838301.261094:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135166208 00000100:00100000:0.0:1788838301.261128:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788838301.261136:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+8:94386:x1875729135166208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788838301.261146:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838301.261162:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504626600/0x88da08396ccc9e9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9e97 expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.261184:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504626600/0x88da08396ccc9e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9e97 expref: 9 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.261195:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504626600/0x88da08396ccc9e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9e97 expref: 9 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.261217:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626600, rc 0) 00000100:00100000:0.0:1788838301.261261:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+9:94386:x1875729135166208:12345-0@lo:101:mount.lustre.0 Request processed in 127us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.261268:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:01000004:0.0:1788838301.261330:0:94409:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff50a9bc000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788838301.261335:0:94409:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff50a9bc000 4 00000100:00100000:3.0:1788838301.261392:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135166208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838301.261406:0:94386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.261415:0:94386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838301.262145:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135166336:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788838301.262188:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838301.262219:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611a2d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788838301.262243:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135166336 00000100:00100000:3.0:1788838301.262249:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135166336 00000100:00100000:3.0:1788838301.262278:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788838301.262286:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:94386:x1875729135166336:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788838301.262301:0:94392:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788838301.262318:0:94392:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788838301.262322:0:94392:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788838301.262325:0:94392:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788838301.262327:0:94392:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 128 00000100:00100000:3.0:1788838301.262406:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+9:94386:x1875729135166336:12345-0@lo:256:mount.lustre.0 Request processed in 120us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838301.262414:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788838301.262452:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135166336:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788838301.263396:0:94386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788838301.263515:0:94386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.263526:0:94386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838301.263535:0:94386:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff50a9bc000 from 1 10000000:01000000:3.0:1788838301.263537:0:94386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788838301.263565:0:94386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc9ea5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.263573:0:94386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc9ea5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.263582:0:94386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc9ea5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838301.263607:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135166464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788838301.263648:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838301.263673:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611a2d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788838301.264992:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135166464 00000100:00100000:1.0:1788838301.265004:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135166464 00000100:00100000:1.0:1788838301.265058:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788838301.265068:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+9:94386:x1875729135166464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838301.265083:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838301.265101:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9eac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9ea5 expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.265128:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9ea5 expref: 10 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.265140:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9ea5 expref: 10 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.265166:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e9800, rc 0) 00000100:00100000:1.0:1788838301.265246:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:94386:x1875729135166464:12345-0@lo:101:mount.lustre.0 Request processed in 179us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.265253:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1788838301.265381:0:94387:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788838301.265450:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135166464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838301.265491:0:94386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc9ea5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9eac expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.265501:0:94386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc9ea5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9eac expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838301.265586:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135166592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838301.265626:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838301.265654:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ce34000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838301.265677:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135166592 00000100:00100000:2.0:1788838301.265682:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135166592 00000100:00100000:2.0:1788838301.265712:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788838301.265721:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:94386:x1875729135166592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838301.266061:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:94386:x1875729135166592:12345-0@lo:501:mount.lustre.0 Request processed in 341us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838301.266068:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788838301.266109:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135166592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788838301.266140:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135166720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838301.266182:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838301.266299:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ce34000 going to sleep for 11 seconds 00000100:00100000:1.0:1788838301.266444:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135166720 00000100:00100000:1.0:1788838301.266450:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135166720 00000100:00100000:1.0:1788838301.266580:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788838301.266588:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:94386:x1875729135166720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838301.266682:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:94386:x1875729135166720:12345-0@lo:503:mount.lustre.0 Request processed in 94us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.266689:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788838301.266775:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135166720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788838301.267379:0:94410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94410:1875729135166848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838301.267421:0:94410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.267487:0:94410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608ea6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788838301.267575:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135166848 00000100:00100000:2.0:1788838301.267581:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135166848 00000100:00100000:2.0:1788838301.267639:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788838301.267648:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:94410:x1875729135166848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838301.268162:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:94410:x1875729135166848:12345-0@lo:502:llog_process_th.0 Request processed in 515us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838301.268170:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788838301.268254:0:94410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94410:1875729135166848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788838301.268281:0:94410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838301.268291:0:94410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838301.268293:0:94410:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788838301.268300:0:94410:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff50a9bc000 00000020:00000080:0.0:1788838301.268303:0:94410:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788838301.268314:0:94410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838301.268316:0:94410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838301.268318:0:94410:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788838301.268320:0:94410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788838301.268322:0:94410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838301.268324:0:94410:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788838301.268327:0:94410:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff50a9bc000 00000020:00000080:0.0:1788838301.268330:0:94410:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788838301.268414:0:94410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94410:1875729135166976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838301.268454:0:94410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838301.272132:0:94410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788838301.272234:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135166976 00000100:00100000:1.0:1788838301.272243:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135166976 00000100:00100000:1.0:1788838301.272307:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788838301.272317:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:94410:x1875729135166976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838301.272474:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:94410:x1875729135166976:12345-0@lo:502:llog_process_th.0 Request processed in 146us (4008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.272482:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788838301.272592:0:94410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94410:1875729135166976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788838301.272626:0:94410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788838301.272635:0:94410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838301.272637:0:94410:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788838301.272647:0:94410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788838301.272968:0:94386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788838301.273005:0:94386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838301.273025:0:94386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc9ea5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9eac expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.273038:0:94386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc9ea5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9eac expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838301.273095:0:94386:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788838301.273098:0:94386:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ff50a9bc000 10000000:01000000:0.0:1788838301.273101:0:94386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ff50a9bc000 10000000:01000000:0.0:1788838301.273105:0:94386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788838301.273111:0:94386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff50a9bc000 from 1 10000000:01000000:0.0:1788838301.273113:0:94386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788838301.273144:0:94386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.273152:0:94386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.273161:0:94386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838301.273180:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135167104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788838301.273221:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838301.273238:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838301.273332:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135167104 00000100:00100000:1.0:1788838301.273338:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135167104 00000100:00100000:1.0:1788838301.273362:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788838301.273370:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+10:94386:x1875729135167104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838301.273389:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838301.273402:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50a2e9000/0x88da08396ccc9eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9eb3 expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.273425:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50a2e9000/0x88da08396ccc9eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9eb3 expref: 11 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.273435:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50a2e9000/0x88da08396ccc9eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9eb3 expref: 11 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.273445:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e9000, rc 0) 00000100:00100000:1.0:1788838301.273490:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94386:x1875729135167104:12345-0@lo:101:mount.lustre.0 Request processed in 120us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.273496:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788838301.273551:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135167104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788838301.273563:0:94386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.273573:0:94386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838301.273621:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135167232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838301.273645:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.273665:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608ea6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838301.273677:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135167232 00000100:00100000:1.0:1788838301.273681:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135167232 00000100:00100000:1.0:1788838301.273698:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788838301.273704:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94386:x1875729135167232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788838301.273977:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94386:x1875729135167232:12345-0@lo:501:mount.lustre.0 Request processed in 272us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.273995:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788838301.274064:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135167232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788838301.274093:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135167360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788838301.274138:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838301.274165:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788838301.274318:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135167360 00000100:00100000:2.0:1788838301.274323:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135167360 00000100:00100000:2.0:1788838301.274361:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788838301.274369:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94386:x1875729135167360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838301.274450:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94386:x1875729135167360:12345-0@lo:503:mount.lustre.0 Request processed in 82us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.274541:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135167360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788838301.274669:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788838301.275000:0:94412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94412:1875729135167488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838301.275040:0:94412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.275071:0:94412:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608ea6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788838301.276416:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135167488 00000100:00100000:0.0:1788838301.276427:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135167488 00000100:00100000:0.0:1788838301.276487:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788838301.276498:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94412:x1875729135167488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838301.277568:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94412:x1875729135167488:12345-0@lo:502:llog_process_th.0 Request processed in 1069us (2523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.277579:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788838301.277686:0:94412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94412:1875729135167488:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788838301.277751:0:94412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788838301.277765:0:94412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ff6082219b8) 00000020:00000080:1.0:1788838301.277790:0:94412:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788838301.278693:0:94412:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff50a9bc000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788838301.278700:0:94412:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff50a9bc000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788838301.278702:0:94412:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff50a9bc000 4 00010000:00080000:1.0:1788838301.278733:0:94412:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff6104d8000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788838301.281074:0:94412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788838301.281336:0:94412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788838301.281383:0:94412:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788838301.281396:0:94412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x88da08396ccc9ec8 00000100:00080000:1.0:1788838301.281405:0:94412:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788838301.281411:0:94412:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff6104d8000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838301.281447:0:94412:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071ca680 x1875729135167616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788838301.281487:0:94412:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788838301.281672:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135167616:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838301.281743:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.284163:0:94412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94412:1875729135167744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838301.284262:0:94412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.284309:0:94412:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff601377d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838301.284334:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135167744 00000100:00100000:1.0:1788838301.284340:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135167744 00000100:00100000:1.0:1788838301.284394:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788838301.284404:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94412:x1875729135167744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838301.284536:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94412:x1875729135167744:12345-0@lo:502:llog_process_th.0 Request processed in 133us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838301.284545:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788838301.284598:0:94412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94412:1875729135167744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838301.284643:0:94412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94412:1875729135167872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838301.284679:0:94412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.284695:0:94412:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff601377d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838301.285277:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135167872 00000100:00100000:2.0:1788838301.285284:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135167872 00000100:00100000:2.0:1788838301.285326:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788838301.285335:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94412:x1875729135167872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838301.285434:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94412:x1875729135167872:12345-0@lo:502:llog_process_th.0 Request processed in 99us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838301.285441:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788838301.285876:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135167616 00000100:00100000:0.0:1788838301.285882:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135167616 00000100:00100000:0.0:1788838301.285914:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1788838301.285920:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135167616:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788838301.285978:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3642:x1875729135167616:12345-0@lo:38:llog_process_th.0 Request processed in 56us (4234us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788838301.285997:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:0.0:1788838301.286049:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788838301.286056:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6104d8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838301.286061:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788838301.286064:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135167616:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788838301.286583:0:94412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:94412:1875729135167872:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788838301.286620:0:94412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1788838301.286773:0:94386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:0.0:1788838301.286794:0:94386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788838301.286902:0:94386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.286913:0:94386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788838301.286962:0:94386:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788838301.286964:0:94386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788838301.286965:0:94386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838301.286967:0:94386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838301.286968:0:94386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838301.286970:0:94386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838301.286971:0:94386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838301.286973:0:94386:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788838301.286974:0:94386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838301.286976:0:94386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788838301.286980:0:94386:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788838301.286993:0:94386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788838301.286994:0:94386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788838301.286995:0:94386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838301.286997:0:94386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838301.286998:0:94386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838301.286999:0:94386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838301.287000:0:94386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838301.287001:0:94386:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788838301.287002:0:94386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838301.287003:0:94386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788838301.287022:0:94386:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788838301.287038:0:94386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135168000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788838301.287085:0:94386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838301.287114:0:94386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788838301.287191:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135168000 00000100:00100000:1.0:1788838301.287197:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135168000 00000100:00100000:1.0:1788838301.287239:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788838301.287247:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94386:x1875729135168000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788838301.287270:0:94395:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788838301.287284:0:94395:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788838301.291393:0:94395:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788838301.294973:0:94395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788838301.296233:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:94386:x1875729135168000:12345-0@lo:253:mount.lustre.0 Request processed in 8979us (9140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838301.296258:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788838301.296337:0:94386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:94386:1875729135168000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788838301.296351:0:94386:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788838301.296354:0:94386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788838301.296356:0:94386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788838301.296358:0:94386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788838301.296359:0:94386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788838301.296361:0:94386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788838301.296362:0:94386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788838301.296363:0:94386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788838301.296365:0:94386:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788838301.296367:0:94386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788838301.296368:0:94386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788838301.296382:0:94386:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788838301.299783:0:94396:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788838301.299816:0:94396:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788838301.300383:0:94396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.300405:0:94396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff504626600/0x88da08396ccc9e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9e97 expref: 10 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.300428:0:94396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.300485:0:94396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff504626600/0x88da08396ccc9e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9e97 expref: 10 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838301.300501:0:94396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff504626600/0x88da08396ccc9e9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9e97 expref: 10 pid: 94398 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838301.300517:0:94396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94396:1875729135168128:0@lo:104: 00000100:00100000:1.0:1788838301.300596:0:94396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.300649:0:94396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608ea6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838301.302055:0:6530:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788838301.302078:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135168128 00000100:00100000:3.0:1788838301.302086:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135168128 00000100:00100000:3.0:1788838301.302366:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788838301.302377:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a3cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+3:94396:x1875729135168128:12345-0@lo:104: 00010000:00010000:3.0:1788838301.302393:0:6530:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838301.302484:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788838301.302490:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a3cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+3:94396:x1875729135168128:12345-0@lo:104: Request processed in 117us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838301.302497:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788838301.302589:0:94396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94396:1875729135168128:0@lo:104: 00010000:00010000:0.0:1788838301.302614:0:94396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.303375:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838301.303383:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.303392:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788838301.303396:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.303405:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838301.303411:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838301.303429:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788838301.303478:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.303485:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838301.303511:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.303518:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9e97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9e9e expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.303534:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838301.303536:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838301.303538:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838301.303545:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838301.303559:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135168256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838301.303606:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838301.303736:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135168256 00000100:00100000:2.0:1788838301.303742:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135168256 00010000:00010000:2.0:1788838301.303768:0:10364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff504626600/0x88da08396ccc9e9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9e97 expref: 11 pid: 94398 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838301.303793:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:2.0:1788838301.303925:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+11:3644:x1875729135168256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838301.303936:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838301.303941:0:10364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff504626600/0x88da08396ccc9e9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9e97 expref: 11 pid: 94398 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.303960:0:10364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff504626600/0x88da08396ccc9e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9e97 expref: 11 pid: 94398 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.303974:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff504626600/0x88da08396ccc9e9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9e97 expref: 11 pid: 94398 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.304000:0:10364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.304009:0:10364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788838301.304023:0:10364:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015355409s 00010000:00010000:2.0:1788838301.304028:0:10364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.304035:0:10364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.304042:0:10364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.304049:0:10364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.304054:0:10364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838301.304057:0:10364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.304064:0:10364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.304092:0:10364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838301.304102:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838301.304144:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:57943c9a-ca27-46d8-8845-5d2bce640e45+10:3644:x1875729135168256:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838301.304152:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:2.0:1788838301.304188:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135168256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838301.304239:0:94396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.304248:0:94396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838301.304254:0:94396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9ecf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788838301.309571:0:94386:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:0.0:1788838301.309934:0:94386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788838301.310056:0:94418:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:1.0:1788838301.310060:0:94418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:2.0:1788838301.310694:0:94419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788838301.311184:0:94386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788838301.311749:0:94419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788838301.316113:0:94419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788838301.316228:0:94419:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788838301.316533:0:94420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94420:1875729135168384:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788838301.316603:0:94420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.316637:0:94420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff601377d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838301.316749:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135168384 00000100:00100000:2.0:1788838301.316757:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135168384 00000100:00100000:2.0:1788838301.316899:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4244 00000100:00100000:2.0:1788838301.316910:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94420:x1875729135168384:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838301.317053:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94420:x1875729135168384:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 145us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838301.317061:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4244 00000100:00100000:1.0:1788838301.317185:0:94420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94420:1875729135168384:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788838301.317218:0:94420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788838301.317244:0:94420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94420:1875729135168512:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788838301.317273:0:94420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.317296:0:94420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff626ae9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838301.317337:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135168512 00000100:00100000:3.0:1788838301.317342:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135168512 00000100:00100000:3.0:1788838301.317370:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4245 00000100:00100000:3.0:1788838301.317377:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94420:x1875729135168512:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788838301.317499:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94420:x1875729135168512:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 122us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838301.317506:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4245 00000100:00100000:1.0:1788838301.317790:0:94420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94420:1875729135168512:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788838301.317951:0:94420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94420:1875729135168640:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788838301.317979:0:94420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838301.318020:0:94420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff626ae9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788838301.318081:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135168640 00000100:00100000:2.0:1788838301.318086:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135168640 00000100:00100000:2.0:1788838301.318115:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4246 00000100:00100000:2.0:1788838301.318122:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94420:x1875729135168640:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788838301.318187:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94420:x1875729135168640:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 65us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838301.318194:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4246 00000100:00100000:1.0:1788838301.318254:0:94420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94420:1875729135168640:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788838301.318292:0:94420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788838301.319381:0:94386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788838301.319418:0:94386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788838301.321363:0:94420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788838301.321458:0:94420:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788838301.321464:0:94420:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:0.0:1788838301.322182:0:94386:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788838301.322197:0:94386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788838301.322286:0:94386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838301.323311:0:94386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788838301.323893:0:94386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788838301.323923:0:94386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788838301.324026:0:94386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788838301.324526:0:94386:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00010000:00080000:0.0:1788838301.340217:0:94386:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 120259084296 00010000:00080000:0.0:1788838301.342673:0:94421:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94421 00010000:02000000:0.0:1788838301.342726:0:94421:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1788838301.342729:0:94421:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788838301.342733:0:94421:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788838301.344659:0:94386:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788838301.344681:0:94386:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788838301.344705:0:94386:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788838301.344736:0:94386:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788838301.347967:0:94386:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838301.348205:0:94386:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788838301.760209:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788838302.268926:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788838302.268935:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff50a9bc000 from 129 10000000:01000000:1.0:1788838302.268940:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788838302.269005:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.269018:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.269031:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838302.269066:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135168768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.269146:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838302.269198:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135168768 00000100:00100000:1.0:1788838302.269206:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1788838302.269213:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135168768 00000100:00100000:0.0:1788838302.269301:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788838302.269314:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+10:6544:x1875729135168768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838302.269334:0:94393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838302.269849:0:94393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9ed6 expref: -99 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.269889:0:94393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9ed6 expref: 11 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.269904:0:94393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9ed6 expref: 11 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.269917:0:94393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627c00, rc 0) 00000100:00100000:0.0:1788838302.270034:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135168768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 721us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838302.270042:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788838302.271068:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135168768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838302.271097:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.271132:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838302.271201:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135168896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.271265:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.271324:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057ae840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.271533:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135168896 00000100:00100000:2.0:1788838302.271547:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135168896 00000100:00100000:2.0:1788838302.271620:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788838302.271629:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135168896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788838302.271667:0:94392:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788838302.271693:0:94392:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788838302.271697:0:94392:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 129 00000100:00100000:2.0:1788838302.271867:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135168896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 238us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.271876:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788838302.272144:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135168896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788838302.272219:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788838302.272228:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.272239:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838302.272250:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788838302.272253:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff503592800 from 58 10000000:01000000:1.0:1788838302.272255:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838302.272295:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.272304:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.272314:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838302.272330:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.273578:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.273634:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057ae840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.274441:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135169024 00000100:00100000:2.0:1788838302.274458:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135169024 00000100:00100000:2.0:1788838302.274533:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788838302.274545:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+11:6544:x1875729135169024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838302.274567:0:94393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838302.274591:0:94393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9ee4 expref: -99 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.274628:0:94393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9ee4 expref: 12 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.274639:0:94393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9ee4 expref: 12 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.274662:0:94393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9200, rc 0) 00000100:00100000:2.0:1788838302.274750:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135169024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.274758:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788838302.274968:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838302.275006:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.275019:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838302.275120:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.275170:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.275195:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057ae840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.288465:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135169152 00000100:00100000:2.0:1788838302.288506:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135169152 00000100:00100000:2.0:1788838302.288603:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788838302.288616:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135169152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.288913:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135169152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (13741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.288922:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788838302.289011:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.289084:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.289145:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.289192:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503e6a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838302.289358:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135169280 00000100:00100000:3.0:1788838302.289364:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135169280 00000100:00100000:3.0:1788838302.289413:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788838302.289422:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135169280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838302.289616:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135169280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838302.289624:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788838302.290895:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788838302.293750:0:94457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1788838302.294579:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1788838302.294617:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788838302.294632:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.294648:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838302.294662:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788838302.294665:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff503592800 from 126 10000000:01000000:3.0:1788838302.294669:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788838302.294722:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.294732:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.294746:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838302.294779:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838302.295063:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838302.295155:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.295212:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135169408 00000100:00100000:2.0:1788838302.295273:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135169408 00000100:00100000:2.0:1788838302.295385:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788838302.295398:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+12:6544:x1875729135169408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838302.295415:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838302.295432:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9ef2 expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.295472:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9ef2 expref: 13 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.295485:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9ef2 expref: 13 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.295496:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8400, rc 0) 00000100:00100000:2.0:1788838302.295580:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135169408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.295587:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788838302.305522:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838302.305551:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.305564:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838302.305652:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.305739:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.305788:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.306713:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135169536 00000100:00100000:2.0:1788838302.306731:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135169536 00000100:00100000:2.0:1788838302.306842:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788838302.306866:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135169536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788838302.306900:0:94398:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788838302.306922:0:94398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788838302.306927:0:94398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788838302.306931:0:94398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788838302.306935:0:94398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788838302.306938:0:94398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 129 00000100:00100000:2.0:1788838302.307125:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135169536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 272us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.307135:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788838302.307148:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788838302.307323:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788838302.307342:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.307354:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838302.307365:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788838302.307368:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1788838302.307371:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788838302.307483:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.307494:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.307505:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838302.307530:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838302.307578:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838302.307636:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036de540 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.308039:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135169664 00000100:00100000:2.0:1788838302.308047:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135169664 00000100:00100000:2.0:1788838302.308101:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788838302.308115:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+13:6544:x1875729135169664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838302.308129:0:94393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838302.308146:0:94393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9f07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f00 expref: -99 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.308178:0:94393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f00 expref: 14 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.308191:0:94393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f00 expref: 14 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.308235:0:94393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8a00, rc 0) 00000100:00100000:2.0:1788838302.308287:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135169664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.308294:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788838302.308340:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838302.308357:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.308372:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838302.308449:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.308495:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.308515:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503e6a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.308529:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135169792 00000100:00100000:2.0:1788838302.308532:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135169792 00000100:00100000:2.0:1788838302.308561:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788838302.308571:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135169792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.308756:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135169792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.308764:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788838302.309105:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.309153:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.309206:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.309239:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.309283:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135169920 00000100:00100000:2.0:1788838302.309289:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135169920 00000100:00100000:2.0:1788838302.309356:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788838302.309365:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135169920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.309507:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135169920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.309515:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788838302.309839:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135169920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838302.311097:0:94459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:2.0:1788838302.311433:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:2.0:1788838302.311544:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788838302.311563:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.311578:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838302.311590:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1788838302.311594:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ff503592800 from 1 10000000:01000000:2.0:1788838302.311598:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788838302.311652:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9600/0x88da08396ccc9f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.311661:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9600/0x88da08396ccc9f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.311675:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9600/0x88da08396ccc9f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838302.311712:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.312485:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.312531:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.312565:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135170048 00000100:00100000:2.0:1788838302.312575:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135170048 00000100:00100000:2.0:1788838302.312635:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788838302.312654:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+14:6544:x1875729135170048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838302.312674:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838302.312695:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc9f15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f0e expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.312729:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc9f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f0e expref: 15 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.312742:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9e00/0x88da08396ccc9f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f0e expref: 15 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.312846:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9e00, rc 0) 00000100:00100000:2.0:1788838302.312973:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135170048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 321us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.312993:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788838302.313060:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838302.313080:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9600/0x88da08396ccc9f0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f15 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.313090:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9600/0x88da08396ccc9f0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f15 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838302.313110:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788838302.313115:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9600/0x88da08396ccc9f0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f15 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.313122:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9600/0x88da08396ccc9f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f15 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838302.313142:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788838302.313145:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff503592800 from 7 10000000:01000000:2.0:1788838302.313147:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838302.313172:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc9f1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.313181:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc9f1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.313189:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc9f1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838302.313226:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.313262:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.313284:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.313302:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135170176 00000100:00100000:2.0:1788838302.313306:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135170176 00000100:00100000:2.0:1788838302.313341:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788838302.313351:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135170176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838302.313359:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838302.313372:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc9f23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f1c expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.313515:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc9f23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f1c expref: 16 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.313526:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc9f23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f1c expref: 16 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.313545:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9c00, rc 0) 00000100:00100000:2.0:1788838302.313579:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135170176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.313586:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788838302.313624:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838302.313636:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc9f1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f23 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.313646:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc9f1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f23 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838302.313715:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.313742:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.313871:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.313956:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135170304 00000100:00100000:2.0:1788838302.313961:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135170304 00000100:00100000:2.0:1788838302.314001:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788838302.314009:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135170304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.314140:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135170304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.314147:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788838302.314489:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.314530:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.314585:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.314609:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.314625:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135170432 00000100:00100000:2.0:1788838302.314629:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135170432 00000100:00100000:2.0:1788838302.314653:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788838302.314660:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135170432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.314945:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135170432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.314956:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788838302.315048:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788838302.319437:0:94461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788838302.319996:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788838302.320024:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788838302.320036:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc9f1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f23 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.320048:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc9f1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f23 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838302.320059:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788838302.320062:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff63f7ce800 from 58 10000000:01000000:2.0:1788838302.320065:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788838302.320102:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.320110:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.320121:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838302.320145:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.320241:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.320293:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838302.320391:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135170560 00000100:00100000:3.0:1788838302.320398:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135170560 00000100:00100000:3.0:1788838302.320448:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788838302.320457:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135170560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838302.320471:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838302.320484:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc9f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f2a expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.320522:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc9f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f2a expref: 17 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.320534:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc9f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f2a expref: 17 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.320543:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5000, rc 0) 00000100:00100000:3.0:1788838302.320595:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135170560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838302.320603:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788838302.321666:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838302.321689:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.321702:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838302.321781:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.321861:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838302.321890:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966000 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.321961:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135170688 00000100:00100000:2.0:1788838302.321967:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135170688 00000100:00100000:2.0:1788838302.322030:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788838302.322052:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135170688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.322184:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135170688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.322192:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788838302.322314:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.322346:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.322403:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838302.322426:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966000 going to sleep for 11 seconds 00000100:00100000:3.0:1788838302.322617:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135170816 00000100:00100000:3.0:1788838302.322622:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135170816 00000100:00100000:3.0:1788838302.322658:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788838302.322666:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135170816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838302.322754:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135170816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838302.322762:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788838302.325604:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838302.327681:0:94462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1788838302.327856:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1788838302.327961:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838302.327991:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.328008:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838302.328021:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788838302.328025:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788838302.328029:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788838302.328083:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.328093:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.328107:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838302.328142:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.328264:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.328358:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838302.328441:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135170944 00000100:00100000:0.0:1788838302.328453:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135170944 00000100:00100000:0.0:1788838302.328515:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788838302.328526:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135170944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838302.328543:0:94393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838302.328565:0:94393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504627a00/0x88da08396ccc9f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f38 expref: -99 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.328605:0:94393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504627a00/0x88da08396ccc9f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f38 expref: 18 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.328618:0:94393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504627a00/0x88da08396ccc9f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f38 expref: 18 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.328628:0:94393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627a00, rc 0) 00000100:00100000:0.0:1788838302.328717:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135170944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838302.328727:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788838302.328777:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135170944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838302.328890:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.328903:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838302.329002:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.329046:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.329081:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947480 going to sleep for 11 seconds 00000100:00100000:0.0:1788838302.331479:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135171072 00000100:00100000:0.0:1788838302.331493:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135171072 00000100:00100000:0.0:1788838302.331563:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788838302.331572:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135171072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.331766:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135171072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838302.331773:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788838302.331885:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.331973:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.332081:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.332140:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.332433:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135171200 00000100:00100000:2.0:1788838302.332440:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135171200 00000100:00100000:2.0:1788838302.332486:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788838302.332493:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a3cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135171200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.334646:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a3cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135171200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2137us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838302.334666:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788838302.337060:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838302.339660:0:94464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788838302.341552:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788838302.341612:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788838302.341629:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.341644:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838302.341677:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788838302.341680:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff63f7ce800 from 7 10000000:01000000:2.0:1788838302.341684:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838302.341736:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.341744:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.341770:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838302.341839:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.342077:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.342141:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838302.344605:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135171328 00000100:00100000:0.0:1788838302.344619:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135171328 00000100:00100000:0.0:1788838302.344686:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788838302.344697:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5056c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135171328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838302.344714:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838302.344733:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504626200/0x88da08396ccc9f4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f46 expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.344761:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504626200/0x88da08396ccc9f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f46 expref: 19 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.344784:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504626200/0x88da08396ccc9f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f46 expref: 19 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.344794:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626200, rc 0) 00000100:00100000:0.0:1788838302.344898:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5056c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135171328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838302.344906:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788838302.345493:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838302.345516:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9f46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f4d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.345529:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9f46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f4d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838302.345616:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838302.345663:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838302.345707:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036dea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838302.347093:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135171456 00000100:00100000:1.0:1788838302.347113:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135171456 00000100:00100000:1.0:1788838302.347200:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788838302.347214:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135171456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838302.347488:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838302.347547:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838302.347617:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838302.347652:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036dea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838302.348012:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135171456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 796us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838302.348030:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788838302.348081:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135171584 00000100:00100000:1.0:1788838302.348087:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135171584 00000100:00100000:1.0:1788838302.348123:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788838302.348131:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135171584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.348286:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135171584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838302.348294:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788838302.348359:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838302.355559:0:94466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788838302.356026:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788838302.356076:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788838302.356090:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9f46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f4d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.356104:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f4d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838302.356114:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788838302.356117:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627f9a800 from 58 10000000:01000000:3.0:1788838302.356120:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788838302.356165:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.356173:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.356184:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838302.356210:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838302.356283:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838302.356346:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036dea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838302.356673:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135171712 00000100:00100000:1.0:1788838302.356681:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135171712 00000100:00100000:1.0:1788838302.356743:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788838302.356753:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135171712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838302.356768:0:94393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838302.356783:0:94393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50a2e9600/0x88da08396ccc9f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f54 expref: -99 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.356857:0:94393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50a2e9600/0x88da08396ccc9f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f54 expref: 20 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.356870:0:94393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50a2e9600/0x88da08396ccc9f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f54 expref: 20 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.356880:0:94393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e9600, rc 0) 00000100:00100000:1.0:1788838302.356931:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135171712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838302.356938:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788838302.356997:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838302.357012:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.357021:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838302.357081:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.357108:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.357131:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838302.362285:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135171840 00000100:00100000:1.0:1788838302.362304:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135171840 00000100:00100000:1.0:1788838302.362410:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788838302.362421:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135171840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.362609:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135171840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (5499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838302.362618:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788838302.362706:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.362759:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.362834:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.362861:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838302.362873:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135171968 00000100:00100000:1.0:1788838302.362876:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135171968 00000100:00100000:1.0:1788838302.362896:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788838302.362901:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135171968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.362993:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135171968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838302.362999:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788838302.363040:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135171968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788838302.364227:0:94467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1788838302.366349:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1788838302.366400:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838302.366414:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.366428:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838302.366460:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788838302.366464:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788838302.366467:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788838302.366510:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.366519:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.366529:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838302.366555:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.366629:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.366676:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838302.368398:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135172096 00000100:00100000:3.0:1788838302.368412:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135172096 00000100:00100000:3.0:1788838302.368479:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788838302.368489:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135172096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838302.368508:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838302.368526:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9f69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f62 expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.368556:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f62 expref: 21 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.368568:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f62 expref: 21 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.368578:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a4000, rc 0) 00000100:00100000:3.0:1788838302.368673:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135172096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838302.368681:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788838302.369751:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838302.369788:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.369990:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838302.370118:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.370189:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.370627:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135172224 00000100:00100000:1.0:1788838302.370639:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135172224 00000100:00100000:1.0:1788838302.370704:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788838302.370716:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135172224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.373820:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50348ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788838302.385462:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135172224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 14737us (15261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838302.385480:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788838302.385546:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.385612:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.385676:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838302.385708:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057ae840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838302.385746:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135172352 00000100:00100000:1.0:1788838302.385752:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135172352 00000100:00100000:1.0:1788838302.385827:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788838302.385839:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135172352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838302.387098:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135172352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1253us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838302.387116:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788838302.387362:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838302.394789:0:94472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788838302.395869:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788838302.395913:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788838302.395925:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.395937:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838302.395947:0:6544:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788838302.395950:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff627f9a800 from 7 10000000:01000000:2.0:1788838302.395954:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788838302.396003:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.396019:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.396041:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838302.396069:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.396143:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.396195:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838302.397837:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135172480 00000100:00100000:3.0:1788838302.397849:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135172480 00000100:00100000:3.0:1788838302.397913:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788838302.397923:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135172480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838302.397937:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838302.397953:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc9f77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f70 expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.397991:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc9f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f70 expref: 22 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.398019:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc9f77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f70 expref: 22 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.398028:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5e00, rc 0) 00000100:00100000:3.0:1788838302.398097:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135172480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838302.398104:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788838302.398135:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838302.398156:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838302.398168:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838302.398249:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.398292:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.398340:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838302.398358:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135172608 00000100:00100000:0.0:1788838302.398371:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135172608 00000100:00100000:0.0:1788838302.398437:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788838302.398447:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135172608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.402432:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135172608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3973us (4127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838302.402451:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788838302.403225:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.403317:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.403407:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838302.403463:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838302.404290:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135172736 00000100:00100000:0.0:1788838302.404318:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135172736 00000100:00100000:0.0:1788838302.404392:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788838302.404404:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135172736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.404735:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135172736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 332us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838302.404744:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788838302.404865:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838302.413609:0:94473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788838302.421599:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788838302.421643:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788838302.421655:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.421666:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838302.421676:0:6544:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788838302.421679:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ff610244d28 from 1 10000000:01000000:0.0:1788838302.421682:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788838302.421721:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504627800/0x88da08396ccc9f7e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.421729:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff504627800/0x88da08396ccc9f7e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.421739:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff504627800/0x88da08396ccc9f7e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838302.421763:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.421858:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838302.421894:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62765d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838302.422418:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135172864 00000100:00100000:3.0:1788838302.422427:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135172864 00000100:00100000:3.0:1788838302.422485:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788838302.422497:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135172864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838302.422511:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838302.422530:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9f85 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f7e expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.422555:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9f85 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f7e expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.422566:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff5059a5800/0x88da08396ccc9f85 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f7e expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838302.422575:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff5059a5800, rc 0) 00000100:00100000:3.0:1788838302.422620:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135172864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838302.422626:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788838302.424853:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838302.424900:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff504627800/0x88da08396ccc9f7e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f85 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.424913:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff504627800/0x88da08396ccc9f7e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f85 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838302.424937:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788838302.424942:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504627800/0x88da08396ccc9f7e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f85 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.424949:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff504627800/0x88da08396ccc9f7e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f85 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838302.424957:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788838302.424959:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ff610244d28 from 1 10000000:01000000:0.0:1788838302.424962:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788838302.425005:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.425013:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.425022:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838302.425041:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.425099:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838302.425149:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62765d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838302.425173:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135172992 00000100:00100000:0.0:1788838302.425179:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135172992 00000100:00100000:0.0:1788838302.428773:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788838302.428788:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135172992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838302.428818:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838302.428836:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff504626600/0x88da08396ccc9f93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9f8c expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.428866:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff504626600/0x88da08396ccc9f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9f8c expref: 24 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.428877:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff504626600/0x88da08396ccc9f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f8c expref: 24 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.428888:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626600, rc 0) 00000100:00100000:0.0:1788838302.428966:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135172992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (3867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838302.428986:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788838302.429056:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135172992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838302.429074:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.429084:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838302.429156:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135173120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838302.429190:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838302.431085:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62765d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838302.431229:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135173120 00000100:00100000:2.0:1788838302.431248:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135173120 00000100:00100000:2.0:1788838302.431320:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788838302.431333:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135173120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838302.431633:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135173120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (2440us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788838302.431641:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788838302.432328:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135173120:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788838302.432728:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788838302.432745:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838302.432790:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838302.460935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838302.461028:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116472960 00000100:00100000:1.0:1788838302.461045:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116472960 00000100:00100000:1.0:1788838302.461116:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:1.0:1788838302.461128:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116472960:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838302.461147:0:94393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838302.461168:0:94393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfa1 expref: -99 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.461213:0:94393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa1 expref: 10 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.461226:0:94393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa1 expref: 10 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838302.461235:0:94393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e8000, rc 0) 00000100:00100000:1.0:1788838302.461554:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116472960:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 427us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838302.461561:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:1.0:1788838302.470064:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838302.470149:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116473088 00000100:00100000:3.0:1788838302.470160:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116473088 00000100:00100000:3.0:1788838302.470415:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:3.0:1788838302.470427:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116473088:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788838302.470453:0:94395:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788838302.470469:0:94395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788838302.470472:0:94395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788838302.470476:0:94395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788838302.470479:0:94395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788838302.470482:0:94395:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 129 00000100:00100000:3.0:1788838302.477528:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116473088:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 Request processed in 7092us (7462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838302.477545:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:3.0:1788838302.481249:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838302.481416:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116473216 00000100:00100000:0.0:1788838302.481428:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116473216 00000100:00100000:0.0:1788838302.481486:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1433 00000100:00100000:0.0:1788838302.481494:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1875729116473216:12345-192.168.203.30@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1788838302.481527:0:66254:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'efc561ba-875e-4857-b79b-9bd7023bd57c' at ffff8ff609269000, cookie 0x88da08396ccc9e27 00010000:00080000:0.0:1788838302.481533:0:66254:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp recovering/t120259084297 exp ffff8ff609269000 cur 3696 last 1788838301 00010000:02000400:0.0:1788838302.481542:0:66254:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788838302.481548:0:66254:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1788838302.481568:0:66254:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788838302.481712:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff503543000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838302.481789:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116473216:12345-192.168.203.30@tcp:38:ll_cfg_requeue.0 Request processed in 293us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838302.481822:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1433 00000100:00100000:1.0:1788838302.488561:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838302.488670:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116463360 00000100:00100000:0.0:1788838302.488681:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116463360 00000100:00100000:0.0:1788838302.488758:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1434 00000100:00100000:0.0:1788838302.488770:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116463360:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00080000:0.0:1788838302.488792:0:66255:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 120259084297, current: 120259084297, replaying 00000100:00100000:0.0:1788838302.488838:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116463360:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 67us (284us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838302.488864:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1434 00010000:00080000:3.0:1788838302.488923:0:94421:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1788838302.781532:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838302.789699:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838302.792358:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116473344 00000100:00100000:3.0:1788838302.792385:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116473344 00000100:00100000:3.0:1788838302.792443:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:3.0:1788838302.792454:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116473344:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838302.795645:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116473344:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3180us (5945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838302.795663:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:0.0:1788838302.796291:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838302.796818:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116473472 00000100:00100000:3.0:1788838302.796827:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116473472 00000100:00100000:3.0:1788838302.796896:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1399 00000100:00100000:3.0:1788838302.796906:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2407:x1875729116473472:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838302.797329:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2407:x1875729116473472:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 422us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838302.797337:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1399 00000100:00080000:2.0:1788838302.800342:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838303.104227:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135173376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838303.104295:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135173248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838303.104327:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838303.104406:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135173376 00000100:00100000:1.0:1788838303.104419:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135173376 00000100:00100000:1.0:1788838303.104581:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:1.0:1788838303.104597:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135173376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838303.104637:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00080000:0.0:1788838303.104792:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838303.112020:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838303.112245:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135173248 00000100:00100000:0.0:1788838303.112258:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135173248 00000100:00100000:0.0:1788838303.112350:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:0.0:1788838303.112371:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135173248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838303.112426:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838303.112431:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135173376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7839us (8105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838303.112445:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00100000:3.0:1788838303.112465:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135173376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838303.112503:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135173248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838303.112511:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00080000:2.0:1788838303.112567:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838303.112608:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135173248:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788838303.805211:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838304.829038:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838305.857054:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838306.684929:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838306.684937:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838306.684941:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838306.684960:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3695 00000100:00080000:0.0:1788838306.684964:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838306.684970:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff5021a5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838306.684992:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd0e00 x1875729135173632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838306.685023:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838306.685027:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838306.685028:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838306.685048:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3695 00000100:00080000:0.0:1788838306.685050:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838306.685054:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ff501ab3000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838306.685067:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd3b80 x1875729135173888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838306.685097:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838306.685101:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838306.685103:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838306.685107:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3695 00000100:00080000:0.0:1788838306.685109:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838306.685113:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ff6061da800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838306.685126:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bcd1180 x1875729135174144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838306.685154:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838306.685157:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838306.685159:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838306.685162:0:63434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3695 00000100:00080000:0.0:1788838306.685164:0:63434:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788838306.685167:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ff632feb800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838306.685178:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff6407a9880 x1875729135174528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838306.685205:0:63434:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788838306.685207:0:63434:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788838306.685209:0:63434:0:(import.c:65:import_set_state_nolock()) ffff8ff6104d8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838306.685221:0:63434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ff6104d8000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838306.685234:0:63434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff632fcd500 x1875729135175040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838306.685266:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135173504:0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.685335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685376:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135174400:0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.685406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685433:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788838306.685439:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135174272:0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.685461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685478:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135174912:0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.685502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685531:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135173632:0@lo:38:kworker.0 00000100:00100000:0.0:1788838306.685555:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685572:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135173888:0@lo:38:kworker.0 00000100:00100000:0.0:1788838306.685594:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685610:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135174144:0@lo:38:kworker.0 00000100:00100000:0.0:1788838306.685633:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685647:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135174528:0@lo:38:kworker.0 00000100:00100000:0.0:1788838306.685667:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685682:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135175040:0@lo:38:kworker.0 00000100:00100000:0.0:1788838306.685702:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685731:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135173760:0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.685754:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685778:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135174656:0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.685830:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685847:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788838306.685852:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135174016:0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.685872:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685883:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135174784:0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.685898:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.685925:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135174400 00000100:00100000:0.0:1788838306.685932:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135174400 00000100:00100000:0.0:1788838306.685989:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135174272 00000100:00100000:0.0:1788838306.685992:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135174272 00000100:00100000:0.0:1788838306.686009:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135174912 00000100:00100000:0.0:1788838306.686010:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135174912 00000100:00100000:0.0:1788838306.686024:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135174784 00000100:00100000:0.0:1788838306.686026:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135174784 00000100:00100000:0.0:1788838306.686042:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1788838306.686049:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff641348450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135174400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.686095:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff641348450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135174400:12345-0@lo:400:kworker.0 Request processed in 46us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.686101:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1788838306.686269:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:0.0:1788838306.686275:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135174272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.686303:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135174272:12345-0@lo:400:kworker.0 Request processed in 28us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.686308:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:0.0:1788838306.686320:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:0.0:1788838306.686325:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135174912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.686361:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135174912:12345-0@lo:400:kworker.0 Request processed in 36us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.686367:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:0.0:1788838306.686378:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:0.0:1788838306.686383:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135174784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.686408:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135174784:12345-0@lo:400:kworker.0 Request processed in 25us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.686413:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:0.0:1788838306.686436:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135173632 00000100:00100000:0.0:1788838306.686439:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135173632 00000100:00100000:0.0:1788838306.686451:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135173888 00000100:00100000:0.0:1788838306.686453:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135173888 00000100:00100000:0.0:1788838306.686459:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135174528 00000100:00100000:0.0:1788838306.686461:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135174528 00000100:00100000:0.0:1788838306.686466:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135175040 00000100:00100000:0.0:1788838306.686468:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135175040 00000100:00100000:0.0:1788838306.686472:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135173760 00000100:00100000:0.0:1788838306.686474:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135173760 00000100:00100000:0.0:1788838306.686486:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135174016 00000100:00100000:0.0:1788838306.686488:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135174016 00000100:00100000:0.0:1788838306.686498:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1788838306.686502:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135173760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.686528:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135173760:12345-0@lo:400:kworker.0 Request processed in 25us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.686533:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1788838306.686542:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1788838306.686546:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135174016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.686567:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135174016:12345-0@lo:400:kworker.0 Request processed in 21us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.686579:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1788838306.686591:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1788838306.686594:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135173632:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788838306.686616:0:66254:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3700 last 0 00000020:00000080:0.0:1788838306.686647:0:66254:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88da08396ccc9fa1 00000004:00100000:0.0:1788838306.686660:0:66254:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788838306.686785:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff639653000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838306.686853:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875729135173632:12345-0@lo:38:kworker.0 Request processed in 257us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.686860:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1788838306.686872:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1788838306.686876:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135173888:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788838306.686889:0:66254:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3700 last 0 00000020:00000080:0.0:1788838306.686909:0:66254:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x88da08396ccc9fa8 00000004:00100000:0.0:1788838306.686915:0:66254:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788838306.686929:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff639650800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838306.686971:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875729135173888:12345-0@lo:38:kworker.0 Request processed in 93us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.686977:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1788838306.686990:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1788838306.686993:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135174528:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788838306.687007:0:66254:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3700 last 0 00000020:00000080:0.0:1788838306.687027:0:66254:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x88da08396ccc9faf 00000004:00100000:0.0:1788838306.687033:0:66254:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788838306.687055:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff609253000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838306.687083:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875729135174528:12345-0@lo:38:kworker.0 Request processed in 88us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.687090:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1788838306.687103:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1788838306.687107:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875729135175040:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788838306.687119:0:66254:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3700 last 0 00000020:00000080:0.0:1788838306.687139:0:66254:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x88da08396ccc9fb6 00000004:00100000:0.0:1788838306.687144:0:66254:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788838306.687158:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff609251000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838306.687186:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875729135175040:12345-0@lo:38:kworker.0 Request processed in 75us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.687194:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00080000:0.0:1788838306.687224:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838306.687228:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838306.687231:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838306.687275:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135174016:0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.687288:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135174784:0@lo:400:kworker.0 00000100:00100000:0.0:1788838306.687298:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135173760:0@lo:400:kworker.0 00010000:00080000:0.0:1788838306.687337:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff62bcd0e00 x1875729135173632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.687349:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00100000:3.0:1788838306.688031:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135174144 00000100:00100000:3.0:1788838306.688041:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135174144 00000100:00100000:3.0:1788838306.688075:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135174656 00000100:00100000:3.0:1788838306.688077:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135174656 00000100:00100000:3.0:1788838306.688104:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4247 00000100:00100000:3.0:1788838306.688110:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3642:x1875729135174144:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788838306.688130:0:23765:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8ff5052d6800, cookie 0x88da08396ccc9e20 00010000:00080000:3.0:1788838306.688135:0:23765:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t120259084299 exp ffff8ff5052d6800 cur 3700 last 1788838301 00000004:00100000:3.0:1788838306.688149:0:23765:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788838306.688170:0:23765:0:(import.c:65:import_set_state_nolock()) ffff8ff627d5b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838306.688227:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504de5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135174144:12345-0@lo:38:kworker.0 Request processed in 116us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838306.688233:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4247 00000100:00100000:3.0:1788838306.688247:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4248 00000100:00100000:3.0:1788838306.688253:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135174656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838306.688287:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135174656:12345-0@lo:400:kworker.0 Request processed in 35us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838306.688292:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4248 00010000:00080000:3.0:1788838306.688335:0:94421:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788838306.688340:0:94421:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 120259084297 00000020:00080000:3.0:1788838306.688345:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838306.688348:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084297, next_transno: 120259084297 00010000:00080000:3.0:1788838306.688367:0:94421:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (120259084297) 00000020:00080000:3.0:1788838306.688370:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788838306.688378:0:94421:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116463360 t120259084297 from 192.168.203.30@tcp req@ffff8ff5071cad80 x1875729116463360/t0(120259084297) o36->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:203/0 lens 528/0 e 0 to 0 dl 1788838313 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838306.688551:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135174656:0@lo:400:kworker.0 00000004:00080000:3.0:1788838306.689273:0:94421:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 845us 00000100:00100000:2.0:1788838306.691583:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135173504 00000100:00100000:2.0:1788838306.691598:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135173504 00000100:00100000:2.0:1788838306.691654:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788838306.691664:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135173504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838306.691756:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135173504:12345-0@lo:400:kworker.0 Request processed in 93us (6420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838306.691763:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788838306.691855:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135174272:0@lo:400:kworker.0 00000100:00100000:2.0:1788838306.691876:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135174912:0@lo:400:kworker.0 00000100:00100000:2.0:1788838306.691885:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135173504:0@lo:400:kworker.0 00000100:00100000:2.0:1788838306.691897:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135174400:0@lo:400:kworker.0 00000100:00100000:1.0:1788838306.692265:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838306.692280:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135175168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838306.692321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838306.692355:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135175168 00000100:00100000:1.0:1788838306.692360:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135175168 00000100:00100000:1.0:1788838306.692390:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4249 00000100:00100000:1.0:1788838306.692397:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135175168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838306.692425:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:1.0:1788838306.692462:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135175168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838306.692469:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4249 00000100:00100000:1.0:1788838306.692500:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135175168:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788838306.696734:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788838306.696769:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:0.0:1788838306.698652:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8ff62bcd0e00 x1875729135173632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838331 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.698665:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788838306.698679:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788838306.698683:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788838306.698689:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135173632:0@lo:38:kworker.0 00010000:00080000:0.0:1788838306.698724:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff62bcd3b80 x1875729135173888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.698739:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 29 00000100:00080000:0.0:1788838306.699759:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8ff62bcd3b80 x1875729135173888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838331 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.699769:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788838306.699774:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff501ab3000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788838306.699778:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788838306.699783:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875729135173888:0@lo:38:kworker.0 00000100:00080000:0.0:1788838306.700914:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 29 00000100:00080000:0.0:1788838306.700931:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788838306.700939:0:3642:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1788838306.700942:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:0.0:1788838306.700962:0:3642:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ff61fc29c00 x1875729135151616/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788838281 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.700972:0:3642:0:(recover.c:53:ptlrpc_replay_next()) import ffff8ff6061da800 from lustre-MDT0000_UUID committed 120259084296 last 0 00000100:00080000:0.0:1788838306.700980:0:3642:0:(client.c:3553:ptlrpc_replay_req()) @@@ REPLAY req@ffff8ff61fc29c00 x1875729135151616/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788838281 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838306.700994:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135174144:0@lo:38:kworker.0 00000001:00100000:2.0:1788838306.701010:0:75678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788838306.701018:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff6407a9880 x1875729135174528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.701050:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 29 00000100:00080000:0.0:1788838306.703012:0:3642:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8ff6407a9880 x1875729135174528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838331 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.703025:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788838306.703030:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff632feb800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788838306.703034:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788838306.703041:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875729135174528:0@lo:38:kworker.0 00010000:00080000:1.0:1788838306.705530:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff632fcd500 x1875729135175040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838306.705564:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 29 00000100:00080000:1.0:1788838306.705575:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788838306.705581:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788838306.705584:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6104d8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788838306.705592:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875729135175040:0@lo:38:kworker.0 00000100:00100000:1.0:1788838306.705637:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135151616:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788838306.705700:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838306.705745:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135151616 00000100:00100000:1.0:1788838306.705752:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135151616 00000100:00100000:1.0:1788838306.705794:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4250 00000100:00100000:1.0:1788838306.705822:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135151616:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:1.0:1788838306.705840:0:8472:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 120259084297, current: 120259084299, replaying 00000100:00100000:1.0:1788838306.705847:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875729135151616:12345-0@lo:1000:osp_up0-1.0 Request processed in 27us (147us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838306.705853:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4250 00010000:00010000:0.0:1788838306.714039:0:94421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccc9fbd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.714062:0:94421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccc9fbd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.714076:0:94421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccc9fbd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.714089:0:94421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.714096:0:94421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.714102:0:94421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.715637:0:94421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccc9fbd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.715654:0:94421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccc9fbd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.715671:0:94421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccc9fbd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.715678:0:94421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838306.715682:0:94421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccc9fbd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.715691:0:94421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccc9fbd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.715706:0:94421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff608f3c700) 00010000:00010000:0.0:1788838306.715709:0:94421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838306.715713:0:94421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccc9fbd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.715720:0:94421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccc9fbd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838306.715742:0:94421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079c15b4f reply state 000000004c564c89 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.715754:0:94421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.715761:0:94421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff608f3c000) 00010000:00010000:0.0:1788838306.715764:0:94421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838306.715767:0:94421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788838306.715913:0:94421:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1788838306.715934:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.715938:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084298 00000020:00080000:0.0:1788838306.715960:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.715963:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084298 00000100:00100000:3.0:1788838306.720025:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838306.720200:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116463872 00000100:00100000:2.0:1788838306.720210:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116463872 00000100:00100000:2.0:1788838306.720625:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1439 00000100:00100000:2.0:1788838306.720639:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2403:x1875729116463872:12345-192.168.203.30@tcp:36:rm.0 00010000:00080000:2.0:1788838306.720662:0:66254:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 120259084298, current: 120259084298, replaying 00000100:00100000:2.0:1788838306.720684:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2403:x1875729116463872:12345-192.168.203.30@tcp:36:rm.0 Request processed in 49us (668us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838306.720691:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1439 00000020:00080000:0.0:1788838306.720822:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.720827:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 120259084298, next_transno: 120259084298 00010000:00080000:0.0:1788838306.720831:0:94421:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (120259084298) 00000020:00080000:0.0:1788838306.720834:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.720844:0:94421:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116463872 t120259084298 from 192.168.203.30@tcp req@ffff8ff61d27ea00 x1875729116463872/t0(120259084298) o36->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:207/0 lens 512/0 e 0 to 0 dl 1788838317 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788838306.720929:0:94421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396ccc9fcb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.720962:0:94421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396ccc9fcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.720977:0:94421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396ccc9fcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.720992:0:94421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721001:0:94421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721008:0:94421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721091:0:94421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc9fd9 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721099:0:94421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc9fd9 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721136:0:94421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc9fd9 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721378:0:94421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc9fd9 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721386:0:94421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc9fd9 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721393:0:94421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc9fd9 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721399:0:94421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838306.721404:0:94421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc9fd9 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721412:0:94421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc9fd9 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721424:0:94421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff8ff605587000) 00010000:00010000:0.0:1788838306.721439:0:94421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788838306.721445:0:94421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc9fd9 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721450:0:94421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccc9fd9 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721472:0:94421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396ccc9fcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721478:0:94421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396ccc9fcb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721501:0:94421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396ccc9fcb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721506:0:94421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838306.721510:0:94421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396ccc9fcb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721517:0:94421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396ccc9fcb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721526:0:94421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587f00) 00010000:00010000:0.0:1788838306.721528:0:94421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838306.721531:0:94421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396ccc9fcb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721537:0:94421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396ccc9fcb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838306.721550:0:94421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a557dd0 reply state 00000000ca46d6d0 transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721561:0:94421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.721568:0:94421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff608f3c000) 00010000:00010000:0.0:1788838306.721570:0:94421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838306.721573:0:94421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788838306.721654:0:94421:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788838306.721673:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.721676:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084299 00010000:00080000:0.0:1788838306.721685:0:94421:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (120259084299) 00000020:00080000:0.0:1788838306.721688:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.721696:0:94421:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729135151616 t120259084299 from 0@lo req@ffff8ff5071c9180 x1875729135151616/t0(120259084299) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:207/0 lens 488/0 e 0 to 0 dl 1788838317 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788838306.721878:0:94421:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788838306.721888:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.721891:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000020:00080000:0.0:1788838306.721894:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.721896:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000100:00080000:0.0:1788838306.722086:0:3642:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ got reply req@ffff8ff61fc29c00 x1875729135151616/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788838322 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.722096:0:3642:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1788838306.722098:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:0.0:1788838306.722103:0:3642:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ff61fc29c00 x1875729135151616/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788838322 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.722110:0:3642:0:(recover.c:53:ptlrpc_replay_next()) import ffff8ff6061da800 from lustre-MDT0000_UUID committed 120259084296 last 120259084299 00000100:00080000:0.0:1788838306.722117:0:3642:0:(client.c:3553:ptlrpc_replay_req()) @@@ REPLAY req@ffff8ff505930e00 x1875729135152000/t120259084300(120259084300) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788838283 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838306.722129:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135151616:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788838306.722146:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135152000:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788838306.722178:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.722215:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135152000 00000100:00100000:0.0:1788838306.722220:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135152000 00000100:00100000:0.0:1788838306.722247:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4251 00000100:00100000:0.0:1788838306.722254:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1875729135152000:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1788838306.722273:0:23765:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 120259084300, current: 120259084300, replaying 00000100:00100000:0.0:1788838306.722282:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3642:x1875729135152000:12345-0@lo:1000:osp_up0-1.0 Request processed in 29us (105us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838306.722288:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4251 00000020:00080000:0.0:1788838306.722299:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.722301:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084300, next_transno: 120259084300 00010000:00080000:0.0:1788838306.722305:0:94421:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (120259084300) 00000020:00080000:0.0:1788838306.722307:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.722311:0:94421:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729135152000 t120259084300 from 0@lo req@ffff8ff633275880 x1875729135152000/t0(120259084300) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:207/0 lens 488/0 e 0 to 0 dl 1788838317 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788838306.722388:0:94421:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788838306.722397:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.722399:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000020:00080000:0.0:1788838306.722401:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.722403:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000100:00080000:0.0:1788838306.722422:0:3642:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ got reply req@ffff8ff505930e00 x1875729135152000/t120259084300(120259084300) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788838322 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.722429:0:3642:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1788838306.722431:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:0.0:1788838306.722435:0:3642:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ff61fc29c00 x1875729135151616/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788838322 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838306.722441:0:3642:0:(recover.c:53:ptlrpc_replay_next()) import ffff8ff6061da800 from lustre-MDT0000_UUID committed 120259084296 last 120259084300 00000100:00080000:0.0:1788838306.722445:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000001:00080000:0.0:1788838306.722995:0:94387:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084297 is committed 00000100:00100000:0.0:1788838306.723361:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135152000:0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1788838306.723385:0:94610:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788838306.723389:0:94610:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788838306.723395:0:94610:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:0.0:1788838306.724202:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.724217:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.724225:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.724231:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838306.724235:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.724243:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.724258:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff608f3c000) 00010000:00010000:0.0:1788838306.724262:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838306.724266:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.724272:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccc9fc4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.725322:0:94610:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8600/0x88da08396ccc9704 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc970b expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838306.725402:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135175296:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1788838306.725594:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838306.725622:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135175296 00000100:00100000:1.0:1788838306.725629:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135175296 00000100:00100000:1.0:1788838306.725673:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4252 00000100:00100000:1.0:1788838306.725682:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3642:x1875729135175296:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788838306.725704:0:8472:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff637f8d500 x1875729135175296/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:207/0 lens 328/0 e 0 to 0 dl 1788838317 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838306.725721:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3642:x1875729135175296:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 41us (128us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838306.725728:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4252 00000020:00080000:1.0:1788838306.725752:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788838306.725756:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00010000:00080000:0.0:1788838306.725814:0:94610:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:3.0:1788838306.729972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838306.733259:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116473600 00000100:00100000:0.0:1788838306.733274:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116473600 00000100:00100000:0.0:1788838306.733543:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1402 00000100:00100000:0.0:1788838306.733555:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2403:x1875729116473600:12345-192.168.203.30@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788838306.733579:0:66253:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff6270bf480 x1875729116473600/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:207/0 lens 224/0 e 0 to 0 dl 1788838317 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838306.733612:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2403:x1875729116473600:12345-192.168.203.30@tcp:400:ldlm_lock_repla.0 Request processed in 51us (3641us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838306.733619:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1402 00000020:00080000:0.0:1788838306.734063:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.734067:0:94421:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 120259084301 00010000:00080000:0.0:1788838306.734070:0:94421:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1788838306.734073:0:94421:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788838306.734079:0:94421:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788838306.734082:0:94421:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788838306.734089:0:94421:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff8ff637f8d500 x1875729135175296/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:207/0 lens 328/0 e 0 to 0 dl 1788838317 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788838306.734107:0:94421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838306.734207:0:94421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc9fe0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x88da08396ccc9704 expref: -99 pid: 94421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.734235:0:94421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc9fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccc9704 expref: 9 pid: 94421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.734250:0:94421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030000/0x88da08396ccc9fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9704 expref: 9 pid: 94421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.734273:0:94421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030000, rc 0) 00010000:00080000:0.0:1788838306.735010:0:94421:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788838306.735024:0:94421:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00010000:2.0:1788838306.735123:0:3642:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8ff626ab8600/0x88da08396ccc9704 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9fe0 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788838306.735135:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788838306.735165:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135175296:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1788838306.735189:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135175424:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1788838306.735229:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838306.735407:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135175424 00000100:00100000:0.0:1788838306.735413:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135175424 00000100:00100000:0.0:1788838306.735467:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4253 00000100:00100000:0.0:1788838306.735475:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3642:x1875729135175424:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1788838306.735490:0:23765:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff637f8d180 x1875729135175424/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:207/0 lens 224/0 e 0 to 0 dl 1788838317 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838306.735505:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3642:x1875729135175424:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 32us (277us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838306.735512:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4253 00010000:00080000:0.0:1788838306.735524:0:94421:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788838306.735633:0:94421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051584 00000001:00100000:2.0:1788838306.744027:0:94387:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788838306.744041:0:94387:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000001:00080000:2.0:1788838306.744047:0:94387:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00000001:00080000:2.0:1788838306.744075:0:94387:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00010000:00010000:3.0:1788838306.744225:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.744237:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.744246:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.744253:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838306.744257:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.744265:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.744284:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.744290:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccc9fd2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788838306.744355:0:94421:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1788838306.744396:0:94421:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1788838306.744413:0:94421:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.30@tcp: req@ffff8ff6270bf480 x1875729116473600/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:207/0 lens 224/0 e 0 to 0 dl 1788838317 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788838306.744587:0:94421:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8ff637f8d180 x1875729135175424/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:207/0 lens 224/0 e 0 to 0 dl 1788838317 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788838306.744653:0:94421:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:3.0:1788838306.745884:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084300 gen 3 00000004:00080000:3.0:1788838306.745893:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084299 committed transno 120259084300 00000004:00080000:3.0:1788838306.745926:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084300 committed transno 120259084300 00000100:00080000:3.0:1788838306.745942:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788838306.745960:0:3642:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8ff637f8ed80 x1875729135175424/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838322 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838306.745969:0:3642:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8ff637f8ed80 x1875729135175424/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838322 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838306.745975:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff6061da800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788838306.745990:0:3642:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788838306.745996:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a2fb54b5): req@ffff8ff61fcd0380 x1875729135153664/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838286 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838306.746009:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135175424:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1788838306.746073:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135175552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838306.746134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838306.746175:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838306.746208:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135175552 00000100:00100000:3.0:1788838306.746214:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135175552 00000100:00100000:3.0:1788838306.746251:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135153664 00000100:00100000:3.0:1788838306.746254:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135153664 00000100:00100000:3.0:1788838306.746274:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4254 00000100:00100000:3.0:1788838306.746282:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3643:x1875729135175552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838306.746312:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:3.0:1788838306.746356:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3643:x1875729135175552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838306.746375:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4254 00000100:00100000:3.0:1788838306.746391:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4255 00000100:00100000:3.0:1788838306.746397:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135153664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838306.746408:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:3.0:1788838306.746573:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135153664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838306.746580:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4255 00000100:00100000:3.0:1788838306.746622:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135175552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838306.746631:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135153664:0@lo:41:osp-pre-0-1.0 00000004:00000080:3.0:1788838306.814509:0:94421:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f518867fe10 00100000:10000000:3.0:1788838306.814525:0:94421:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:0.0:1788838306.814662:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000004:00080000:3.0:1788838306.814871:0:94406:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x322:0x0] 00000100:00100000:3.0:1788838306.814909:0:94406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94406:1875729135175680:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788838306.814984:0:94406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838306.815012:0:94406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a48d9c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788838306.815025:0:94408:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:3.0:1788838306.815041:0:94408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94408:1875729135175808:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788838306.815065:0:94408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838306.815079:0:94408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50a48de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838306.815098:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135175680 00000100:00100000:3.0:1788838306.815104:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135175680 00000100:00100000:3.0:1788838306.815141:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135175808 00000100:00100000:3.0:1788838306.815144:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135175808 00000100:00100000:3.0:1788838306.815164:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5986 00000100:00100000:3.0:1788838306.815172:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:94406:x1875729135175680:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788838306.815209:0:26209:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 897 -> diff = -95 00002000:02000040:3.0:1788838306.815214:0:26209:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:803 to 0x280000401:897) 00000100:00100000:0.0:1788838306.823870:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838306.830060:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116473856 00000100:00100000:1.0:1788838306.830082:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116473856 00000100:00100000:1.0:1788838306.830159:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1403 00000100:00100000:1.0:1788838306.830168:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2406:x1875729116473856:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838306.830614:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2406:x1875729116473856:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 444us (15954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838306.830623:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1403 00000100:00100000:1.0:1788838306.830665:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5987 00000100:00100000:1.0:1788838306.830675:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:94408:x1875729135175808:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788838306.830699:0:26217:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 897 -> diff = -94 00002000:02000040:1.0:1788838306.830704:0:26217:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:897) 00000100:00100000:3.0:1788838306.845842:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116473728 00000100:00100000:3.0:1788838306.845856:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116473728 00000100:00100000:3.0:1788838306.845914:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:3.0:1788838306.845924:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2406:x1875729116473728:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838306.846006:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2406:x1875729116473728:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 84us (22146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838306.846013:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00002000:00010000:3.0:1788838306.846990:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.846999:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc9fe7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847016:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x381:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.847021:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.847027:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc9fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847043:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc9fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847053:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc9fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847060:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc9fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847567:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838306.847583:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.847590:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc9fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847599:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.847603:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc9fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847612:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc9fe7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847630:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc9fe7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847636:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043de63f6/0x88da08396ccc9fe7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847654:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.847656:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.847658:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.847769:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.847774:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc9fee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847781:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x380:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.847793:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x380:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.847831:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc9fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847843:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc9fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847852:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc9fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847859:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc9fee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847888:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838306.847895:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.847899:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc9fee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847906:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.847910:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc9fee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847918:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc9fee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847929:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc9fee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847960:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5109fc0/0x88da08396ccc9fee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.847974:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.847975:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.847977:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.848022:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.848027:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc9ff5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848035:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37f:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.848039:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.848042:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc9ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848050:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc9ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848057:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc9ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848064:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc9ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848078:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838306.848112:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.848117:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc9ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848124:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.848127:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc9ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848135:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc9ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848146:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc9ff5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848153:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efe1d8ca/0x88da08396ccc9ff5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848165:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.848167:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.848168:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.848212:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.848217:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc9ffc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.848224:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37e:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.848227:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.848231:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc9ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850308:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc9ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850329:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc9ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850337:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc9ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850360:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838306.850679:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.850686:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccca003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850696:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37d:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.850700:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.850705:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccca003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850715:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccca003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850722:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccca003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850744:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccca003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850764:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788838306.850776:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838306.850781:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc9ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850788:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.850792:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc9ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850823:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc9ffc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850839:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc9ffc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850847:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c36d9b/0x88da08396ccc9ffc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850867:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.850871:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccca003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850887:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.850890:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccca003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850897:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccca003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850906:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccca003 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850912:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9a37efb/0x88da08396ccca003 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.850924:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.850926:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.850928:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.856553:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.856566:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccca00a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856584:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37c:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.856589:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.856597:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccca00a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856612:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccca00a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856639:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccca00a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856645:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccca00a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856674:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838306.856718:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.856723:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccca011 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856732:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37b:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.856735:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.856739:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccca011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856748:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccca011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856755:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccca011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856762:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccca011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856791:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788838306.856819:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838306.856826:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccca00a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856834:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.856838:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccca00a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856846:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccca00a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856862:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccca00a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856869:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009df13184/0x88da08396ccca00a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856891:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.856894:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccca011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856900:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.856903:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccca011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856922:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccca011 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856934:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccca011 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856941:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009463f16c/0x88da08396ccca011 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.856966:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.856968:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.856970:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838306.857006:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.857014:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.857019:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccca018 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857026:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37a:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.857029:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.857033:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccca018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857042:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccca018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857050:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccca018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857064:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccca018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857076:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838306.857099:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838306.857105:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccca018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.857122:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529e00 already unused, calling callback (ffffffffc0dd5350) 00002000:00010000:3.0:1788838306.857126:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.857126:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccca018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857131:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccca01f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.857134:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccca018 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857139:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x379:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.857142:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x379:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.857146:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccca01f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.857152:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccca018 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857154:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccca01f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.857159:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d634831d/0x88da08396ccca018 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857162:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccca01f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857169:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccca01f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.857173:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838306.857175:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838306.857176:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.857181:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838306.857187:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.857190:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccca01f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857202:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.857205:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccca01f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857213:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccca01f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857224:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccca01f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857231:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048c648b9/0x88da08396ccca01f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857245:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.857247:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.857248:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.857260:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.857762:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.857769:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccca026 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857778:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x378:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.857781:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x378:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.857786:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccca026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.857794:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccca026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788838306.857866:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788838306.859506:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccca026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.859515:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccca026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.859753:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838306.859872:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.859879:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccca02d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.859890:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x377:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.859894:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.859899:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccca02d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.859911:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccca02d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.859918:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccca02d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.859924:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccca02d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.859958:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838306.860000:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.860005:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccca034 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.860013:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x376:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.860016:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x376:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.860020:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccca034 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.860029:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccca034 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.860036:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccca034 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860036:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838306.860044:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccca034 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860044:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccca026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860053:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838306.860057:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccca026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860066:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccca026 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860082:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccca026 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860090:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2bf1250/0x88da08396ccca026 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860136:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838306.860141:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccca02d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860147:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838306.860150:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccca02d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860158:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccca02d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860169:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccca02d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860176:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000846565a0/0x88da08396ccca02d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860190:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838306.860193:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccca034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860198:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838306.860202:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccca034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860222:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccca034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860232:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccca034 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.860239:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838306.860241:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838306.864570:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838306.864589:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.867301:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.868131:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788838306.868142:0:26209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab040f31/0x88da08396ccca034 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838306.868501:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.868509:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccca03b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868589:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x375:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.868594:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x375:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.868600:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccca03b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868614:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccca03b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868623:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccca03b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868630:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccca03b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868649:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838306.868692:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.868698:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccca042 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868706:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x374:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.868709:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x374:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.868713:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccca042 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868722:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccca042 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868741:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccca042 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868749:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccca042 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868765:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788838306.868776:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838306.868782:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccca03b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868789:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.868793:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccca03b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.868821:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccca03b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.870376:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccca03b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.870386:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b48a63c/0x88da08396ccca03b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.870413:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.871658:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccca042 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.871673:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.871679:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccca042 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.871691:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccca042 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.871712:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccca042 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.871720:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c892a93/0x88da08396ccca042 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.871745:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.871747:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.871750:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.873865:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838306.874667:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.874681:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccca049 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.874698:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x381:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.874703:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.874709:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccca049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.874727:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccca049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.874737:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccca049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.874758:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccca049 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.874787:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838306.874917:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.874922:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccca050 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.874930:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x380:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.874933:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x380:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.874937:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccca050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838306.875043:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.875049:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccca057 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875059:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x373:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.875062:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x373:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.875065:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccca057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875087:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccca057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875095:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccca057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875102:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccca057 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875113:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838306.875157:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.875162:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047f1a66/0x88da08396ccca05e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875169:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x372:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.875172:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x372:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.875176:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000047f1a66/0x88da08396ccca05e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875185:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000047f1a66/0x88da08396ccca05e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875193:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047f1a66/0x88da08396ccca05e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875211:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000047f1a66/0x88da08396ccca05e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875225:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788838306.875234:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838306.875239:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838306.875240:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccca049 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.875245:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccca057 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875248:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.875252:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccca049 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.875252:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.875255:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccca057 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875263:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccca049 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.875263:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccca057 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875280:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccca049 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.875280:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccca057 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875289:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb75e201/0x88da08396ccca049 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.875289:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba27507d/0x88da08396ccca057 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875308:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838306.875310:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.875312:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000047f1a66/0x88da08396ccca05e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.875312:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.875313:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.875326:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.875327:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.875330:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000047f1a66/0x88da08396ccca05e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875338:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000047f1a66/0x88da08396ccca05e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875348:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000047f1a66/0x88da08396ccca05e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875355:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047f1a66/0x88da08396ccca05e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875369:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.875371:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.875373:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.875415:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.875420:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067783460/0x88da08396ccca065 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875427:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x371:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.875430:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x371:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.875433:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067783460/0x88da08396ccca065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875441:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067783460/0x88da08396ccca065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875456:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067783460/0x88da08396ccca065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875464:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067783460/0x88da08396ccca065 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875485:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838306.875531:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.875536:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006efe6612/0x88da08396ccca06c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875545:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x370:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.875548:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x370:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.875552:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006efe6612/0x88da08396ccca06c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875560:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006efe6612/0x88da08396ccca06c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875569:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006efe6612/0x88da08396ccca06c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875576:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006efe6612/0x88da08396ccca06c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875598:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838306.875636:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.875641:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d71b80e9/0x88da08396ccca073 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875648:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36f:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.875651:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.875655:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d71b80e9/0x88da08396ccca073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875663:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d71b80e9/0x88da08396ccca073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875671:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d71b80e9/0x88da08396ccca073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875678:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d71b80e9/0x88da08396ccca073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875691:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788838306.875730:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.875735:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a58b4c84/0x88da08396ccca07a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875742:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36e:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.875752:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.875755:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a58b4c84/0x88da08396ccca07a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875763:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a58b4c84/0x88da08396ccca07a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875770:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a58b4c84/0x88da08396ccca07a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.875776:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a58b4c84/0x88da08396ccca07a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.877402:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccca050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.877423:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccca050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.878956:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccca050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.879043:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838306.879053:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067783460/0x88da08396ccca065 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.879062:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712de00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.879067:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067783460/0x88da08396ccca065 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.879078:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067783460/0x88da08396ccca065 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880283:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788838306.880307:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788838306.880315:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006efe6612/0x88da08396ccca06c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880329:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.880342:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006efe6612/0x88da08396ccca06c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880354:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006efe6612/0x88da08396ccca06c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880372:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006efe6612/0x88da08396ccca06c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880394:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006efe6612/0x88da08396ccca06c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880431:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067783460/0x88da08396ccca065 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880439:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838306.880441:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067783460/0x88da08396ccca065 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880443:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d71b80e9/0x88da08396ccca073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880450:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.880453:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d71b80e9/0x88da08396ccca073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880458:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838306.880461:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a58b4c84/0x88da08396ccca07a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880462:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d71b80e9/0x88da08396ccca073 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880469:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.880473:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a58b4c84/0x88da08396ccca07a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880475:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d71b80e9/0x88da08396ccca073 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880481:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a58b4c84/0x88da08396ccca07a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880482:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d71b80e9/0x88da08396ccca073 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880495:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838306.880498:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a58b4c84/0x88da08396ccca07a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880499:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccca050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880507:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.880507:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a58b4c84/0x88da08396ccca07a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880514:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccca050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880520:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.880521:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.880522:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccca050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880523:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.880530:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.880536:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.880542:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccca050 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880549:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.880551:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.880552:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.880704:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.880711:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396ccca081 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880722:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36d:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.880727:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.880733:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396ccca081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880745:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396ccca081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880753:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396ccca081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880761:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396ccca081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880788:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838306.880830:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838306.880836:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396ccca081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880843:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.880846:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396ccca081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880854:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396ccca081 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838306.880859:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.880863:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a80377/0x88da08396ccca088 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880865:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396ccca081 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880872:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36c:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:2.0:1788838306.880872:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396ccca081 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880874:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.880879:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075a80377/0x88da08396ccca088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880887:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075a80377/0x88da08396ccca088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880892:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.880893:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.880895:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075a80377/0x88da08396ccca088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.880895:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.880902:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075a80377/0x88da08396ccca088 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880920:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838306.880967:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.880973:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8d34fda/0x88da08396ccca08f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.880980:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36b:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.880987:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.880991:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d34fda/0x88da08396ccca08f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881001:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8d34fda/0x88da08396ccca08f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881008:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8d34fda/0x88da08396ccca08f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881015:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d34fda/0x88da08396ccca08f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881026:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788838306.881060:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.881065:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee7370d2/0x88da08396ccca096 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881071:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36a:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.881074:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.881077:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee7370d2/0x88da08396ccca096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881196:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838306.881202:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075a80377/0x88da08396ccca088 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881209:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712da00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.881212:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a80377/0x88da08396ccca088 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881219:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075a80377/0x88da08396ccca088 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881229:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075a80377/0x88da08396ccca088 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881402:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee7370d2/0x88da08396ccca096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881409:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075a80377/0x88da08396ccca088 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881412:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee7370d2/0x88da08396ccca096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881425:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838306.881429:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8d34fda/0x88da08396ccca08f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881436:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee7370d2/0x88da08396ccca096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881436:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.881449:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838306.881455:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8d34fda/0x88da08396ccca08f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881456:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.881460:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee7370d2/0x88da08396ccca096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881464:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8d34fda/0x88da08396ccca08f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881466:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712cc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.881470:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee7370d2/0x88da08396ccca096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881476:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8d34fda/0x88da08396ccca08f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881477:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee7370d2/0x88da08396ccca096 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881484:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8d34fda/0x88da08396ccca08f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881488:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee7370d2/0x88da08396ccca096 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881495:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee7370d2/0x88da08396ccca096 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881496:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.881497:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.881499:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.881504:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.881507:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.881508:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.881510:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.881615:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x369:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.881627:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a251c99c/0x88da08396ccca09d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881635:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x369:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.881638:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.881642:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a251c99c/0x88da08396ccca09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881652:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a251c99c/0x88da08396ccca09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881660:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a251c99c/0x88da08396ccca09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881668:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a251c99c/0x88da08396ccca09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881685:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788838306.881727:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x368:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.881731:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004827993b/0x88da08396ccca0a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881739:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x368:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.881742:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x368:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.881746:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004827993b/0x88da08396ccca0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881755:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004827993b/0x88da08396ccca0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881770:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004827993b/0x88da08396ccca0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881777:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004827993b/0x88da08396ccca0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881788:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788838306.881942:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838306.881958:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a251c99c/0x88da08396ccca09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838306.881964:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x367:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838306.881965:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.881970:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e619f0b/0x88da08396ccca0ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881970:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a251c99c/0x88da08396ccca09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881979:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x367:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:2.0:1788838306.881979:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a251c99c/0x88da08396ccca09d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881981:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.881986:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e619f0b/0x88da08396ccca0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.881992:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a251c99c/0x88da08396ccca09d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.881994:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e619f0b/0x88da08396ccca0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882002:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e619f0b/0x88da08396ccca0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.882005:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a251c99c/0x88da08396ccca09d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882011:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e619f0b/0x88da08396ccca0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.882020:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838306.882023:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004827993b/0x88da08396ccca0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.882029:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712dc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.882032:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004827993b/0x88da08396ccca0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882033:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838306.882039:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004827993b/0x88da08396ccca0a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.882050:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004827993b/0x88da08396ccca0a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.882057:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004827993b/0x88da08396ccca0a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838306.882068:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x366:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788838306.882068:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838306.882072:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e619f0b/0x88da08396ccca0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882073:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396ccca0b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.882079:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.882081:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x366:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:2.0:1788838306.882087:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e619f0b/0x88da08396ccca0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.882095:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e619f0b/0x88da08396ccca0ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.882106:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e619f0b/0x88da08396ccca0ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882174:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x366:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.882180:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396ccca0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882190:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396ccca0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882198:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396ccca0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882205:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396ccca0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882217:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838306.882224:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.882227:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396ccca0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882234:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712ce00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.882243:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396ccca0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882316:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396ccca0b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882328:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396ccca0b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882335:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396ccca0b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882349:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.882351:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.882353:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.882395:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x365:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.882400:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b89c550/0x88da08396ccca0b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882408:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x365:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.882410:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x365:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.882414:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b89c550/0x88da08396ccca0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882615:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b89c550/0x88da08396ccca0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882637:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b89c550/0x88da08396ccca0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882644:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b89c550/0x88da08396ccca0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882657:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838306.882665:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.882669:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b89c550/0x88da08396ccca0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882676:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.882679:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b89c550/0x88da08396ccca0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882687:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b89c550/0x88da08396ccca0b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882698:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b89c550/0x88da08396ccca0b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882704:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b89c550/0x88da08396ccca0b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882718:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.882726:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.882728:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.882773:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x364:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.882778:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccca0c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882785:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x364:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.882788:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.882792:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccca0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882819:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccca0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882837:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccca0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882844:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccca0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882857:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838306.882862:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.882866:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccca0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882872:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712ca00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.882875:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccca0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882895:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccca0c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882906:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccca0c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882913:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026bbd6ec/0x88da08396ccca0c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882926:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.882929:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.882931:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.882983:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x363:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.882988:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccca0c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.882995:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x363:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.882998:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x363:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.883002:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccca0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883009:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccca0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883016:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccca0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883028:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccca0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883043:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838306.883050:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.883053:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccca0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883058:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.883061:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccca0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883068:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccca0c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883079:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccca0c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.883438:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e619f0b/0x88da08396ccca0ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.883455:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.883457:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.883459:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.883466:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.883472:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.883663:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027233875/0x88da08396ccca0c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883680:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.883682:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.883684:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838306.883753:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788838306.883763:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137fbd0c/0x88da08396ccca0ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883772:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x362:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:3.0:1788838306.883776:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838306.883780:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000137fbd0c/0x88da08396ccca0ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883789:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000137fbd0c/0x88da08396ccca0ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883814:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137fbd0c/0x88da08396ccca0ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883876:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000137fbd0c/0x88da08396ccca0ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.883892:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788838306.885209:0:26209:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:802 00010000:00010000:1.0:1788838306.885576:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838306.885585:0:26217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002464858/0x88da08396ccca050 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838306.885714:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.885720:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccca0d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885733:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37f:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.885737:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.885742:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccca0d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885755:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccca0d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885765:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccca0d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885771:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccca0d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885784:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788838306.885849:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.885854:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccca0dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885862:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37e:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.885864:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.885874:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccca0dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885883:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccca0dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885890:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccca0dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885897:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccca0dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885914:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788838306.885927:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788838306.885933:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000137fbd0c/0x88da08396ccca0ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885940:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3efc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.885956:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000137fbd0c/0x88da08396ccca0ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885965:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000137fbd0c/0x88da08396ccca0ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885981:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000137fbd0c/0x88da08396ccca0ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.885999:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000137fbd0c/0x88da08396ccca0ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.886011:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838306.886017:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccca0d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886017:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838306.886021:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccca0dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.886025:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.886028:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.886029:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccca0d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886032:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccca0dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.886038:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccca0d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886040:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccca0dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886050:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccca0dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886057:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d958eac9/0x88da08396ccca0dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.886060:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccca0d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.886067:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da54206c/0x88da08396ccca0d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886067:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.886069:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.886071:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.886081:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.886082:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.886084:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.886090:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.886096:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838306.886128:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.886133:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccca0e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886146:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37d:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.886149:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.886153:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccca0e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886163:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccca0e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886171:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccca0e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886177:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccca0e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886199:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838306.886245:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.886603:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccca0ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886614:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37c:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.886617:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.886621:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccca0ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886630:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccca0ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886648:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccca0ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886656:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccca0ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886668:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788838306.886710:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.886715:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccca0f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886722:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37b:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.886725:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.886728:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccca0f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886737:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccca0f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886744:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccca0f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886751:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccca0f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886773:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788838306.886932:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.886938:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000285dd0ef/0x88da08396ccca0f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886957:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37a:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.886960:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.886964:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000285dd0ef/0x88da08396ccca0f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886972:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000285dd0ef/0x88da08396ccca0f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886980:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000285dd0ef/0x88da08396ccca0f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886986:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000285dd0ef/0x88da08396ccca0f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.886997:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788838306.887032:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.887037:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000140609c5/0x88da08396ccca0ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887043:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x379:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.887051:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x379:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.887055:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000140609c5/0x88da08396ccca0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887063:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000140609c5/0x88da08396ccca0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887070:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000140609c5/0x88da08396ccca0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887077:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000140609c5/0x88da08396ccca0ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887138:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788838306.887177:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.887182:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d047965b/0x88da08396ccca106 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887189:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x378:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.887192:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x378:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.887196:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d047965b/0x88da08396ccca106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887203:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d047965b/0x88da08396ccca106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887210:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d047965b/0x88da08396ccca106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887224:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d047965b/0x88da08396ccca106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887233:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1788838306.887406:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:94406:x1875729135175680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 72230us (72417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838306.887418:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5986 00000100:00100000:3.0:1788838306.887487:0:94406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94406:1875729135175680:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788838306.887503:0:94406:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x381:0x0] from OST, last_created [0x280000401:0x381:0x0]last_used is [0x280000401:0x322:0x0] 00002000:00010000:1.0:1788838306.887679:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.887685:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bbc9797/0x88da08396ccca10d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887695:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x377:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.887698:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.887702:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bbc9797/0x88da08396ccca10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887711:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bbc9797/0x88da08396ccca10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887719:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bbc9797/0x88da08396ccca10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887726:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bbc9797/0x88da08396ccca10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887736:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788838306.887771:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.887776:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003748ed3/0x88da08396ccca114 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.887789:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x376:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.887792:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x376:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.887815:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003748ed3/0x88da08396ccca114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838306.888003:0:94406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94406:1875729135176064:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788838306.888047:0:94406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838306.888080:0:94406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838306.888111:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135175936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838306.888138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838306.888184:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135176064 00000100:00100000:3.0:1788838306.888191:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135176064 00000100:00100000:3.0:1788838306.888229:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5988 00000100:00100000:3.0:1788838306.888237:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:94406:x1875729135176064:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1788838306.888238:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788838306.888246:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccca0e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888254:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.888259:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccca0e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888268:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccca0e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888285:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccca0e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888293:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f639250/0x88da08396ccca0e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888318:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788838306.888321:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccca0ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888327:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.888330:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccca0ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888337:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccca0ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888347:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccca0ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888354:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000354b30be/0x88da08396ccca0ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888365:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838306.888369:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccca0f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.888371:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003748ed3/0x88da08396ccca114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888376:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.888379:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccca0f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.888381:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003748ed3/0x88da08396ccca114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.888389:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003748ed3/0x88da08396ccca114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888398:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccca0f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838306.888408:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135175936 00010000:00010000:2.0:1788838306.888409:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccca0f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838306.888411:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135175936 00010000:00010000:2.0:1788838306.888416:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f8091a7/0x88da08396ccca0f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888427:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838306.888431:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000285dd0ef/0x88da08396ccca0f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888437:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c6e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.888440:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000285dd0ef/0x88da08396ccca0f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888447:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000285dd0ef/0x88da08396ccca0f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888456:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000285dd0ef/0x88da08396ccca0f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888463:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000285dd0ef/0x88da08396ccca0f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888487:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838306.888490:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000140609c5/0x88da08396ccca0ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888496:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c6c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.888499:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000140609c5/0x88da08396ccca0ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888506:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000140609c5/0x88da08396ccca0ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788838306.888511:0:26213:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 898 00010000:00010000:2.0:1788838306.888515:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000140609c5/0x88da08396ccca0ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888521:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000140609c5/0x88da08396ccca0ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888531:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838306.888535:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d047965b/0x88da08396ccca106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888541:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c7a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.888543:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d047965b/0x88da08396ccca106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888561:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d047965b/0x88da08396ccca106 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888572:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d047965b/0x88da08396ccca106 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888579:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d047965b/0x88da08396ccca106 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888591:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838306.888594:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bbc9797/0x88da08396ccca10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888601:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c7200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.888603:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bbc9797/0x88da08396ccca10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888611:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bbc9797/0x88da08396ccca10d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888620:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bbc9797/0x88da08396ccca10d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888627:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bbc9797/0x88da08396ccca10d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.888649:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.888651:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.888653:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.888661:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.888667:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.888968:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838306.889709:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:1.0:1788838306.889725:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135175936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838306.889748:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 896 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838306.889905:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135175936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838306.889913:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:1.0:1788838306.889985:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135175936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788838306.890022:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838306.890787:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838306.890811:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003748ed3/0x88da08396ccca114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.890825:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c6600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.890831:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003748ed3/0x88da08396ccca114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.890843:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003748ed3/0x88da08396ccca114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.890862:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003748ed3/0x88da08396ccca114 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.890870:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003748ed3/0x88da08396ccca114 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.890891:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.890893:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.890894:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838306.890997:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.891010:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098766696/0x88da08396ccca11b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891021:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x375:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.891024:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x375:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.891031:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098766696/0x88da08396ccca11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891042:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098766696/0x88da08396ccca11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891051:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098766696/0x88da08396ccca11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891060:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098766696/0x88da08396ccca11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891080:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838306.891085:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838306.891090:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098766696/0x88da08396ccca11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.891098:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c7600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838306.891101:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098766696/0x88da08396ccca11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.891118:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098766696/0x88da08396ccca11b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.891130:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098766696/0x88da08396ccca11b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.891137:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098766696/0x88da08396ccca11b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838306.891152:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.891154:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838306.891155:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838306.891879:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.891888:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccca122 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891900:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x374:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.891903:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x374:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.891908:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccca122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891918:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccca122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891934:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccca122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891941:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccca122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891969:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838306.891978:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838306.891982:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccca122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.891989:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c7400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.891993:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccca122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892001:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccca122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892012:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccca122 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892018:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a37da02/0x88da08396ccca122 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892034:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.892041:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.892043:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838306.892102:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.892108:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccca129 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892116:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x373:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.892119:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x373:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.892123:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccca129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892132:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccca129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892139:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccca129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892145:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccca129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892157:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838306.892164:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838306.892168:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccca129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892174:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c6a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.892177:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccca129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892195:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccca129 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892205:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccca129 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892213:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004733fc58/0x88da08396ccca129 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892226:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.892228:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.892229:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838306.892283:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.892288:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccca130 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892295:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x372:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.892298:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x372:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.892302:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccca130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892310:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccca130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892317:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccca130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892330:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccca130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892343:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788838306.892351:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838306.892355:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccca130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892361:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c6400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.892364:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccca130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892372:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccca130 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892381:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccca130 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892388:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f3cdeb/0x88da08396ccca130 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.892401:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.892402:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.892404:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838306.894065:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1788838306.895079:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:94406:x1875729135176064:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6837us (7026us total) trans 4294969456 rc 0/0 00000100:00100000:3.0:1788838306.895103:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5988 00010000:00010000:1.0:1788838306.895214:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087eba244/0x88da08396ccca137 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895232:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x371:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.895236:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x371:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.895242:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087eba244/0x88da08396ccca137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895325:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087eba244/0x88da08396ccca137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895337:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087eba244/0x88da08396ccca137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895345:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087eba244/0x88da08396ccca137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895370:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788838306.895510:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.895517:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b9db32/0x88da08396ccca13e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895525:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x370:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.895588:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x370:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.895594:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b9db32/0x88da08396ccca13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895604:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4b9db32/0x88da08396ccca13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895623:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b9db32/0x88da08396ccca13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895630:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b9db32/0x88da08396ccca13e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895649:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788838306.895659:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838306.895666:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087eba244/0x88da08396ccca137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895674:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6c000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.895678:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087eba244/0x88da08396ccca137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895687:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087eba244/0x88da08396ccca137 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895705:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087eba244/0x88da08396ccca137 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895712:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087eba244/0x88da08396ccca137 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895734:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838306.895746:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4b9db32/0x88da08396ccca13e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895752:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.895755:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b9db32/0x88da08396ccca13e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895762:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b9db32/0x88da08396ccca13e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895771:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4b9db32/0x88da08396ccca13e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895777:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4b9db32/0x88da08396ccca13e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.895789:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.895790:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.895792:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838306.896010:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.896017:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa2f61dc/0x88da08396ccca145 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.896025:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36f:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.896028:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.896032:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa2f61dc/0x88da08396ccca145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.896051:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa2f61dc/0x88da08396ccca145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.896059:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa2f61dc/0x88da08396ccca145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.896065:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa2f61dc/0x88da08396ccca145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.896079:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838306.896406:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.896413:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa2f61dc/0x88da08396ccca145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.896421:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.896492:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa2f61dc/0x88da08396ccca145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.896500:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa2f61dc/0x88da08396ccca145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.896513:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa2f61dc/0x88da08396ccca145 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.896521:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa2f61dc/0x88da08396ccca145 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.896604:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838306.896656:0:94406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94406:1875729135176064:0@lo:5:osp-pre-0-0.0 00002000:00010000:1.0:1788838306.896679:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.896685:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000276fb128/0x88da08396ccca14c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838306.896687:0:94406:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x381:0x0]-[0x280000401:0x3a1:0x0] 00010000:00010000:1.0:1788838306.896694:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36e:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.896697:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.896701:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000276fb128/0x88da08396ccca14c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.896710:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000276fb128/0x88da08396ccca14c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.896718:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000276fb128/0x88da08396ccca14c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.896738:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000276fb128/0x88da08396ccca14c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.896762:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788838306.897029:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.897033:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000276fb128/0x88da08396ccca14c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.897039:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6dc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.897043:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000276fb128/0x88da08396ccca14c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.897050:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000276fb128/0x88da08396ccca14c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.897061:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000276fb128/0x88da08396ccca14c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.897068:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000276fb128/0x88da08396ccca14c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.897079:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.897081:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.897082:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838306.897226:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788838306.897760:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788838306.897769:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002750ddbb/0x88da08396ccca153 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.897780:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36d:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:1.0:1788838306.897783:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838306.897787:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002750ddbb/0x88da08396ccca153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.897910:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002750ddbb/0x88da08396ccca153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898029:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002750ddbb/0x88da08396ccca153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898037:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002750ddbb/0x88da08396ccca153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.898364:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838306.898460:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.898466:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a43bf0/0x88da08396ccca15a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.898475:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36c:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.898478:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.898482:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a43bf0/0x88da08396ccca15a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.898491:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a43bf0/0x88da08396ccca15a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.898514:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a43bf0/0x88da08396ccca15a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.898521:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007a43bf0/0x88da08396ccca15a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898724:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838306.898731:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002750ddbb/0x88da08396ccca153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898750:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6cc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.898755:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002750ddbb/0x88da08396ccca153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898764:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002750ddbb/0x88da08396ccca153 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898779:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002750ddbb/0x88da08396ccca153 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898786:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002750ddbb/0x88da08396ccca153 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898925:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838306.898929:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007a43bf0/0x88da08396ccca15a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898937:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.898940:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a43bf0/0x88da08396ccca15a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898959:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a43bf0/0x88da08396ccca15a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898971:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007a43bf0/0x88da08396ccca15a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.898986:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.898988:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.898990:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838306.899080:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788838306.899183:0:26217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a43bf0/0x88da08396ccca15a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.902045:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838306.902242:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.902418:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002adec276/0x88da08396ccca161 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.902506:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36b:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.902511:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.902518:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002adec276/0x88da08396ccca161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.902532:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002adec276/0x88da08396ccca161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.902543:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002adec276/0x88da08396ccca161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.902568:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002adec276/0x88da08396ccca161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.902631:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838306.902698:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.902703:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001028aa39/0x88da08396ccca168 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.902710:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36a:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.902714:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.902718:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001028aa39/0x88da08396ccca168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.902726:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001028aa39/0x88da08396ccca168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.902733:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001028aa39/0x88da08396ccca168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.902740:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001028aa39/0x88da08396ccca168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.902770:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788838306.902777:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002adec276/0x88da08396ccca161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.902784:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.902820:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002adec276/0x88da08396ccca161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.902840:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002adec276/0x88da08396ccca161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.902856:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002adec276/0x88da08396ccca161 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.902864:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002adec276/0x88da08396ccca161 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.902883:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788838306.902887:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001028aa39/0x88da08396ccca168 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.902893:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.902896:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001028aa39/0x88da08396ccca168 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.902902:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001028aa39/0x88da08396ccca168 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.902911:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001028aa39/0x88da08396ccca168 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.902918:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.902928:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.902930:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838306.903419:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788838306.903550:0:26217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001028aa39/0x88da08396ccca168 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838306.903637:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x369:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.903642:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820f80f4/0x88da08396ccca16f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.903651:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x369:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.903655:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.903659:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000820f80f4/0x88da08396ccca16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.903670:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000820f80f4/0x88da08396ccca16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.903678:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000820f80f4/0x88da08396ccca16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.903685:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000820f80f4/0x88da08396ccca16f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.903779:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838306.903786:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000820f80f4/0x88da08396ccca16f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.903793:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030200 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.903909:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000820f80f4/0x88da08396ccca16f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.903918:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000820f80f4/0x88da08396ccca16f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.903935:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000820f80f4/0x88da08396ccca16f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.904322:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.904324:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.904326:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838306.904971:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788838306.904979:0:26217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000820f80f4/0x88da08396ccca16f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.905581:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788838306.907369:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x368:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.907389:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbdc834d/0x88da08396ccca176 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907443:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x368:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.907449:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x368:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.907456:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbdc834d/0x88da08396ccca176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907472:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbdc834d/0x88da08396ccca176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907483:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbdc834d/0x88da08396ccca176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907490:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbdc834d/0x88da08396ccca176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907515:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788838306.907647:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x367:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.907654:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0540df5/0x88da08396ccca17d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907663:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x367:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.907666:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.907670:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0540df5/0x88da08396ccca17d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907679:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0540df5/0x88da08396ccca17d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907697:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0540df5/0x88da08396ccca17d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907705:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0540df5/0x88da08396ccca17d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907727:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788838306.907764:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x366:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.907768:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000459ee172/0x88da08396ccca184 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907776:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x366:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.907779:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x366:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.907782:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000459ee172/0x88da08396ccca184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907791:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000459ee172/0x88da08396ccca184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907814:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000459ee172/0x88da08396ccca184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907821:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000459ee172/0x88da08396ccca184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907845:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788838306.907882:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x365:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.907887:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccca18b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907895:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x365:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.907898:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x365:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.907901:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccca18b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907910:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccca18b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907917:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccca18b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907924:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccca18b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907934:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788838306.907981:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x364:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.907985:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccca192 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.907993:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x364:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.908002:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.908006:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccca192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908016:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccca192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908024:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccca192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908030:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccca192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908038:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788838306.908075:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x363:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.908080:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccca199 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908088:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x363:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.908091:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x363:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.908094:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccca199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908103:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccca199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908111:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccca199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908124:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccca199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908132:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788838306.908169:0:26217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788838306.908174:0:26217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccca1a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908182:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x362:0x0].0x0 since=3700s v=(0 0) 00010000:00010000:0.0:1788838306.908185:0:26217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838306.908189:0:26217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccca1a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908198:0:26217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccca1a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908206:0:26217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccca1a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908212:0:26217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccca1a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838306.908220:0:26217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00080000:0.0:1788838306.908651:0:26217:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:0.0:1788838306.908754:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:94408:x1875729135175808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 78077us (93683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838306.908772:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5987 00010000:00010000:1.0:1788838306.910164:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788838306.910176:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbdc834d/0x88da08396ccca176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.910208:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030400 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.910213:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbdc834d/0x88da08396ccca176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.910224:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbdc834d/0x88da08396ccca176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.910260:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbdc834d/0x88da08396ccca176 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.910268:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbdc834d/0x88da08396ccca176 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.910298:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788838306.910302:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0540df5/0x88da08396ccca17d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.910309:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.910312:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0540df5/0x88da08396ccca17d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.910319:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0540df5/0x88da08396ccca17d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.910328:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0540df5/0x88da08396ccca17d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911627:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788838306.911640:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000459ee172/0x88da08396ccca184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911652:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.911656:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000459ee172/0x88da08396ccca184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911667:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000459ee172/0x88da08396ccca184 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911685:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000459ee172/0x88da08396ccca184 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911692:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000459ee172/0x88da08396ccca184 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911716:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788838306.911720:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccca18b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911726:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529a00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.911729:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccca18b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911752:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccca18b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911762:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccca18b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911768:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c892a93/0x88da08396ccca18b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911780:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788838306.911783:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccca192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911788:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529000 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:3.0:1788838306.911791:0:15289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccca192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911812:0:15289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccca192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.911821:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccca192 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.911914:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0540df5/0x88da08396ccca17d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.911928:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838306.911932:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccca199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.911937:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529800 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.911940:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccca199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.911959:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccca199 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.911969:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccca199 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.911976:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab040f31/0x88da08396ccca199 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.911988:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838306.911992:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccca1a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.911999:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838306.912008:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccca1a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.912016:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccca1a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.912026:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccca1a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.912032:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c648b9/0x88da08396ccca1a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838306.912045:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.912046:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.912048:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.912057:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838306.912062:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838306.912132:0:94408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94408:1875729135175808:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788838306.912148:0:94408:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x381:0x0] from OST, last_created [0x2c0000401:0x381:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:1.0:1788838306.912218:0:94408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94408:1875729135176320:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1788838306.914786:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b48a63c/0x88da08396ccca192 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838306.914918:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.914920:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838306.914922:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838306.915404:0:94408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838306.915460:0:94408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff608ea6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838306.915487:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135176192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838306.915527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838306.915572:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135176192 00000100:00100000:1.0:1788838306.915580:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135176192 00000100:00100000:1.0:1788838306.915636:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1788838306.915644:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135176192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838306.915675:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838306.915716:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135176192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838306.915722:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1788838306.915765:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135176192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838306.916102:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135176320 00000100:00100000:0.0:1788838306.916107:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135176320 00000100:00100000:0.0:1788838306.916143:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5989 00000100:00100000:0.0:1788838306.916150:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:94408:x1875729135176320:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788838306.916177:0:26215:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 898 00000100:00100000:0.0:1788838306.926686:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:94408:x1875729135176320:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10529us (11278us total) trans 4294969458 rc 0/0 00000100:00100000:0.0:1788838306.926700:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5989 00000100:00100000:2.0:1788838306.926992:0:94408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94408:1875729135176320:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788838306.927009:0:94408:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x381:0x0]-[0x2c0000401:0x3a1:0x0] 00010000:00010000:2.0:1788838307.908003:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838308.221965:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838308.221990:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135176448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838308.222056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838308.222121:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135176448 00000100:00100000:1.0:1788838308.222129:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135176448 00000100:00100000:1.0:1788838308.222180:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:1.0:1788838308.222189:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135176448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838308.222217:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838308.222259:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135176448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838308.222265:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00080000:1.0:1788838308.222285:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838308.222320:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135176448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838308.222819:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838308.229105:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135176576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838308.229174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838308.229450:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135176576 00000100:00100000:2.0:1788838308.229459:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135176576 00000100:00100000:2.0:1788838308.229518:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:2.0:1788838308.229527:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135176576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838308.229562:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838308.229605:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135176576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838308.229611:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00080000:0.0:1788838308.230368:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838308.230409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135176576:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788838308.499355:0:94675:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788838308.927711:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788838309.844629:0:94728:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788838309.844908:0:94728:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788838309.950062:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838310.975181:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788838311.010553:0:94778:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788838311.010830:0:94778:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788838311.805320:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838311.805354:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135176704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838311.805463:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838311.805748:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135176704 00000100:00100000:3.0:1788838311.805760:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135176704 00000100:00100000:3.0:1788838311.805854:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4256 00000100:00100000:3.0:1788838311.805866:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135176704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838311.805910:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:3.0:1788838311.805981:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135176704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838311.805988:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4256 00000100:00100000:3.0:1788838311.806046:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135176704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838311.811979:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135177088:0@lo:400:kworker.0 00000100:00100000:1.0:1788838311.812077:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838311.812141:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135177600:0@lo:400:kworker.0 00000100:00100000:1.0:1788838311.812174:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838311.812192:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135178112:0@lo:400:kworker.0 00000100:00100000:1.0:1788838311.812214:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838311.812242:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788838311.812248:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135177216:0@lo:400:kworker.0 00000100:00100000:1.0:1788838311.812272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838311.812289:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135177728:0@lo:400:kworker.0 00000100:00100000:1.0:1788838311.812310:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838311.812326:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135178240:0@lo:400:kworker.0 00000100:00100000:1.0:1788838311.812347:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838311.812403:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135177600 00000100:00100000:1.0:1788838311.812411:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135177600 00000100:00100000:1.0:1788838311.812475:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135178112 00000100:00100000:1.0:1788838311.812478:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135178112 00000100:00100000:1.0:1788838311.812504:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00100000:1.0:1788838311.812514:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135177600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838311.812577:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135177600:12345-0@lo:400:kworker.0 Request processed in 65us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838311.812585:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00100000:1.0:1788838311.812602:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00100000:1.0:1788838311.812609:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135178112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838311.812635:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135178112:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838311.812641:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000100:00100000:1.0:1788838311.812691:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135177600:0@lo:400:kworker.0 00000100:00100000:1.0:1788838311.812713:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135178112:0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.813509:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135177088 00000100:00100000:2.0:1788838311.813516:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135177088 00000100:00100000:2.0:1788838311.813563:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135177216 00000100:00100000:2.0:1788838311.813567:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135177216 00000100:00100000:2.0:1788838311.813589:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135177728 00000100:00100000:2.0:1788838311.813592:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135177728 00000100:00100000:2.0:1788838311.813611:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135178240 00000100:00100000:2.0:1788838311.813614:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135178240 00000100:00100000:2.0:1788838311.813628:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1788838311.813637:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135177088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.813702:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135177088:12345-0@lo:400:kworker.0 Request processed in 66us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838311.813710:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1788838311.813723:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:2.0:1788838311.813729:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135177216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.813757:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135177216:12345-0@lo:400:kworker.0 Request processed in 29us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838311.813763:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:2.0:1788838311.813773:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:2.0:1788838311.813779:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135177728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.813826:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135177728:12345-0@lo:400:kworker.0 Request processed in 48us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838311.813842:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:2.0:1788838311.813854:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1788838311.813860:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135178240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.813889:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135178240:12345-0@lo:400:kworker.0 Request processed in 31us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838311.813894:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1788838311.814092:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135177216:0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.814105:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135177728:0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.814124:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135178240:0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.814138:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135177088:0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.814271:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135176832:0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.814322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838311.814365:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135177344:0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.814409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838311.814429:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135177856:0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.814454:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838311.814476:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135178368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838311.814497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838311.814518:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788838311.814536:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135176960:0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.814562:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838311.814581:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135177472:0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.814607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838311.814624:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135177984:0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.814646:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838311.814686:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135177344 00000100:00100000:0.0:1788838311.814691:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135177344 00000100:00100000:0.0:1788838311.814728:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135176960 00000100:00100000:0.0:1788838311.814731:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135176960 00000100:00100000:0.0:1788838311.814749:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1788838311.814758:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135177344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.814830:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135177344:12345-0@lo:400:kworker.0 Request processed in 73us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838311.814837:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1788838311.814857:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1788838311.814863:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135176960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.814891:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135176960:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838311.814896:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00080000:0.0:1788838311.815035:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838311.815039:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838311.815042:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838311.815058:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135177472 00000100:00100000:0.0:1788838311.815062:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135177472 00000100:00100000:0.0:1788838311.815095:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135177984 00000100:00100000:0.0:1788838311.815098:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135177984 00000100:00100000:0.0:1788838311.815116:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1788838311.815130:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135177472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.815162:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135177472:12345-0@lo:400:kworker.0 Request processed in 33us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838311.815168:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1788838311.815180:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1788838311.815185:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135177984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.815209:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135177984:12345-0@lo:400:kworker.0 Request processed in 23us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838311.815214:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1788838311.815242:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135177856 00000100:00100000:0.0:1788838311.815245:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135177856 00000100:00100000:0.0:1788838311.815267:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135178368 00000100:00100000:0.0:1788838311.815269:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135178368 00000100:00100000:0.0:1788838311.815283:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4257 00000100:00100000:0.0:1788838311.815289:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135177856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.815322:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135177856:12345-0@lo:400:kworker.0 Request processed in 33us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838311.815328:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4257 00000100:00100000:0.0:1788838311.815339:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4258 00000100:00100000:0.0:1788838311.815344:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135178368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788838311.815376:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:2.0:1788838311.815483:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135176832 00000100:00100000:2.0:1788838311.815488:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135176832 00000100:00100000:2.0:1788838311.815524:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788838311.815531:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135176832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.815568:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135176832:12345-0@lo:400:kworker.0 Request processed in 39us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838311.815574:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788838311.815657:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838311.815688:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135176960:0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.815700:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135177472:0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.815716:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135177984:0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.815725:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135176832:0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.815746:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135177344:0@lo:400:kworker.0 00000100:00100000:2.0:1788838311.815761:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135177856:0@lo:400:kworker.0 00000100:00100000:0.0:1788838311.816351:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135178368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1004us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838311.816361:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4258 00000100:00100000:2.0:1788838311.817299:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135178368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838311.997462:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838311.997513:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838311.997577:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838311.997864:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116474112 00000100:00100000:2.0:1788838311.997878:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116474112 00000100:00100000:2.0:1788838311.997968:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116474240 00000100:00100000:2.0:1788838311.997972:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116474240 00000100:00100000:2.0:1788838311.998003:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1410 00000100:00100000:2.0:1788838311.998016:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2406:x1875729116474112:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838311.998117:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2406:x1875729116474112:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 104us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838311.998124:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1410 00000100:00100000:2.0:1788838311.998145:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1411 00000100:00100000:2.0:1788838311.998151:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2406:x1875729116474240:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838311.998182:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2406:x1875729116474240:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838311.998188:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1411 00000100:00100000:1.0:1788838311.998374:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116473984 00000100:00100000:1.0:1788838311.998379:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116473984 00000100:00100000:1.0:1788838311.998433:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:1.0:1788838311.998441:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2406:x1875729116473984:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838311.998471:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2406:x1875729116473984:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838311.998478:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00080000:3.0:1788838311.998670:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838311.998676:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788838312.000500:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838312.317671:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838312.317777:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135178624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838312.317925:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838312.318003:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135178624 00000100:00100000:2.0:1788838312.318013:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135178624 00000100:00100000:2.0:1788838312.318079:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:2.0:1788838312.318090:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135178624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838312.318140:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838312.318207:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135178624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838312.318215:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:2.0:1788838312.318274:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135178624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838312.321072:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135178496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838312.321176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838312.321359:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135178496 00000100:00100000:1.0:1788838312.321368:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135178496 00000100:00100000:1.0:1788838312.321437:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:1.0:1788838312.321448:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135178496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788838312.321654:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838312.321850:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875729135178496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 402us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838312.321858:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:3.0:1788838312.322405:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135178496:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788838312.834995:0:9540:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969458 is committed 00000001:00080000:1.0:1788838312.838958:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969456 is committed 00010000:00010000:1.0:1788838313.022327:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838313.329785:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838313.329948:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116474368 00000100:00100000:2.0:1788838313.329962:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116474368 00000100:00100000:2.0:1788838313.330067:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1440 00000100:00100000:2.0:1788838313.330086:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:72354:x1875729116474368:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838313.330130:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838313.330163:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e400/0x88da08396ccca1a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfa8 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838313.330268:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccca1ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838313.330294:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccca1ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838313.330308:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccca1ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838313.330375:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838313.330390:0:66254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838313.330440:0:66254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccca1ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838313.330471:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e400/0x88da08396ccca1a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa8 expref: 8 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838313.330703:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccca1ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa8 expref: 7 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838313.330714:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:2.0:1788838313.330718:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838313.330722:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148fc00, rc 0) 00000100:00100000:2.0:1788838313.330857:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+7:72354:x1875729116474368:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 779us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838313.330867:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1440 00000100:00080000:3.0:1788838313.332510:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838313.341271:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135178752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838313.341426:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838313.341514:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135178752 00000100:00100000:1.0:1788838313.341528:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135178752 00000100:00100000:1.0:1788838313.341616:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:1.0:1788838313.341628:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135178752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838313.341650:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838313.341736:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135178752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838313.341777:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00100000:2.0:1788838313.341865:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135178752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838313.342473:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135178880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838313.342537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838313.342828:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135178880 00000100:00100000:1.0:1788838313.342837:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135178880 00000100:00100000:1.0:1788838313.342895:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:1.0:1788838313.342916:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135178880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838313.342942:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838313.343001:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135178880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838313.343009:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:0.0:1788838313.343159:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135178880:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788838313.344979:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838313.344990:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838313.351842:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838313.352325:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116474496 00000100:00100000:2.0:1788838313.352338:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116474496 00000100:00100000:2.0:1788838313.352439:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1441 00000100:00100000:2.0:1788838313.352452:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:72354:x1875729116474496:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788838313.352511:0:75504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:2.0:1788838313.352624:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:72354:x1875729116474496:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 173us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838313.352632:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1441 00000100:00100000:1.0:1788838313.367119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838313.369475:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116474624 00000100:00100000:2.0:1788838313.369495:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116474624 00000100:00100000:2.0:1788838313.369607:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1442 00000100:00100000:2.0:1788838313.369625:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:72354:x1875729116474624:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788838313.369693:0:67312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:2.0:1788838313.370212:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:72354:x1875729116474624:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 593us (3127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838313.370221:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1442 00000100:00080000:3.0:1788838313.371374:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838313.373295:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838313.373579:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116474752 00000100:00100000:0.0:1788838313.373593:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116474752 00000100:00100000:0.0:1788838313.373659:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5990 00000100:00100000:0.0:1788838313.373669:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2403:x1875729116474752:12345-192.168.203.30@tcp:8:lfs.0 00010000:00080000:0.0:1788838313.373709:0:26207:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp t0 exp 0000000000000000 cur 3707 last 0 00000020:00000080:0.0:1788838313.373749:0:26207:0:(genops.c:1385:class_connect()) connect: client efc561ba-875e-4857-b79b-9bd7023bd57c, cookie 0x88da08396ccca1b5 00002000:00100000:0.0:1788838313.373765:0:26207:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli efc561ba-875e-4857-b79b-9bd7023bd57c/ffff8ff50443f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788838313.373984:0:26207:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788838313.374082:0:26207:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788838313.374244:0:26207:0:(import.c:65:import_set_state_nolock()) ffff8ff50443d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838313.375911:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116474752:12345-192.168.203.30@tcp:8:lfs.0 Request processed in 2223us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838313.375926:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5990 00000100:00100000:0.0:1788838313.388432:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838313.388617:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116474880 00000100:00100000:2.0:1788838313.388629:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116474880 00000100:00100000:2.0:1788838313.388713:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2136 00000100:00100000:2.0:1788838313.388724:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+6:72354:x1875729116474880:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838313.388763:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838313.388897:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+6:72354:x1875729116474880:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 174us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838313.388915:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2136 00000100:00080000:3.0:1788838313.390296:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838313.391750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838313.392225:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116475008 00000100:00100000:0.0:1788838313.392238:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116475008 00000100:00100000:0.0:1788838313.392294:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5991 00000100:00100000:0.0:1788838313.392303:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2403:x1875729116475008:12345-192.168.203.30@tcp:8:lfs.0 00010000:00080000:0.0:1788838313.394711:0:26216:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp t0 exp 0000000000000000 cur 3707 last 0 00000020:00000080:0.0:1788838313.394761:0:26216:0:(genops.c:1385:class_connect()) connect: client efc561ba-875e-4857-b79b-9bd7023bd57c, cookie 0x88da08396ccca1bc 00002000:00100000:0.0:1788838313.394778:0:26216:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli efc561ba-875e-4857-b79b-9bd7023bd57c/ffff8ff50443a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788838313.397078:0:26216:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788838313.397223:0:26216:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788838313.397279:0:26216:0:(import.c:65:import_set_state_nolock()) ffff8ff50443a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788838313.397396:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116475008:12345-192.168.203.30@tcp:8:lfs.0 Request processed in 5091us (5655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838313.397408:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5991 00000100:00100000:0.0:1788838313.404945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838313.407866:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116475136 00000100:00100000:2.0:1788838313.407892:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116475136 00000100:00100000:2.0:1788838313.408114:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2137 00000100:00100000:2.0:1788838313.408128:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+6:72354:x1875729116475136:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838313.408165:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838313.408282:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+6:72354:x1875729116475136:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 157us (3353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838313.408291:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2137 00000100:00080000:3.0:1788838313.417035:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788838314.045152:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838315.072010:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838316.092925:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838316.925102:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135179392:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925204:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135179904:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925229:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925254:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135180416:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925301:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788838316.925307:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135179008:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925334:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925371:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135179520:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925391:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925406:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135180032:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925425:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925440:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135180544:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925483:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135179136:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925517:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925534:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50270b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135179648:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925556:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925574:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135180160:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925596:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925613:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788838316.925619:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135179264:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925655:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135179776:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925674:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925689:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135180288:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925706:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838316.925736:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135179392 00000100:00100000:0.0:1788838316.925743:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135179392 00000100:00100000:0.0:1788838316.925787:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135179520 00000100:00100000:0.0:1788838316.925790:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135179520 00000100:00100000:0.0:1788838316.925837:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135180032 00000100:00100000:0.0:1788838316.925841:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135180032 00000100:00100000:0.0:1788838316.925850:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135180544 00000100:00100000:0.0:1788838316.925853:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135180544 00000100:00100000:0.0:1788838316.925861:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135179136 00000100:00100000:0.0:1788838316.925864:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135179136 00000100:00100000:0.0:1788838316.925875:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135179264 00000100:00100000:0.0:1788838316.925887:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135179264 00000100:00100000:0.0:1788838316.925903:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1788838316.925910:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135179392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.925957:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135179392:12345-0@lo:400:kworker.0 Request processed in 47us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.925973:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1788838316.925991:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1788838316.925997:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135179520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926024:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135179520:12345-0@lo:400:kworker.0 Request processed in 28us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926030:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1788838316.926040:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1788838316.926045:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135180032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926067:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135180032:12345-0@lo:400:kworker.0 Request processed in 21us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926072:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1788838316.926080:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1788838316.926085:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135180544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926105:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135180544:12345-0@lo:400:kworker.0 Request processed in 21us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926111:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1788838316.926126:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:0.0:1788838316.926132:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135179136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926165:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135179136:12345-0@lo:400:kworker.0 Request processed in 33us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926171:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:0.0:1788838316.926184:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1788838316.926191:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135179264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838316.926195:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135179904 00000100:00100000:3.0:1788838316.926202:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135179904 00000100:00100000:0.0:1788838316.926219:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135179264:12345-0@lo:400:kworker.0 Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926231:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1788838316.926250:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135180416 00000100:00100000:0.0:1788838316.926255:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135180416 00000100:00100000:0.0:1788838316.926280:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135179776 00000100:00100000:0.0:1788838316.926283:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135179776 00000100:00100000:0.0:1788838316.926298:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135180288 00000100:00100000:0.0:1788838316.926300:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135180288 00000100:00100000:0.0:1788838316.926314:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:0.0:1788838316.926320:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135180416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926349:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135180416:12345-0@lo:400:kworker.0 Request processed in 29us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926354:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00100000:0.0:1788838316.926364:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1788838316.926370:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135179776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926393:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135179776:12345-0@lo:400:kworker.0 Request processed in 24us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926399:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1788838316.926409:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00100000:0.0:1788838316.926414:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135180288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926436:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135180288:12345-0@lo:400:kworker.0 Request processed in 21us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926442:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00100000:0.0:1788838316.926457:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135179008 00000100:00100000:0.0:1788838316.926461:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135179008 00000100:00100000:0.0:1788838316.926485:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788838316.926492:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135179008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926530:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135179008:12345-0@lo:400:kworker.0 Request processed in 40us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926536:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788838316.926576:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135179648 00000100:00100000:0.0:1788838316.926580:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135179648 00000100:00100000:0.0:1788838316.926602:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135180160 00000100:00100000:0.0:1788838316.926605:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135180160 00000100:00100000:0.0:1788838316.926622:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4259 00000100:00100000:0.0:1788838316.926627:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135179648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926658:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135179648:12345-0@lo:400:kworker.0 Request processed in 30us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926664:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4259 00000100:00100000:0.0:1788838316.926675:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4260 00000100:00100000:0.0:1788838316.926680:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135180160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926707:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135180160:12345-0@lo:400:kworker.0 Request processed in 27us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.926712:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4260 00000100:00080000:0.0:1788838316.926737:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838316.926740:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838316.926742:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838316.926745:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838316.926784:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135179264:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926828:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135179776:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926837:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969456 gen 2 00000100:00100000:0.0:1788838316.926853:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135180288:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926863:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135179136:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926892:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50270b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135179648:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926906:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135180160:0@lo:400:kworker.0 00000100:00100000:3.0:1788838316.926972:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:3.0:1788838316.926982:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135179904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.926985:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135179008:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.927001:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135179520:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.927014:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135180032:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.927029:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135180544:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.927043:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135179392:0@lo:400:kworker.0 00000100:00100000:3.0:1788838316.927045:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135179904:12345-0@lo:400:kworker.0 Request processed in 54us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838316.927056:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135179904:0@lo:400:kworker.0 00000100:00100000:3.0:1788838316.927057:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00100000:0.0:1788838316.927073:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969458 gen 2 00000100:00100000:0.0:1788838316.927083:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135180416:0@lo:400:kworker.0 00000100:00100000:0.0:1788838316.927127:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838316.927139:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135180672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838316.927174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838316.927489:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135180672 00000100:00100000:3.0:1788838316.927494:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135180672 00000100:00100000:3.0:1788838316.927524:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4261 00000100:00100000:3.0:1788838316.927531:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135180672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838316.927555:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:3.0:1788838316.927603:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135180672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838316.927610:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4261 00000100:00100000:1.0:1788838316.927656:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135180672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838316.929475:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135180800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838316.929531:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838316.929600:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135180800 00000100:00100000:2.0:1788838316.929607:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135180800 00000100:00100000:2.0:1788838316.929650:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4262 00000100:00100000:2.0:1788838316.929658:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135180800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838316.929697:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:2.0:1788838316.930313:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135180800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 654us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838316.930321:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4262 00000100:00100000:1.0:1788838316.930443:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135180800:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788838317.117010:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838317.119266:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838317.119320:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838317.119342:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838317.119369:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116475264 00000100:00100000:2.0:1788838317.119371:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838317.119379:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116475264 00000100:00100000:3.0:1788838317.119418:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116475776 00000100:00100000:2.0:1788838317.119430:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838317.119435:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116475776 00000100:00100000:1.0:1788838317.119453:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:2.0:1788838317.119461:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116475520 00000100:00100000:2.0:1788838317.119467:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116475520 00000100:00100000:1.0:1788838317.119469:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116475264:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838317.119520:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116475648 00000100:00100000:3.0:1788838317.119527:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116475648 00000100:00100000:2.0:1788838317.119533:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116475392 00000100:00100000:2.0:1788838317.119540:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116475392 00000100:00100000:1.0:1788838317.119545:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116475264:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838317.119555:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:3.0:1788838317.119585:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2710 00000100:00100000:2.0:1788838317.119597:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1418 00000100:00100000:3.0:1788838317.119606:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2404:x1875729116475776:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838317.119618:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2404:x1875729116475520:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838317.119673:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2404:x1875729116475520:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 64us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838317.119680:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1418 00000100:00100000:3.0:1788838317.119698:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2404:x1875729116475776:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 99us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838317.119699:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1419 00000100:00100000:2.0:1788838317.119707:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116475392:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838317.119730:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2710 00000100:00100000:2.0:1788838317.119746:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116475392:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838317.119753:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1419 00000100:00100000:3.0:1788838317.119785:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2711 00000100:00080000:0.0:1788838317.119840:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838317.119848:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2404:x1875729116475648:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:0.0:1788838317.119849:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838317.119855:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838317.119859:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838317.119926:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2404:x1875729116475648:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 119us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838317.119936:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2711 00000100:00100000:1.0:1788838317.437707:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135181056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838317.437858:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838317.437913:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838317.437920:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135180928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838317.437945:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838317.438980:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135181056 00000100:00100000:3.0:1788838317.438999:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135181056 00000100:00100000:3.0:1788838317.439366:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135180928 00000100:00100000:3.0:1788838317.439372:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135180928 00000100:00100000:3.0:1788838317.439401:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:3.0:1788838317.439412:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135181056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838317.439458:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838317.439580:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135181056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838317.439587:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00100000:2.0:1788838317.440026:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1788838317.440067:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135180928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838317.440119:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838317.440194:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135180928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838317.440201:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1788838317.440303:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135180928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838317.440322:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135181056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788838318.141378:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838318.461175:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135181184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838318.461210:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135181312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838318.461267:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838318.461298:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135181184 00000100:00100000:2.0:1788838318.461307:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135181184 00000100:00100000:1.0:1788838318.461374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838318.461384:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135181312 00000100:00100000:2.0:1788838318.461389:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135181312 00000100:00100000:2.0:1788838318.461417:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1788838318.461432:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135181184:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788838318.461510:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788838318.461514:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788838318.461603:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838318.461666:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135181184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 240us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838318.462187:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135181184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838318.462687:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:1.0:1788838318.462704:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135181312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838318.462777:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838318.462928:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135181312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 231us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838318.462936:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:0.0:1788838318.463279:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135181312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838318.474883:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000001:00100000:1.0:1788838318.981545:0:9540:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00000001:00100000:1.0:1788838318.981893:0:8455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of efc561ba-875e-4857-b79b-9bd7023bd57c 00010000:00010000:2.0:1788838319.165000:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788838319.408215:0:94971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:0.0:1788838320.189207:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838321.216863:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788838321.235676:0:95019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1788838322.045069:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135181440:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.045147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838322.045159:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135181568:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.045190:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135181952:0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838322.045211:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135182080:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.045213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838322.045227:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135182464:0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838322.045246:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135182592:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.045246:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838322.045262:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135182976:0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838322.045278:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838322.045303:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135181696:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.045312:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135181824:0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045325:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838322.045341:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135182208:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.045342:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838322.045359:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135182336:0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045362:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838322.045377:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135182720:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.045378:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838322.045393:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135182848:0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045396:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838322.045410:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838322.045426:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135181568 00000100:00100000:2.0:1788838322.045433:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135181568 00000100:00100000:1.0:1788838322.045438:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135182208 00000100:00100000:1.0:1788838322.045441:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135182208 00000100:00100000:2.0:1788838322.045482:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135181952 00000100:00100000:1.0:1788838322.045482:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135182336 00000100:00100000:2.0:1788838322.045485:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135181952 00000100:00100000:1.0:1788838322.045485:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135182336 00000100:00100000:2.0:1788838322.045498:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135182464 00000100:00100000:2.0:1788838322.045501:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135182464 00000100:00100000:1.0:1788838322.045504:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135182720 00000100:00100000:1.0:1788838322.045507:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135182720 00000100:00100000:2.0:1788838322.045512:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135182976 00000100:00100000:2.0:1788838322.045514:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135182976 00000100:00100000:2.0:1788838322.045527:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135181696 00000100:00100000:1.0:1788838322.045527:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135182848 00000100:00100000:2.0:1788838322.045530:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135181696 00000100:00100000:1.0:1788838322.045530:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135182848 00000100:00100000:2.0:1788838322.045546:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135181824 00000100:00100000:3.0:1788838322.045547:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135182080 00000100:00100000:2.0:1788838322.045549:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135181824 00000100:00100000:1.0:1788838322.045552:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1788838322.045554:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135182080 00000100:00100000:1.0:1788838322.045561:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135182208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045566:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:2.0:1788838322.045574:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135181568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838322.045593:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135182592 00000100:00100000:3.0:1788838322.045598:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135182592 00000100:00100000:1.0:1788838322.045615:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135182208:12345-0@lo:400:kworker.0 Request processed in 54us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.045616:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135181568:12345-0@lo:400:kworker.0 Request processed in 42us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.045625:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1788838322.045625:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1788838322.045628:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4263 00000100:00100000:3.0:1788838322.045639:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135182080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045648:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1788838322.045655:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:2.0:1788838322.045659:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135181952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.045662:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135182336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838322.045708:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135182080:12345-0@lo:400:kworker.0 Request processed in 70us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.045710:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135181952:12345-0@lo:400:kworker.0 Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838322.045714:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135182336:12345-0@lo:400:kworker.0 Request processed in 52us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.045720:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1788838322.045721:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:1.0:1788838322.045732:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00100000:2.0:1788838322.045738:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1788838322.045738:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135182720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045743:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135182464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045764:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135182464:12345-0@lo:400:kworker.0 Request processed in 21us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838322.045764:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135182720:12345-0@lo:400:kworker.0 Request processed in 26us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.045770:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1788838322.045778:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00100000:2.0:1788838322.045780:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1788838322.045785:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135182976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.045788:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:1.0:1788838322.045794:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135182848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838322.045826:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4263 00000100:00100000:2.0:1788838322.045851:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135182976:12345-0@lo:400:kworker.0 Request processed in 57us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838322.045861:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4264 00000100:00100000:2.0:1788838322.045862:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1788838322.045876:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135182592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.045882:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1788838322.045892:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135181696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838322.045925:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135182592:12345-0@lo:400:kworker.0 Request processed in 55us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838322.045934:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4264 00000100:00100000:2.0:1788838322.045937:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135181696:12345-0@lo:400:kworker.0 Request processed in 45us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.045946:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1788838322.045962:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1788838322.045968:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135181824:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788838322.045978:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838322.045985:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838322.045988:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838322.045992:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838322.046003:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135181824:12345-0@lo:400:kworker.0 Request processed in 34us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.046010:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1788838322.046032:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135182848:12345-0@lo:400:kworker.0 Request processed in 237us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838322.046038:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00100000:2.0:1788838322.046061:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135181696:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.046061:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135181824:0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.046071:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135182208:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.046071:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135182336:0@lo:400:kworker.0 00000100:00100000:2.0:1788838322.046079:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135182720:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.046079:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135182848:0@lo:400:kworker.0 00000100:00100000:3.0:1788838322.046108:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135183104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838322.046111:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135181952:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.046126:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135182464:0@lo:400:kworker.0 00000100:00100000:1.0:1788838322.046135:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135182976:0@lo:400:kworker.0 00000100:00100000:3.0:1788838322.046165:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838322.046202:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135181568:0@lo:400:kworker.0 00000100:00100000:3.0:1788838322.046215:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135182080:0@lo:400:kworker.0 00000100:00100000:0.0:1788838322.046255:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135181440 00000100:00100000:0.0:1788838322.046260:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135181440 00000100:00100000:0.0:1788838322.046289:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788838322.046296:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135181440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838322.046325:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135182592:0@lo:400:kworker.0 00000100:00100000:0.0:1788838322.046344:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135181440:12345-0@lo:400:kworker.0 Request processed in 48us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838322.046350:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788838322.046387:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135183104 00000100:00100000:0.0:1788838322.046391:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135183104 00000100:00100000:0.0:1788838322.046411:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4265 00000100:00100000:0.0:1788838322.046416:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135183104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838322.046440:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:0.0:1788838322.046470:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135183104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838322.046476:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4265 00000100:00100000:0.0:1788838322.046506:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788838322.046513:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135183232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838322.046536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838322.046558:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135183232 00000100:00100000:0.0:1788838322.046561:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135183232 00000100:00100000:0.0:1788838322.046581:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4266 00000100:00100000:0.0:1788838322.046588:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135183232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788838322.046604:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:0.0:1788838322.046651:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135183232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838322.046657:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4266 00000100:00100000:0.0:1788838322.046687:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135183232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838322.048163:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135181440:0@lo:400:kworker.0 00000100:00100000:3.0:1788838322.048421:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135183104:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788838322.238581:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838322.244018:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838322.244124:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838322.244160:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838322.244189:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838322.244250:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116476288 00000100:00100000:0.0:1788838322.244260:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116476288 00000100:00100000:0.0:1788838322.244317:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2716 00000100:00100000:0.0:1788838322.244328:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116476288:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838322.244402:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116476288:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838322.244408:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2716 00000100:00100000:2.0:1788838322.249302:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116475904 00000100:00100000:2.0:1788838322.249346:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116475904 00000100:00100000:2.0:1788838322.249428:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:2.0:1788838322.249440:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116475904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838322.249517:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116475904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (5355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.249524:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00080000:0.0:1788838322.249981:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838322.255728:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116476032 00000100:00100000:2.0:1788838322.255808:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116476160 00000100:00100000:2.0:1788838322.255823:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116476160 00000100:00100000:3.0:1788838322.255875:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116476032 00000100:00100000:2.0:1788838322.255984:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1426 00000100:00100000:2.0:1788838322.255995:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2407:x1875729116476160:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838322.256072:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2407:x1875729116476160:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (11882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.256080:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1426 00000100:00100000:1.0:1788838322.256173:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838322.256274:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116476416 00000100:00100000:2.0:1788838322.256278:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116476416 00000100:00080000:0.0:1788838322.256460:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838322.256465:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838322.256467:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838322.256515:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1427 00000100:00100000:3.0:1788838322.256524:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116476032:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838322.256822:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116476032:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 298us (12811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838322.256854:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1427 00000100:00100000:2.0:1788838322.258124:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2717 00000100:00100000:2.0:1788838322.258138:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116476416:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838322.258205:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116476416:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.258212:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2717 00000100:00100000:3.0:1788838322.557333:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838322.557355:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5059a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135183488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838322.557369:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135183360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838322.558399:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838322.558967:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838322.559270:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135183360 00000100:00100000:2.0:1788838322.559280:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135183360 00000100:00100000:2.0:1788838322.559370:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135183488 00000100:00100000:2.0:1788838322.559374:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135183488 00000100:00100000:3.0:1788838322.559408:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:3.0:1788838322.559420:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135183360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838322.559467:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838322.559532:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135183360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838322.559540:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00100000:3.0:1788838322.559558:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:3.0:1788838322.559565:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135183488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838322.559581:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838322.559613:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135183488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838322.559619:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:3.0:1788838322.559660:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5059a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135183488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838322.559825:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135183360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838322.987178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838322.987731:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116476544 00000100:00100000:0.0:1788838322.987743:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116476544 00000100:00100000:0.0:1788838322.987875:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1443 00000100:00100000:0.0:1788838322.987888:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:72821:x1875729116476544:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1788838322.987929:0:67312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:0.0:1788838322.988005:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:72821:x1875729116476544:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 119us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838322.988014:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1443 00000100:00100000:1.0:1788838322.993702:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838322.999577:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116476672 00000100:00100000:2.0:1788838322.999593:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116476672 00000100:00100000:2.0:1788838322.999671:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1444 00000100:00100000:2.0:1788838322.999697:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:72821:x1875729116476672:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:2.0:1788838322.999736:0:75504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:2.0:1788838322.999852:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:72821:x1875729116476672:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 157us (6154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838322.999859:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1444 00000100:00100000:1.0:1788838323.007738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838323.007832:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116476800 00000100:00100000:2.0:1788838323.007850:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116476800 00000100:00100000:2.0:1788838323.007909:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2144 00000100:00100000:2.0:1788838323.007921:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+5:72821:x1875729116476800:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838323.007951:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838323.008023:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+5:72821:x1875729116476800:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 105us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838323.008031:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2144 00000100:00100000:3.0:1788838323.011417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838323.011576:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116476928 00000100:00100000:2.0:1788838323.011587:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116476928 00000100:00100000:2.0:1788838323.011655:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2145 00000100:00100000:2.0:1788838323.011666:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+5:72821:x1875729116476928:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838323.011692:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838323.011773:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+5:72821:x1875729116476928:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 109us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838323.011780:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2145 00000100:00100000:1.0:1788838323.032517:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838323.032704:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116477056 00000100:00100000:3.0:1788838323.032714:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116477056 00000100:00100000:3.0:1788838323.032923:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1445 00000100:00100000:3.0:1788838323.032932:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:71717:x1875729116477056:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788838323.032952:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838323.032971:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca1c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfaf expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033037:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033052:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033065:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033077:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efe00/0x88da08396ccca1d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033084:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efe00/0x88da08396ccca1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033091:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efe00/0x88da08396ccca1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033221:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee600/0x88da08396ccca1d8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033229:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee600/0x88da08396ccca1d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033236:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee600/0x88da08396ccca1d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838323.033260:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838323.033263:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838323.033299:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee600/0x88da08396ccca1d8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033322:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033329:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033336:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033342:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033359:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3ee000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838323.033363:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033371:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033393:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:3.0:1788838323.033396:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838323.033400:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033407:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca1ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033419:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efe00/0x88da08396ccca1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033425:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efe00/0x88da08396ccca1d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033437:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efe00/0x88da08396ccca1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033442:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3efe00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838323.033445:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efe00/0x88da08396ccca1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033451:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efe00/0x88da08396ccca1d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033458:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8ff605587700) 00010000:00010000:3.0:1788838323.033460:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838323.033462:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efe00/0x88da08396ccca1d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033469:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efe00/0x88da08396ccca1d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033497:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca1c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfaf expref: 9 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033509:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee600/0x88da08396ccca1d8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfaf expref: 8 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.033516:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff605587f00) 00010000:00010000:3.0:1788838323.033518:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838323.033521:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ee600, rc 0) 00000100:00100000:3.0:1788838323.036059:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71717:x1875729116477056:12345-192.168.203.30@tcp:101:bash.0 Request processed in 3112us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838323.036093:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1445 00000100:00100000:0.0:1788838323.046523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838323.046664:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116477184 00000100:00100000:2.0:1788838323.046678:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116477184 00000100:00100000:2.0:1788838323.046746:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1446 00000100:00100000:2.0:1788838323.046756:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+8:71717:x1875729116477184:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1788838323.046788:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838323.046828:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccca1df lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfb6 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.046904:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.046918:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.046928:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.046942:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccca1ed lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.046948:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccca1ed lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.046954:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccca1ed lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838323.047912:0:67312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc70380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:67312:1875729135183616:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788838323.047994:0:67312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838323.048674:0:67312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624f7e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838323.048856:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135183616 00000100:00100000:0.0:1788838323.048863:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135183616 00000100:00100000:0.0:1788838323.048921:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4267 00000100:00100000:0.0:1788838323.048942:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:67312:x1875729135183616:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788838323.049051:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:67312:x1875729135183616:12345-0@lo:1000:mdt00_003.0 Request processed in 111us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838323.049070:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4267 00000100:00100000:3.0:1788838323.049150:0:67312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc70380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:67312:1875729135183616:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788838323.049213:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef000/0x88da08396ccca1f4 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049230:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef000/0x88da08396ccca1f4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049241:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef000/0x88da08396ccca1f4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838323.049262:0:67312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef000/0x88da08396ccca1f4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049275:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049282:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049287:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049294:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049299:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148f600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838323.049304:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049311:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049352:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff605587f00) 00010000:00010000:3.0:1788838323.049356:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838323.049360:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049367:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148f600/0x88da08396ccca1e6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049381:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccca1ed lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049387:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccca1ed lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049392:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccca1ed lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049397:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148e600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838323.049400:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccca1ed lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049406:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccca1ed lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049413:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff8ff60b5cfe00) 00010000:00010000:3.0:1788838323.049415:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838323.049418:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccca1ed lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049424:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e600/0x88da08396ccca1ed lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049471:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccca1df lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfb6 expref: 10 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049484:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef000/0x88da08396ccca1f4 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfb6 expref: 9 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.049491:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff605587c00) 00010000:00010000:3.0:1788838323.049493:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788838323.049495:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ef000, rc 0) 00000100:00100000:3.0:1788838323.049558:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:71717:x1875729116477184:12345-192.168.203.30@tcp:101:bash.0 Request processed in 2803us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838323.049565:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1446 00000100:00100000:1.0:1788838323.058445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838323.058541:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116477312 00000100:00100000:0.0:1788838323.058551:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116477312 00000100:00100000:0.0:1788838323.058609:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1447 00000100:00100000:0.0:1788838323.058619:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+9:71717:x1875729116477312:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788838323.058642:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838323.058663:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528800/0x88da08396ccca1fb lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfbd expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.058721:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529400/0x88da08396ccca202 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.058749:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529400/0x88da08396ccca202 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.058762:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529400/0x88da08396ccca202 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838323.058854:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1788838323.058859:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788838323.058921:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528800/0x88da08396ccca1fb lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfbd expref: 11 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.058943:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529400/0x88da08396ccca202 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfbd expref: 10 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.058971:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff606722d00) 00010000:00010000:0.0:1788838323.058974:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1788838323.058978:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529400, rc 0) 00000100:00100000:0.0:1788838323.059035:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71717:x1875729116477312:12345-192.168.203.30@tcp:101:bash.0 Request processed in 417us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838323.059042:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1447 00000100:00100000:2.0:1788838323.072274:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838323.072311:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838323.072553:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116477440 00000100:00100000:0.0:1788838323.072563:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116477440 00000100:00100000:0.0:1788838323.072617:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1448 00000100:00100000:0.0:1788838323.072628:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71717:x1875729116477440:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788838323.072649:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838323.072669:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528800/0x88da08396ccca209 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfc4 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.072753:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.072767:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.072780:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.072820:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528a00/0x88da08396ccca217 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.072829:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528a00/0x88da08396ccca217 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.072864:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528a00/0x88da08396ccca217 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.072945:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528600/0x88da08396ccca21e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.072954:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528600/0x88da08396ccca21e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.072962:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528600/0x88da08396ccca21e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838323.073008:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788838323.073013:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788838323.073032:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528600/0x88da08396ccca21e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073045:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528600/0x88da08396ccca21e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073055:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073061:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073068:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073074:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073090:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838323.073095:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073102:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073115:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff606722d00) 00010000:00010000:0.0:1788838323.073118:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838323.073122:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073128:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529e00/0x88da08396ccca210 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073141:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528a00/0x88da08396ccca217 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073147:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528a00/0x88da08396ccca217 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073154:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528a00/0x88da08396ccca217 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073160:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838323.073163:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528a00/0x88da08396ccca217 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073169:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528a00/0x88da08396ccca217 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073188:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff8ff508af1e00) 00010000:00010000:0.0:1788838323.073191:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838323.073195:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528a00/0x88da08396ccca217 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073200:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528a00/0x88da08396ccca217 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073235:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528800/0x88da08396ccca209 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfc4 expref: 12 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073248:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528600/0x88da08396ccca21e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfc4 expref: 11 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.073255:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8ff50b021900) 00010000:00010000:0.0:1788838323.073257:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838323.073259:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528600, rc 0) 00000100:00100000:0.0:1788838323.073321:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+11:71717:x1875729116477440:12345-192.168.203.30@tcp:101:bash.0 Request processed in 694us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838323.073330:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1448 00000100:00100000:1.0:1788838323.073586:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116477568 00000100:00100000:1.0:1788838323.073593:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116477568 00000100:00100000:1.0:1788838323.073636:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 741 00000100:00100000:1.0:1788838323.073644:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116477568:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838323.073656:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838323.073669:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529400/0x88da08396ccca202 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfbd expref: 11 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838323.073680:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8ff606722d00) 00010000:00010000:1.0:1788838323.073684:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838323.073711:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2405:x1875729116477568:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 68us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838323.073718:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 741 00000100:00100000:2.0:1788838323.080048:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838323.080193:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116477696 00000100:00100000:3.0:1788838323.080205:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116477696 00000100:00100000:3.0:1788838323.080267:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5992 00000100:00100000:3.0:1788838323.080278:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2404:x1875729116477696:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788838323.080297:0:26209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838323.080329:0:26209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061e21721/0x88da08396ccca225 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfcb expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838323.080537:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x603:0x0] initial LVB size: 0, mtime: 0x6a9f817d, atime: 0x6a9f817d, ctime: 0x6a9f817d, blocks: 0x0 00010000:00010000:3.0:1788838323.080559:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x603:0x0].0x0 since=3717s v=(0 0) 00010000:00010000:3.0:1788838323.080565:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x603:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838323.080575:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061e21721/0x88da08396ccca225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfcb expref: 6 pid: 26209 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.080619:0:26209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061e21721/0x88da08396ccca225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfcb expref: 6 pid: 26209 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.080634:0:26209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3efe00, rc 0) 00000100:00100000:3.0:1788838323.080697:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2404:x1875729116477696:12345-192.168.203.30@tcp:101:bash.0 Request processed in 421us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838323.080704:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5992 00000100:00100000:1.0:1788838323.093475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838323.093573:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116477824 00000100:00100000:0.0:1788838323.093584:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116477824 00000100:00100000:0.0:1788838323.093647:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1449 00000100:00100000:0.0:1788838323.093658:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+9:71717:x1875729116477824:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788838323.093679:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838323.093700:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccca22c lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfd2 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.093852:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.093870:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.093882:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.093958:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccca23a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.093981:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccca23a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.093990:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccca23a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838323.094103:0:66254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66254:1875729135183744:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788838323.094161:0:66254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838323.094199:0:66254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6193c1180 going to sleep for 11 seconds 00000100:00100000:0.0:1788838323.094234:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135183744 00000100:00100000:0.0:1788838323.094239:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135183744 00000100:00100000:0.0:1788838323.094283:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4268 00000100:00100000:0.0:1788838323.094291:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66254:x1875729135183744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788838323.094373:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66254:x1875729135183744:12345-0@lo:1000:mdt00_001.0 Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838323.094380:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4268 00000100:00100000:2.0:1788838323.094883:0:66254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:66254:1875729135183744:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788838323.094939:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccca241 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.094951:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccca241 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.094960:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccca241 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838323.094986:0:66254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccca241 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.094999:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095005:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095012:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095034:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095041:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838323.095045:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095054:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095067:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8ff605587f00) 00010000:00010000:2.0:1788838323.095070:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838323.095074:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095081:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528a00/0x88da08396ccca233 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095097:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccca23a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095103:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccca23a lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095109:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccca23a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095113:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148e800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838323.095116:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccca23a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095132:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccca23a lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095141:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff8ff60b5cfa00) 00010000:00010000:2.0:1788838323.095143:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838323.095146:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccca23a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095152:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e800/0x88da08396ccca23a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095191:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528800/0x88da08396ccca22c lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfd2 expref: 11 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095217:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e200/0x88da08396ccca241 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfd2 expref: 10 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.095224:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff60b5cf100) 00010000:00010000:2.0:1788838323.095227:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788838323.095229:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e200, rc 0) 00000100:00100000:2.0:1788838323.096275:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71717:x1875729116477824:12345-192.168.203.30@tcp:101:bash.0 Request processed in 2614us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838323.096286:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1449 00000100:00100000:1.0:1788838323.101085:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838323.101935:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116477952 00000100:00100000:0.0:1788838323.101944:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116477952 00000100:00100000:0.0:1788838323.101998:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1450 00000100:00100000:0.0:1788838323.102008:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71717:x1875729116477952:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1788838323.102026:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838323.102040:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528e00/0x88da08396ccca248 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfd9 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.102087:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529000/0x88da08396ccca24f lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.102097:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529000/0x88da08396ccca24f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.102116:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529000/0x88da08396ccca24f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838323.102163:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788838323.102167:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788838323.102205:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601528e00/0x88da08396ccca248 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfd9 expref: 12 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.102227:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529000/0x88da08396ccca24f lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfd9 expref: 11 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838323.102235:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8900) 00010000:00010000:0.0:1788838323.102238:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1788838323.102242:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529000, rc 0) 00000100:00100000:0.0:1788838323.102355:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:71717:x1875729116477952:12345-192.168.203.30@tcp:101:bash.0 Request processed in 348us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838323.102363:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1450 00000100:00100000:0.0:1788838323.112327:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838323.112381:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838323.113377:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116478208 00000100:00100000:1.0:1788838323.113390:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116478208 00000100:00100000:2.0:1788838323.113468:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 742 00000100:00100000:2.0:1788838323.113485:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116478208:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838323.113500:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838323.113525:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff601529000/0x88da08396ccca24f lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfd9 expref: 11 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838323.113556:0:10364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8900) 00010000:00010000:2.0:1788838323.113561:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838323.113627:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2405:x1875729116478208:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 149us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838323.113635:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 742 00000100:00100000:3.0:1788838323.114657:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116478080 00000100:00100000:3.0:1788838323.114666:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116478080 00000100:00100000:3.0:1788838323.114716:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1451 00000100:00100000:3.0:1788838323.114734:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+10:71717:x1875729116478080:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1788838323.114752:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838323.114768:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee800/0x88da08396ccca256 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfe0 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.114869:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.114884:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.114895:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.114910:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3efa00/0x88da08396ccca264 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.114931:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3efa00/0x88da08396ccca264 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.114939:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3efa00/0x88da08396ccca264 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115010:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ef400/0x88da08396ccca26b lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115019:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ef400/0x88da08396ccca26b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115025:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ef400/0x88da08396ccca26b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838323.115065:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x5:0x0]: returning size 0 00000004:00200000:3.0:1788838323.115070:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838323.115090:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ef400/0x88da08396ccca26b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115101:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ef400/0x88da08396ccca26b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115111:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115117:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115123:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115140:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115146:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3ee000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838323.115151:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115159:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115169:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8ff6082c8900) 00010000:00010000:3.0:1788838323.115172:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838323.115176:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115183:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee000/0x88da08396ccca25d lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115195:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3efa00/0x88da08396ccca264 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115201:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3efa00/0x88da08396ccca264 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115206:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3efa00/0x88da08396ccca264 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115211:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3efa00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838323.115214:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3efa00/0x88da08396ccca264 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115230:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3efa00/0x88da08396ccca264 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115239:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff8ff605587000) 00010000:00010000:3.0:1788838323.115241:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838323.115244:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3efa00/0x88da08396ccca264 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115250:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3efa00/0x88da08396ccca264 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115281:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ee800/0x88da08396ccca256 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfe0 expref: 12 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115307:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8ff50f3ef400/0x88da08396ccca26b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfe0 expref: 11 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838323.115315:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8ff612676b00) 00010000:00010000:3.0:1788838323.115317:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838323.115320:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ef400, rc 0) 00000100:00100000:3.0:1788838323.115386:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+11:71717:x1875729116478080:12345-192.168.203.30@tcp:101:bash.0 Request processed in 662us (3070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838323.115392:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1451 00000100:00100000:3.0:1788838323.119045:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838323.119159:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116478336 00000100:00100000:1.0:1788838323.119174:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116478336 00000100:00100000:1.0:1788838323.119294:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5993 00000100:00100000:1.0:1788838323.119306:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2404:x1875729116478336:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1788838323.119325:0:26212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838323.119347:0:26212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df5ee1a6/0x88da08396ccca272 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfe7 expref: -99 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838323.119394:0:26212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x604:0x0] initial LVB size: 0, mtime: 0x6a9f817d, atime: 0x6a9f817d, ctime: 0x6a9f817d, blocks: 0x0 00010000:00010000:1.0:1788838323.119427:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x604:0x0].0x0 since=3717s v=(0 0) 00010000:00010000:1.0:1788838323.119432:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x604:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838323.119441:0:26212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df5ee1a6/0x88da08396ccca272 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfe7 expref: 7 pid: 26212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838323.119459:0:26212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df5ee1a6/0x88da08396ccca272 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfe7 expref: 7 pid: 26212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838323.119472:0:26212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6ce00, rc 0) 00000100:00100000:1.0:1788838323.119542:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116478336:12345-192.168.203.30@tcp:101:bash.0 Request processed in 238us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838323.119549:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5993 00010000:00010000:2.0:1788838323.261568:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838323.581171:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838323.581196:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135183872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838323.581271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838323.581333:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135184000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838323.581379:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838323.583183:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135183872 00000100:00100000:2.0:1788838323.583196:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135183872 00000100:00100000:2.0:1788838323.583298:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135184000 00000100:00100000:2.0:1788838323.583302:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135184000 00000100:00100000:3.0:1788838323.583367:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:3.0:1788838323.583381:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135183872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838323.583409:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838323.583505:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135183872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838323.583512:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00100000:3.0:1788838323.583529:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:3.0:1788838323.583537:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135184000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838323.583548:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838323.583582:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135184000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (2203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838323.583589:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:3.0:1788838323.583636:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135184000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838323.583877:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff637f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135183872:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788838324.285003:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838325.309086:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838326.333583:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838327.165175:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135184512:0@lo:400:kworker.0 00000100:00100000:1.0:1788838327.165248:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838327.165291:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135185024:0@lo:400:kworker.0 00000100:00100000:1.0:1788838327.165329:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838327.165345:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135185536:0@lo:400:kworker.0 00000100:00100000:1.0:1788838327.165364:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838327.165385:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788838327.165391:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135184128:0@lo:400:kworker.0 00000100:00100000:1.0:1788838327.165463:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838327.165488:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135184640:0@lo:400:kworker.0 00000100:00100000:1.0:1788838327.165507:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838327.165522:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135185152:0@lo:400:kworker.0 00000100:00100000:1.0:1788838327.165559:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838327.165584:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135185664:0@lo:400:kworker.0 00000100:00100000:1.0:1788838327.165604:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838327.165635:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135184512 00000100:00100000:1.0:1788838327.165658:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135184512 00000100:00100000:2.0:1788838327.165958:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135184640 00000100:00100000:2.0:1788838327.165963:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135184640 00000100:00100000:2.0:1788838327.166007:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135185152 00000100:00100000:2.0:1788838327.166010:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135185152 00000100:00100000:2.0:1788838327.166024:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135185664 00000100:00100000:2.0:1788838327.166027:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135185664 00000100:00100000:2.0:1788838327.166040:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1788838327.166047:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135184640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838327.166103:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135184640:12345-0@lo:400:kworker.0 Request processed in 56us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838327.166110:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1788838327.166127:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1788838327.166134:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135185152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838327.166170:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135185152:12345-0@lo:400:kworker.0 Request processed in 37us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838327.166176:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1788838327.166188:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1788838327.166194:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135185664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838327.166218:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135185664:12345-0@lo:400:kworker.0 Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838327.166223:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1788838327.166245:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135185024 00000100:00100000:2.0:1788838327.166248:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135185024 00000100:00100000:2.0:1788838327.166269:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135185536 00000100:00100000:2.0:1788838327.166272:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135185536 00000100:00100000:2.0:1788838327.166288:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:2.0:1788838327.166307:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135185024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838327.166337:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135185024:12345-0@lo:400:kworker.0 Request processed in 43us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838327.166343:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:2.0:1788838327.166354:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:2.0:1788838327.166359:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135185536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838327.166382:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135185536:12345-0@lo:400:kworker.0 Request processed in 24us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838327.166387:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:2.0:1788838327.166437:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135184640:0@lo:400:kworker.0 00000100:00100000:2.0:1788838327.166446:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135185152:0@lo:400:kworker.0 00000100:00100000:2.0:1788838327.166454:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135185664:0@lo:400:kworker.0 00000100:00100000:2.0:1788838327.166470:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135185024:0@lo:400:kworker.0 00000100:00100000:2.0:1788838327.166479:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135185536:0@lo:400:kworker.0 00000100:00100000:1.0:1788838327.166888:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1788838327.166896:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135184512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838327.166935:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135184512:12345-0@lo:400:kworker.0 Request processed in 41us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838327.166941:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1788838327.167176:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135184512:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.168737:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135184384:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.168836:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838327.168870:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135184896:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.168896:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838327.168919:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135185408:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.168939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838327.168962:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788838327.168968:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135184256:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.168987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838327.169002:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135184768:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838327.169038:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135185280:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169058:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788838327.169085:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838327.169089:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838327.169104:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838327.169119:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135184384 00000100:00100000:3.0:1788838327.169126:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135184384 00000100:00100000:3.0:1788838327.169169:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135184256 00000100:00100000:3.0:1788838327.169173:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135184256 00000100:00100000:3.0:1788838327.169191:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1788838327.169198:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135184384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169251:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135184384:12345-0@lo:400:kworker.0 Request processed in 53us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838327.169257:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1788838327.169274:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1788838327.169281:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135184256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169323:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135184256:12345-0@lo:400:kworker.0 Request processed in 42us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838327.169329:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1788838327.169347:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135184896 00000100:00100000:3.0:1788838327.169350:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135184896 00000100:00100000:3.0:1788838327.169373:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135185408 00000100:00100000:3.0:1788838327.169376:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135185408 00000100:00100000:3.0:1788838327.169392:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:3.0:1788838327.169398:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135184896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169427:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135184896:12345-0@lo:400:kworker.0 Request processed in 29us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838327.169433:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:3.0:1788838327.169444:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:3.0:1788838327.169450:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135185408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169474:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135185408:12345-0@lo:400:kworker.0 Request processed in 25us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838327.169486:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00100000:3.0:1788838327.169514:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135184768 00000100:00100000:3.0:1788838327.169518:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135184768 00000100:00100000:3.0:1788838327.169539:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135185280 00000100:00100000:3.0:1788838327.169542:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135185280 00000100:00100000:3.0:1788838327.169557:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4269 00000100:00100000:3.0:1788838327.169563:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135184768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169594:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135184768:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838327.169600:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4269 00000100:00100000:3.0:1788838327.169611:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4270 00000100:00100000:3.0:1788838327.169617:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5048d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135185280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169642:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5048d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135185280:12345-0@lo:400:kworker.0 Request processed in 25us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838327.169662:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4270 00000100:00080000:3.0:1788838327.169678:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838327.169681:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838327.169683:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838327.169710:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135184256:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169720:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135184768:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169727:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135185280:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169736:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135184384:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169744:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135184896:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.169751:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135185408:0@lo:400:kworker.0 00000100:00100000:3.0:1788838327.170742:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838327.170757:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135185792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838327.170834:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838327.170961:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135184128 00000100:00100000:0.0:1788838327.170967:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135184128 00000100:00100000:0.0:1788838327.171004:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788838327.171012:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135184128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838327.171075:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135184128:12345-0@lo:400:kworker.0 Request processed in 64us (5611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838327.171082:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788838327.171264:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135185920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838327.171287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838327.186268:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135185792 00000100:00100000:2.0:1788838327.186287:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135185792 00000100:00100000:2.0:1788838327.186327:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135185920 00000100:00100000:2.0:1788838327.186331:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135185920 00000100:00100000:2.0:1788838327.186380:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4271 00000100:00100000:2.0:1788838327.186390:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135185920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838327.186428:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:0.0:1788838327.186562:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135184128:0@lo:400:kworker.0 00000100:00100000:2.0:1788838327.195574:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135185920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9174us (24274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838327.195589:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4271 00000100:00100000:2.0:1788838327.195684:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4272 00000100:00100000:2.0:1788838327.195693:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135185792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838327.195731:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:2.0:1788838327.195780:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135185792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (24946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838327.195787:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4272 00000100:00100000:3.0:1788838327.198434:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135185920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838327.198457:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135185792:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788838327.359311:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838327.363485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838327.363532:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838327.363566:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838327.363594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838327.363626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838327.363656:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116478976 00000100:00100000:1.0:1788838327.363674:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116478976 00000100:00100000:1.0:1788838327.363731:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116478848 00000100:00100000:1.0:1788838327.363734:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116478848 00000100:00100000:1.0:1788838327.363758:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2722 00000100:00100000:1.0:1788838327.363767:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116478976:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838327.363884:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116478976:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 117us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838327.363892:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2722 00000100:00100000:1.0:1788838327.363909:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2723 00000100:00100000:1.0:1788838327.363916:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2405:x1875729116478848:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838327.363964:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2405:x1875729116478848:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838327.363971:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2723 00000100:00100000:1.0:1788838327.363997:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116478720 00000100:00100000:1.0:1788838327.364000:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116478720 00000100:00100000:1.0:1788838327.364032:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116478592 00000100:00100000:1.0:1788838327.364035:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116478592 00000100:00100000:1.0:1788838327.364054:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1434 00000100:00100000:1.0:1788838327.364060:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116478720:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838327.364087:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116478720:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838327.364092:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1434 00000100:00100000:1.0:1788838327.364102:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1435 00000100:00100000:1.0:1788838327.364107:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2405:x1875729116478592:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838327.364130:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2405:x1875729116478592:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838327.364137:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1435 00000100:00080000:3.0:1788838327.364599:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838327.364605:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838327.364608:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788838327.364610:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788838327.365383:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116478464 00000100:00100000:2.0:1788838327.365392:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116478464 00000100:00100000:2.0:1788838327.365449:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:2.0:1788838327.365458:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116478464:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838327.365523:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116478464:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 66us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838327.365541:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:0.0:1788838327.677133:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135186048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838327.677210:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838327.677702:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135186048 00000100:00100000:3.0:1788838327.677711:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135186048 00000100:00100000:3.0:1788838327.677774:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:3.0:1788838327.677784:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135186048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838327.677855:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838327.677910:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135186048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838327.677916:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1788838327.678120:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135186048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838327.678457:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838327.678469:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135186176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838327.678513:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838327.678583:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135186176 00000100:00100000:3.0:1788838327.678588:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135186176 00000100:00100000:3.0:1788838327.678622:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:3.0:1788838327.678629:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135186176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838327.678647:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838327.678684:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135186176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838327.678709:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00100000:3.0:1788838327.678740:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135186176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788838328.387192:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838328.701267:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135186304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838328.701357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838328.701753:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135186432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838328.701790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838328.701940:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135186304 00000100:00100000:1.0:1788838328.701949:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135186304 00000100:00100000:1.0:1788838328.702004:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135186432 00000100:00100000:1.0:1788838328.702008:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135186432 00000100:00100000:1.0:1788838328.702027:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:1.0:1788838328.702035:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135186304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838328.702058:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838328.702124:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135186304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838328.702147:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:1.0:1788838328.702163:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:1.0:1788838328.702170:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135186432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838328.702181:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838328.702214:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135186432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838328.702221:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:2.0:1788838328.702374:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135186304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838328.702515:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135186432:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788838329.413591:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838330.432092:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838331.455083:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838331.538371:0:95311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc7072aad0 20000000:00000080:1.0:1788838331.538471:0:95311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8ff639c5a800 uarg=0000000000000000 00000040:00100000:1.0:1788838331.539653:0:95311:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 49 20000000:01000000:1.0:1788838331.539667:0:95311:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:1.0:1788838331.539686:0:95311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1788838331.540544:0:95312:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 55 marker 42 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:3.0:1788838331.540726:0:95312:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 57 marker 42 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1788838331.540743:0:95312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:1.0:1788838331.541438:0:95311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:1.0:1788838331.541465:0:95311:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1788838331.541483:0:95311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:1.0:1788838331.541499:0:95311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:1.0:1788838331.541513:0:95311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1788838331.542362:0:95313:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 43 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1788838331.542484:0:95313:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 43 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1788838331.542497:0:95313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:2.0:1788838331.543347:0:95311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:2.0:1788838331.543374:0:95311:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1788838331.543479:0:95311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:2.0:1788838331.543502:0:95311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:2.0:1788838331.543523:0:95311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1788838331.545165:0:95314:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 44 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1788838331.545254:0:95314:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 44 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1788838331.545269:0:95314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:0.0:1788838331.546445:0:95311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:0.0:1788838331.546468:0:95311:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:0.0:1788838331.546486:0:95311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:0.0:1788838331.546504:0:95311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:0.0:1788838331.546522:0:95311:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788838331.546548:0:95311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546587:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc9db0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf8c expref: 9 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546595:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff504627200/0x88da08396ccc9dbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf9a expref: 9 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546604:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50a2e8a00/0x88da08396ccc9de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9de1 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546632:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50a2e9000/0x88da08396ccc9eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9eb3 expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546639:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9ee4 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546646:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f00 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546653:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc9f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f2a expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546660:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff504627a00/0x88da08396ccc9f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f38 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546667:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50a2e9600/0x88da08396ccc9f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f54 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546674:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f62 expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546681:0:95311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff504626600/0x88da08396ccc9f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f8c expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546688:0:95311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546741:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff504626600/0x88da08396ccc9f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9f8c expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.546766:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff504626600/0x88da08396ccc9f93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9f8c expref: 23 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.546794:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135186560:0@lo:104: 00000100:00100000:0.0:1788838331.546913:0:95311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838331.547162:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9f62 expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.547172:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9f62 expref: 23 pid: 94398 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.547181:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135186688:0@lo:104: 00000100:00100000:0.0:1788838331.547210:0:95311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838331.547241:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50a2e9600/0x88da08396ccc9f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9f54 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.547250:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50a2e9600/0x88da08396ccc9f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9f54 expref: 23 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.547259:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50270b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135186816:0@lo:104: 00000100:00100000:0.0:1788838331.547280:0:95311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838331.547300:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff504627a00/0x88da08396ccc9f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9f38 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.547308:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff504627a00/0x88da08396ccc9f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9f38 expref: 23 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.547317:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640669c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135186944:0@lo:104: 00000100:00100000:0.0:1788838331.547344:0:95311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838331.547359:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc9f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9f2a expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.547366:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc9f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9f2a expref: 23 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.547373:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187072:0@lo:104: 00000100:00100000:0.0:1788838331.547391:0:95311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838331.547405:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9f00 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.547412:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9f00 expref: 23 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.547419:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187200:0@lo:104: 00000100:00100000:0.0:1788838331.547436:0:95311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838331.547454:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9ee4 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.547463:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9ee4 expref: 23 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.547470:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187328:0@lo:104: 00000100:00100000:0.0:1788838331.547496:0:95311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788838331.547513:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50a2e9000/0x88da08396ccc9eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9eb3 expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.547522:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50a2e9000/0x88da08396ccc9eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9eb3 expref: 23 pid: 94398 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.547544:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187456:0@lo:104: 00010000:00010000:0.0:1788838331.547641:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50a2e8a00/0x88da08396ccc9de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9de1 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.547650:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50a2e8a00/0x88da08396ccc9de8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9de1 expref: 23 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.547658:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187584:0@lo:104: 00010000:00010000:0.0:1788838331.547690:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff504627200/0x88da08396ccc9dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf9a expref: 9 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.547699:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff504627200/0x88da08396ccc9dbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf9a expref: 9 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.547709:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187712:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788838331.547793:0:95311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc9db0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf8c expref: 9 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.547832:0:95311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc9db0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf8c expref: 9 pid: 94392 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.547841:0:95311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187840:192.168.203.30@tcp:104: 00000100:00100000:0.0:1788838331.547869:0:95311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d27300 going to sleep for 11 seconds 00000100:00100000:1.0:1788838331.548220:0:10414:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788838331.548247:0:10414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838331.548264:0:10414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838331.548283:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135186560 00000100:00100000:1.0:1788838331.548300:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135186560 00000100:00100000:1.0:1788838331.548348:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135186688 00000100:00100000:1.0:1788838331.548352:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135186688 00000100:00100000:1.0:1788838331.548361:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135186816 00000100:00100000:1.0:1788838331.548364:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135186816 00000100:00100000:1.0:1788838331.548371:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135186944 00000100:00100000:1.0:1788838331.548374:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135186944 00000100:00100000:1.0:1788838331.548383:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135187072 00000100:00100000:1.0:1788838331.548385:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135187072 00000100:00100000:1.0:1788838331.548411:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135187200 00000100:00100000:1.0:1788838331.548415:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135187200 00000100:00100000:1.0:1788838331.548425:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135187328 00000100:00100000:1.0:1788838331.548428:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135187328 00000100:00100000:1.0:1788838331.548440:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135187456 00000100:00100000:1.0:1788838331.548443:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135187456 00000100:00100000:1.0:1788838331.548451:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135187584 00000100:00100000:1.0:1788838331.548453:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135187584 00000100:00100000:1.0:1788838331.548468:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788838331.548478:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:95311:x1875729135186560:12345-0@lo:104: 00010000:00010000:1.0:1788838331.548496:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.548592:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788838331.548599:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+11:95311:x1875729135186560:12345-0@lo:104: Request processed in 123us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.548607:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788838331.548630:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788838331.548637:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:95311:x1875729135186688:12345-0@lo:104: 00010000:00010000:1.0:1788838331.548646:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.548697:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788838331.548703:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+10:95311:x1875729135186688:12345-0@lo:104: Request processed in 67us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.548710:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788838331.548724:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788838331.548730:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:95311:x1875729135186816:12345-0@lo:104: 00010000:00010000:1.0:1788838331.548739:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.548771:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788838331.548777:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+9:95311:x1875729135186816:12345-0@lo:104: Request processed in 47us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.548794:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788838331.548827:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788838331.548833:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:95311:x1875729135186944:12345-0@lo:104: 00010000:00010000:1.0:1788838331.548840:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.548874:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788838331.548879:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+8:95311:x1875729135186944:12345-0@lo:104: Request processed in 46us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.548884:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788838331.548897:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788838331.548903:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+7:95311:x1875729135187072:12345-0@lo:104: 00010000:00010000:1.0:1788838331.548910:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.548947:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788838331.548952:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+7:95311:x1875729135187072:12345-0@lo:104: Request processed in 50us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.548959:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788838331.549166:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788838331.549174:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+6:95311:x1875729135187200:12345-0@lo:104: 00010000:00010000:1.0:1788838331.549183:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.549219:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788838331.549224:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+6:95311:x1875729135187200:12345-0@lo:104: Request processed in 52us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.549231:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788838331.549244:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788838331.549251:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50598a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+5:95311:x1875729135187328:12345-0@lo:104: 00010000:00010000:1.0:1788838331.549258:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.549286:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788838331.549290:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50598a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+5:95311:x1875729135187328:12345-0@lo:104: Request processed in 41us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.549296:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788838331.549328:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788838331.549334:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+4:95311:x1875729135187456:12345-0@lo:104: 00010000:00010000:1.0:1788838331.549342:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.549379:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1788838331.549384:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+4:95311:x1875729135187456:12345-0@lo:104: Request processed in 51us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.549391:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788838331.549404:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788838331.549411:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:95311:x1875729135187584:12345-0@lo:104: 00010000:00010000:1.0:1788838331.549419:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.549445:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1788838331.549451:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:95311:x1875729135187584:12345-0@lo:104: Request processed in 41us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.549456:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00010000:2.0:1788838331.549762:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788838331.549772:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.549790:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627000 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838331.549795:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.549834:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838331.549842:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838331.549850:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838331.549898:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.549917:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838331.549944:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.549951:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff504627000/0x88da08396ccc9f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f93 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550085:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788838331.550090:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550097:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9a00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838331.550100:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550107:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838331.550114:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838331.550119:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838331.550134:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550138:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838331.550144:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550151:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e9a00/0x88da08396ccc9f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f69 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550166:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788838331.550170:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550175:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a5600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838331.550178:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550184:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838331.550189:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838331.550194:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838331.550206:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550212:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838331.550226:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550232:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a5600/0x88da08396ccc9f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f5b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550241:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788838331.550244:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550260:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838331.550263:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550270:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838331.550276:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838331.550282:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838331.550296:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550303:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838331.550309:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550316:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9400/0x88da08396ccc9f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f3f expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550325:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838331.550329:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550336:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9a00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838331.550338:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550355:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838331.550362:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838331.550367:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838331.550381:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550387:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838331.550392:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550466:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9a00/0x88da08396ccc9f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f31 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550476:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838331.550480:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550485:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4800 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838331.550488:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550495:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838331.550502:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838331.550515:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838331.550531:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550537:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838331.550543:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550549:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4800/0x88da08396ccc9f00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9f07 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550558:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838331.550562:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550647:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8c00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838331.550650:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550657:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838331.550663:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838331.550668:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838331.550686:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550692:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838331.550704:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550711:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8c00/0x88da08396ccc9ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9eeb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550721:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838331.550724:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550732:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626000 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838331.550734:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550741:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838331.550748:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838331.550754:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838331.550768:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550774:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838331.550778:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550795:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff504626000/0x88da08396ccc9eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9eba expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550843:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838331.550847:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550852:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8c00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838331.550855:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550862:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838331.550868:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838331.550873:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838331.550889:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550895:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838331.550900:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550907:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8c00/0x88da08396ccc9de1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9de8 expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.550924:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838331.550926:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838331.550928:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838331.551361:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135186560:0@lo:104: 00000100:00100000:0.0:1788838331.551377:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135186688:0@lo:104: 00000100:00100000:0.0:1788838331.551387:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50270b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135186816:0@lo:104: 00000100:00100000:0.0:1788838331.551424:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640669c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135186944:0@lo:104: 00000100:00100000:0.0:1788838331.551434:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187072:0@lo:104: 00000100:00100000:0.0:1788838331.551443:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187200:0@lo:104: 00000100:00100000:0.0:1788838331.551453:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187328:0@lo:104: 00000100:00100000:0.0:1788838331.551464:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187456:0@lo:104: 00000100:00100000:0.0:1788838331.551473:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187584:0@lo:104: 00000100:00100000:2.0:1788838331.551543:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135187968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838331.551721:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838331.551730:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838331.551737:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838331.552333:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135188352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838331.552425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838331.552480:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135188864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838331.552501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838331.552531:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788838331.552537:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135188224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838331.552558:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838331.552584:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135188736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838331.552607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838331.552650:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135188352 00000100:00100000:0.0:1788838331.552659:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135188352 00010000:00010000:0.0:1788838331.552701:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff504627a00/0x88da08396ccc9f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f38 expref: 24 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.552733:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135188864 00000100:00100000:0.0:1788838331.552736:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135188864 00010000:00010000:0.0:1788838331.552747:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50a2e9000/0x88da08396ccc9eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9eb3 expref: 25 pid: 94398 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.552759:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135188224 00000100:00100000:0.0:1788838331.552775:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135188224 00010000:00010000:0.0:1788838331.552825:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50a2e9600/0x88da08396ccc9f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f54 expref: 26 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.552836:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135188736 00000100:00100000:0.0:1788838331.552839:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135188736 00010000:00010000:0.0:1788838331.552848:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9ee4 expref: 27 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838331.552860:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1788838331.552869:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+27:3646:x1875729135188352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838331.552885:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838331.552891:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff504627a00/0x88da08396ccc9f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f38 expref: 27 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.552901:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff504627a00/0x88da08396ccc9f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9f38 expref: 27 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.552922:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff504627a00/0x88da08396ccc9f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9f38 expref: 27 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.552938:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838331.553235:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+26:3646:x1875729135188352:12345-0@lo:103:ldlm_bl.0 Request processed in 364us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838331.553244:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1788838331.553267:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1788838331.553274:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+25:3646:x1875729135188864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838331.553284:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838331.553289:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50a2e9000/0x88da08396ccc9eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9eb3 expref: 25 pid: 94398 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.553308:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50a2e9000/0x88da08396ccc9eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9eb3 expref: 25 pid: 94398 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.553320:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50a2e9000/0x88da08396ccc9eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9eb3 expref: 25 pid: 94398 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.553329:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838331.553355:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135188864:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838331.553361:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1788838331.553374:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1788838331.553379:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3646:x1875729135188224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838331.553386:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838331.553450:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50a2e9600/0x88da08396ccc9f5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f54 expref: 23 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.553461:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50a2e9600/0x88da08396ccc9f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9f54 expref: 23 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.553473:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50a2e9600/0x88da08396ccc9f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9f54 expref: 23 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.553483:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838331.553508:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3646:x1875729135188224:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838331.553514:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1788838331.553527:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:0.0:1788838331.553533:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3646:x1875729135188736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838331.553550:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838331.553555:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9ee4 expref: 21 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.553632:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9ee4 expref: 21 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.553644:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab9200/0x88da08396ccc9eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9ee4 expref: 21 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.553655:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838331.553679:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3646:x1875729135188736:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838331.553686:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:0.0:1788838331.553740:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135188224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838331.553750:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135188736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838331.553757:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135188352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838331.553764:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135188864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838331.554388:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187712:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788838331.554626:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838331.554678:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135188480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838331.554703:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838331.554729:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135188992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838331.554755:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838331.554822:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135187968 00000100:00100000:2.0:1788838331.554829:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135187968 00010000:00010000:2.0:1788838331.554866:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff504626600/0x88da08396ccc9f93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f8c expref: 20 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838331.554894:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135188480 00000100:00100000:2.0:1788838331.554897:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135188480 00010000:00010000:2.0:1788838331.554911:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc9f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f2a expref: 21 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838331.554925:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135188992 00000100:00100000:2.0:1788838331.554928:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135188992 00010000:00010000:2.0:1788838331.554938:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50a2e8a00/0x88da08396ccc9de8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9de1 expref: 22 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838331.554950:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1788838331.554957:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3643:x1875729135187968:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838331.555193:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:3.0:1788838331.555205:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3643:x1875729135188480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838331.555221:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838331.555228:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc9f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f2a expref: 22 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.555240:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc9f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9f2a expref: 22 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.555258:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5000/0x88da08396ccc9f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9f2a expref: 22 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.555294:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838331.555342:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3643:x1875729135188480:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838331.555349:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:3.0:1788838331.555370:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:3.0:1788838331.555377:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce53450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3643:x1875729135188992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838331.555385:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838331.555390:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50a2e8a00/0x88da08396ccc9de8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9de1 expref: 20 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.555413:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50a2e8a00/0x88da08396ccc9de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9de1 expref: 20 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.555426:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50a2e8a00/0x88da08396ccc9de8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9de1 expref: 20 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.555435:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838331.555458:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce53450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+19:3643:x1875729135188992:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838331.555465:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00010000:00010000:2.0:1788838331.555683:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838331.555690:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff504626600/0x88da08396ccc9f93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f8c expref: 18 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.555703:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff504626600/0x88da08396ccc9f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9f8c expref: 18 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.555728:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff504626600/0x88da08396ccc9f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9f8c expref: 18 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838331.555740:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838331.555768:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:3643:x1875729135187968:12345-0@lo:103:ldlm_bl.0 Request processed in 811us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838331.555775:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1788838331.555896:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135187968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838331.555907:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135188480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838331.555915:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135188992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838331.556231:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135188096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838331.556274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838331.556345:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135188608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838331.556370:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838331.556562:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135188096 00000100:00100000:3.0:1788838331.556635:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135188096 00010000:00010000:3.0:1788838331.556670:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f62 expref: 17 pid: 94398 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838331.556701:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135188608 00000100:00100000:3.0:1788838331.556705:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135188608 00010000:00010000:3.0:1788838331.556718:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f00 expref: 18 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838331.556762:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:3.0:1788838331.556772:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+18:3644:x1875729135188096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838331.556795:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838331.556825:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f62 expref: 18 pid: 94398 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.556836:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9f62 expref: 18 pid: 94398 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.556852:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a4000/0x88da08396ccc9f69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9f62 expref: 18 pid: 94398 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.556867:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838331.556903:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+17:3644:x1875729135188096:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838331.556911:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:3.0:1788838331.556928:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:3.0:1788838331.556935:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+16:3644:x1875729135188608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838331.556943:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838331.556947:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9f00 expref: 16 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.556956:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9f00 expref: 16 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838331.557156:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135188096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788838331.557215:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8a00/0x88da08396ccc9f07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9f00 expref: 16 pid: 94393 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838331.557240:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788838331.557279:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+15:3644:x1875729135188608:12345-0@lo:103:ldlm_bl.0 Request processed in 344us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838331.557287:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1788838331.557345:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135188608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788838331.560384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838331.560561:0:95311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95311:1875729135187840:192.168.203.30@tcp:104: 00010000:00010000:0.0:1788838331.560662:0:95311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838331.561247:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838331.562149:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116479104 00000100:00100000:2.0:1788838331.562164:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116479104 00010000:00010000:2.0:1788838331.562216:0:6533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff504627200/0x88da08396ccc9dbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf9a expref: 10 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838331.562294:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116479232 00000100:00100000:2.0:1788838331.562299:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116479232 00010000:00010000:2.0:1788838331.562313:0:6533:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc9db0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf8c expref: 11 pid: 94392 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838331.562532:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2590 00000100:00100000:1.0:1788838331.562547:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2af93169-6705-472b-b7ff-fd7cc5c04782+11:2404:x1875729116479104:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838331.562567:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838331.562574:0:6531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff504627200/0x88da08396ccc9dbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf9a expref: 11 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562606:0:6531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff504627200/0x88da08396ccc9dbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf9a expref: 11 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562630:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff504627200/0x88da08396ccc9dbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf9a expref: 11 pid: 94395 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562645:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838331.562732:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116479104:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 188us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.562740:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2590 00000100:00100000:1.0:1788838331.562764:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2591 00000100:00100000:1.0:1788838331.562772:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50364b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:2404:x1875729116479232:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838331.562792:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838331.562829:0:6531:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc9db0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf8c expref: 9 pid: 94392 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562840:0:6531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc9db0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf8c expref: 9 pid: 94392 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562850:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8200/0x88da08396ccc9db0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf8c expref: 9 pid: 94392 timeout: 3825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562862:0:6531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562872:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562903:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562911:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562918:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562925:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562931:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528e00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:1.0:1788838331.562936:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562946:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562975:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838331.562988:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838331.563013:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50364b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2af93169-6705-472b-b7ff-fd7cc5c04782+8:2404:x1875729116479232:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 242us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838331.563020:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2591 00010000:00010000:0.0:1788838331.563580:0:95311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.563592:0:95311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838331.563609:0:95311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601528e00/0x88da08396ccca279 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838332.285069:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788838332.285102:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135189120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838332.285213:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838332.285321:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135189120 00000100:00100000:3.0:1788838332.285332:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135189120 00000100:00100000:0.0:1788838332.285393:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135189248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838332.285400:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4273 00000100:00100000:3.0:1788838332.285413:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135189120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838332.285447:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:0.0:1788838332.285460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838332.285501:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135189120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838332.285508:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4273 00000100:00100000:3.0:1788838332.285532:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135189248 00000100:00100000:3.0:1788838332.285536:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135189248 00000100:00100000:3.0:1788838332.285575:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4274 00000100:00100000:3.0:1788838332.285584:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135189248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838332.285602:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445027840 avail 1298788352 00000100:00100000:3.0:1788838332.285675:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135189248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838332.285681:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4274 00000100:00100000:0.0:1788838332.285693:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135189376:0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.290104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838332.290185:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135189376 00000100:00100000:0.0:1788838332.290194:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135189376 00000100:00100000:0.0:1788838332.290242:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788838332.290253:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+15:3646:x1875729135189376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.290304:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+15:3646:x1875729135189376:12345-0@lo:400:kworker.0 Request processed in 54us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838332.290312:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788838332.290364:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135189376:0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.290920:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135189888:0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.290996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838332.291047:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135190400:0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.291101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838332.291132:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788838332.291138:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135189760:0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.291173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838332.291192:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135190272:0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.291226:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838332.291266:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135189888 00000100:00100000:1.0:1788838332.291275:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135189888 00000100:00100000:1.0:1788838332.291346:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135189760 00000100:00100000:1.0:1788838332.291349:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135189760 00000100:00100000:1.0:1788838332.291382:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135190272 00000100:00100000:1.0:1788838332.291385:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135190272 00000100:00100000:1.0:1788838332.291409:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1788838332.291418:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135189888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.291477:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135189888:12345-0@lo:400:kworker.0 Request processed in 59us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.291486:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1788838332.291505:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1788838332.291511:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135189760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.291542:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135189760:12345-0@lo:400:kworker.0 Request processed in 31us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.291548:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1788838332.291560:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1788838332.291566:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135190272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.291593:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135190272:12345-0@lo:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.291610:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1788838332.291636:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135190400 00000100:00100000:1.0:1788838332.291640:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135190400 00000100:00100000:0.0:1788838332.291982:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135189632:0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.292047:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838332.292089:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135190144:0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.292114:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838332.292223:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135189248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838332.292337:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135189120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838332.292358:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135189504:0@lo:400:kworker.0 00000100:00100000:2.0:1788838332.292406:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838332.292421:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135190016:0@lo:400:kworker.0 00000100:00100000:2.0:1788838332.292483:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135189632 00000100:00100000:2.0:1788838332.292490:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135189632 00000100:00100000:2.0:1788838332.292528:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135189504 00000100:00100000:2.0:1788838332.292531:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135189504 00000100:00100000:2.0:1788838332.292550:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1788838332.292557:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135189632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838332.292603:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135189632:12345-0@lo:400:kworker.0 Request processed in 47us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838332.292609:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1788838332.292639:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1788838332.292647:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135189504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838332.292680:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135189504:12345-0@lo:400:kworker.0 Request processed in 34us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838332.292685:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00080000:2.0:1788838332.292701:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788838332.292706:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838332.292708:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838332.297954:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135190656:0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.297985:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135190144 00000100:00100000:1.0:1788838332.298004:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135190144 00000100:00100000:0.0:1788838332.298021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838332.298083:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135189632:0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.298127:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135190656 00000100:00100000:1.0:1788838332.298129:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:0.0:1788838332.298151:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135190656 00000100:00100000:1.0:1788838332.298159:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135190400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.298206:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1788838332.298219:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135190656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.298275:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135190400:12345-0@lo:400:kworker.0 Request processed in 132us (7170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.298285:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:0.0:1788838332.298299:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135190656:12345-0@lo:400:kworker.0 Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838332.298308:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1788838332.298314:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:1.0:1788838332.298325:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135190144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.298358:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135190656:0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.298398:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135190144:12345-0@lo:400:kworker.0 Request processed in 74us (6280us total) trans 0 rc 0/0 00000100:00080000:0.0:1788838332.298406:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838332.298413:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00100000:0.0:1788838332.298447:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135189760:0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.298463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135190272:0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.298477:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135189888:0@lo:400:kworker.0 00000100:00100000:1.0:1788838332.298516:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135190144:0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.298523:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135190400:0@lo:400:kworker.0 00000100:00100000:3.0:1788838332.300843:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838332.300949:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135190528:0@lo:400:kworker.0 00000100:00100000:3.0:1788838332.301016:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838332.301139:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135189504:0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.302594:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135190016 00000100:00100000:0.0:1788838332.302606:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135190016 00000100:00100000:0.0:1788838332.302790:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135190528 00000100:00100000:0.0:1788838332.302794:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135190528 00000100:00100000:0.0:1788838332.302836:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00100000:0.0:1788838332.302846:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135190016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.302920:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135190016:12345-0@lo:400:kworker.0 Request processed in 76us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838332.302927:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00100000:0.0:1788838332.302945:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:0.0:1788838332.302951:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135190528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838332.302980:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135190528:12345-0@lo:400:kworker.0 Request processed in 29us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838332.303000:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00080000:3.0:1788838332.303162:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838332.303167:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838332.303199:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135190016:0@lo:400:kworker.0 00000100:00100000:3.0:1788838332.303214:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135190528:0@lo:400:kworker.0 00010000:00010000:2.0:1788838332.477234:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838332.480867:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838332.480919:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838332.480955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838332.480989:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838332.481014:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838332.481084:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116479360 00000100:00100000:1.0:1788838332.481092:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116479360 00000100:00100000:1.0:1788838332.481147:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:1.0:1788838332.481157:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+8:2406:x1875729116479360:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838332.481225:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+8:2406:x1875729116479360:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 70us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.481233:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:2.0:1788838332.481661:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116479488 00000100:00100000:2.0:1788838332.481666:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116479488 00000100:00100000:2.0:1788838332.481724:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116479616 00000100:00100000:2.0:1788838332.481728:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116479616 00000100:00100000:2.0:1788838332.481754:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1442 00000100:00100000:2.0:1788838332.481761:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2406:x1875729116479488:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838332.481833:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2406:x1875729116479488:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838332.481858:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1442 00000100:00100000:2.0:1788838332.481872:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1443 00000100:00100000:2.0:1788838332.481878:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2406:x1875729116479616:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838332.481905:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2406:x1875729116479616:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838332.481912:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1443 00000100:00080000:0.0:1788838332.482013:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788838332.482017:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838332.482135:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116479744 00000100:00100000:3.0:1788838332.482140:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116479744 00000100:00100000:3.0:1788838332.482187:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116479872 00000100:00100000:3.0:1788838332.482191:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116479872 00000100:00100000:3.0:1788838332.482214:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2728 00000100:00100000:3.0:1788838332.482221:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116479744:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838332.482251:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2406:x1875729116479744:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838332.482257:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2728 00000100:00100000:3.0:1788838332.482271:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2729 00000100:00100000:3.0:1788838332.482277:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2406:x1875729116479872:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838332.482301:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2406:x1875729116479872:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838332.482306:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2729 00000100:00080000:0.0:1788838332.482476:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838332.482479:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838332.797815:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135190784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838332.797894:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838332.798849:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135190784 00000100:00100000:3.0:1788838332.798860:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135190784 00000100:00100000:3.0:1788838332.798921:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:3.0:1788838332.798931:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135190784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838332.798965:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838332.798969:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838332.798979:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135190912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838332.801005:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135190784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2068us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838332.801020:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1788838332.803948:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838332.804048:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135190784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838332.804169:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135190912 00000100:00100000:3.0:1788838332.804177:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135190912 00000100:00100000:3.0:1788838332.804239:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:3.0:1788838332.804247:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135190912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838332.804275:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838332.804340:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135190912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838332.804346:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:0.0:1788838332.804497:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135190912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788838332.860302:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838332.860411:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116480000 00000100:00100000:2.0:1788838332.860421:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116480000 00000100:00100000:2.0:1788838332.860481:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:2.0:1788838332.860501:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116480000:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838332.860518:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838332.860538:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e400/0x88da08396ccca280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cfee expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838332.860567:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e400/0x88da08396ccca280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfee expref: 9 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838332.860579:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e400/0x88da08396ccca280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfee expref: 9 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838332.860587:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e400, rc 0) 00000100:00100000:2.0:1788838332.861063:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116480000:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 562us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838332.861071:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:3.0:1788838332.862487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838332.862591:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116480128 00000100:00100000:1.0:1788838332.862600:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116480128 00000100:00100000:1.0:1788838332.862675:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:1.0:1788838332.862686:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116480128:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838332.862876:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116480128:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 190us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.862884:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:1.0:1788838332.872867:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838332.872969:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116480256 00000100:00100000:0.0:1788838332.872980:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116480256 00000100:00100000:0.0:1788838332.873040:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:0.0:1788838332.873050:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116480256:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838332.873197:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116480256:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 148us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838332.873206:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:3.0:1788838332.877118:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838332.877467:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116480384 00000100:00100000:1.0:1788838332.877477:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116480384 00000100:00100000:1.0:1788838332.877545:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:1.0:1788838332.877554:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+9:73305:x1875729116480384:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788838332.877720:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+9:73305:x1875729116480384:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 166us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.877728:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:3.0:1788838332.879971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838332.880048:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116480512 00000100:00100000:0.0:1788838332.880059:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116480512 00000100:00100000:0.0:1788838332.880115:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:0.0:1788838332.880124:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:73305:x1875729116480512:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788838332.880281:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:73305:x1875729116480512:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 156us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838332.880289:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:3.0:1788838332.884497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838332.884706:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116480640 00000100:00100000:1.0:1788838332.884716:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116480640 00000100:00100000:1.0:1788838332.884787:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:1.0:1788838332.884823:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116480640:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838332.884841:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838332.884861:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff509c6c800/0x88da08396ccca287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cff5 expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838332.884889:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff509c6c800/0x88da08396ccca287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cff5 expref: 10 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838332.884900:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff509c6c800/0x88da08396ccca287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cff5 expref: 10 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838332.884923:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6c800, rc 0) 00000100:00100000:1.0:1788838332.884981:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116480640:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 185us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.884988:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:3.0:1788838332.887745:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838332.887910:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116480768 00000100:00100000:0.0:1788838332.887919:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116480768 00000100:00100000:0.0:1788838332.887976:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:0.0:1788838332.887985:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116480768:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838332.888097:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116480768:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 113us (360us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788838332.888105:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 93 10000000:01000000:2.0:1788838332.988916:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788838332.988923:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff50a9bc000 from 58 10000000:01000000:2.0:1788838332.988949:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788838332.989010:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838332.989022:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838332.989032:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838332.989060:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838332.989135:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838332.989188:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838332.989356:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135191040 00000100:00100000:1.0:1788838332.989376:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135191040 00000100:00100000:1.0:1788838332.989431:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788838332.989441:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135191040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838332.989454:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838332.989468:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff509c6da00/0x88da08396ccca295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca28e expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838332.989491:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff509c6da00/0x88da08396ccca295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca28e expref: 16 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838332.989502:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff509c6da00/0x88da08396ccca295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca28e expref: 16 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838332.989510:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6da00, rc 0) 00000100:00100000:1.0:1788838332.989556:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135191040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.989563:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788838332.989869:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838332.989885:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838332.989894:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838332.989959:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838332.990005:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838332.990041:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788838332.990226:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135191168 00000100:00100000:1.0:1788838332.990232:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135191168 00000100:00100000:1.0:1788838332.990266:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788838332.990274:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135191168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838332.990481:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135191168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.990489:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788838332.990579:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838332.990612:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838332.990673:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838332.990694:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503684f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838332.990880:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135191296 00000100:00100000:1.0:1788838332.990885:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135191296 00000100:00100000:1.0:1788838332.990921:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788838332.990929:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135191296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838332.991237:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135191296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 309us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838332.991245:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788838332.992140:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838332.992638:0:95315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95315:1875729135191424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838332.993856:0:95315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838332.994158:0:95315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503684e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838333.002436:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135191424 00000100:00100000:2.0:1788838333.002455:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135191424 00000100:00100000:2.0:1788838333.002523:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788838333.002533:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:95315:x1875729135191424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838333.002932:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:95315:x1875729135191424:12345-0@lo:502:llog_process_th.0 Request processed in 399us (9077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838333.002949:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788838333.003233:0:95315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95315:1875729135191424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838333.003308:0:95315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95315:1875729135191552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838333.003352:0:95315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838333.003389:0:95315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503684e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838333.003444:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135191552 00000100:00100000:2.0:1788838333.003449:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135191552 00000100:00100000:2.0:1788838333.003529:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788838333.003538:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:95315:x1875729135191552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838333.003823:0:95315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95315:1875729135191552:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788838333.003845:0:95315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000100:00100000:2.0:1788838333.004025:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:95315:x1875729135191552:12345-0@lo:502:llog_process_th.0 Request processed in 488us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838333.004032:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000020:01000000:1.0:1788838333.004093:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1788838333.004160:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838333.004172:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.004183:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838333.004193:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788838333.004196:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:1.0:1788838333.004199:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788838333.004226:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.004234:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.004243:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838333.004279:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.004312:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.010445:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b7e1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.011833:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135191680 00000100:00100000:3.0:1788838333.011847:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135191680 00000100:00100000:3.0:1788838333.011923:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788838333.011932:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135191680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838333.011948:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838333.011966:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50f3eea00/0x88da08396ccca2a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca29c expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.011994:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50f3eea00/0x88da08396ccca2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca29c expref: 17 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.012006:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50f3eea00/0x88da08396ccca2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca29c expref: 17 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.012015:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3eea00, rc 0) 00000100:00100000:3.0:1788838333.012090:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135191680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (7776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.012097:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788838333.012137:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838333.012168:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.012179:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838333.012447:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.012486:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.012526:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b7e1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.014305:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135191808 00000100:00100000:3.0:1788838333.014318:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135191808 00000100:00100000:3.0:1788838333.014380:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788838333.014391:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135191808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.014563:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135191808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.014590:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788838333.014644:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.014690:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.014738:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838333.014766:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.014790:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135191936 00000100:00100000:3.0:1788838333.014794:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135191936 00000100:00100000:3.0:1788838333.014836:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788838333.014842:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135191936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.014921:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135191936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.014928:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788838333.014969:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135191936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838333.017897:0:95316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95316:1875729135192064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838333.017993:0:95316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838333.018040:0:95316:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.018168:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135192064 00000100:00100000:3.0:1788838333.018176:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135192064 00000100:00100000:3.0:1788838333.018226:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788838333.018236:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:95316:x1875729135192064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838333.018374:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:95316:x1875729135192064:12345-0@lo:502:llog_process_th.0 Request processed in 139us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.018382:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788838333.018516:0:95316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95316:1875729135192064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838333.018546:0:95316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838333.018556:0:95316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838333.018559:0:95316:0:(obd_config.c:1563:class_process_config()) marker 44 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1788838333.018564:0:95316:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1788838333.018581:0:95316:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:1.0:1788838333.019157:0:95316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95316:1875729135192192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.019212:0:95316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.019247:0:95316:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b7e1a80 going to sleep for 11 seconds 00000020:01000004:2.0:1788838333.019317:0:95317:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff50a9bc000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788838333.019321:0:95317:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff50a9bc000 4 00000100:00100000:0.0:1788838333.022112:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135192192 00000100:00100000:0.0:1788838333.022127:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135192192 00000100:00100000:0.0:1788838333.022239:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788838333.022249:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:95316:x1875729135192192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838333.022439:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:95316:x1875729135192192:12345-0@lo:502:llog_process_th.0 Request processed in 192us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838333.022448:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788838333.022548:0:95316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95316:1875729135192192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838333.022586:0:95316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838333.022594:0:95316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838333.022597:0:95316:0:(obd_config.c:1563:class_process_config()) marker 44 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1788838333.022601:0:95316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:3.0:1788838333.022937:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:3.0:1788838333.022989:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788838333.022999:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.023024:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838333.023034:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788838333.023037:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff503592800 from 58 10000000:01000000:3.0:1788838333.023040:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788838333.023069:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.023076:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.023085:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838333.023104:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135192320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.023146:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838333.023181:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503684f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788838333.023229:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135192320 00000100:00100000:2.0:1788838333.023234:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135192320 00000100:00100000:2.0:1788838333.023278:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788838333.023286:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135192320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838333.023297:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838333.023308:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e600/0x88da08396ccca2b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca2aa expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838333.023330:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e600/0x88da08396ccca2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca2aa expref: 18 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838333.023341:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e600/0x88da08396ccca2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2aa expref: 18 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838333.023350:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e600, rc 0) 00000100:00100000:2.0:1788838333.023392:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135192320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838333.023399:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788838333.023564:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135192320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838333.023578:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838333.023597:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838333.023715:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135192448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838333.023747:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838333.023867:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60573f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.024143:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135192448 00000100:00100000:3.0:1788838333.024149:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135192448 00000100:00100000:3.0:1788838333.024217:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788838333.024226:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135192448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.024352:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135192448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.024359:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788838333.024448:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135192448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838333.024483:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135192576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838333.024525:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838333.024553:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838333.024564:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135192576 00000100:00100000:0.0:1788838333.024570:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135192576 00000100:00100000:0.0:1788838333.024600:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788838333.024606:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135192576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838333.024943:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135192576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 337us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838333.024950:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788838333.029885:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135192576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838333.032491:0:95318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95318:1875729135192704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838333.032580:0:95318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838333.032634:0:95318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff50255b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838333.033014:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135192704 00000100:00100000:0.0:1788838333.033022:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135192704 00000100:00100000:0.0:1788838333.033080:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788838333.033089:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:95318:x1875729135192704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838333.033238:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:95318:x1875729135192704:12345-0@lo:502:llog_process_th.0 Request processed in 149us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838333.033246:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788838333.033389:0:95318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95318:1875729135192704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.033440:0:95318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95318:1875729135192832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.033478:0:95318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.033511:0:95318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b7e1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.033899:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135192832 00000100:00100000:3.0:1788838333.033905:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135192832 00000100:00100000:3.0:1788838333.033946:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788838333.033961:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:95318:x1875729135192832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838333.034057:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:95318:x1875729135192832:12345-0@lo:502:llog_process_th.0 Request processed in 96us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.034065:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788838333.034156:0:95318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95318:1875729135192832:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788838333.034182:0:95318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1788838333.036144:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1788838333.036182:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788838333.036194:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.036207:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838333.036218:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788838333.036221:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1788838333.036224:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788838333.036266:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.036274:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.036283:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838333.036304:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135192960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.036366:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838333.036413:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62ce34b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838333.036484:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135192960 00000100:00100000:0.0:1788838333.036491:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135192960 00000100:00100000:0.0:1788838333.036541:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788838333.036551:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135192960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838333.036563:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838333.036587:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601528e00/0x88da08396ccca2bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca2b8 expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838333.036610:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601528e00/0x88da08396ccca2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca2b8 expref: 19 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838333.036621:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601528e00/0x88da08396ccca2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2b8 expref: 19 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838333.036630:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528e00, rc 0) 00000100:00100000:0.0:1788838333.036756:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135192960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838333.036763:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788838333.036900:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135192960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838333.036922:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.036932:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838333.036995:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135193088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.037027:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.037047:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b7e1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.037550:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135193088 00000100:00100000:3.0:1788838333.037556:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135193088 00000100:00100000:3.0:1788838333.037604:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788838333.037612:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135193088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.037892:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135193088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.037899:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788838333.037986:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135193088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.038021:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135193216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.038060:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.038082:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b7e1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838333.038138:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135193216 00000100:00100000:0.0:1788838333.038143:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135193216 00000100:00100000:0.0:1788838333.038175:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788838333.038183:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135193216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838333.038262:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135193216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838333.038270:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788838333.038308:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135193216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838333.038476:0:95319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95319:1875729135193344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838333.038509:0:95319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838333.038522:0:95319:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.038572:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135193344 00000100:00100000:1.0:1788838333.038576:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135193344 00000100:00100000:1.0:1788838333.038605:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788838333.038612:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+19:95319:x1875729135193344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.038704:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+19:95319:x1875729135193344:12345-0@lo:502:llog_process_th.0 Request processed in 92us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.038712:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788838333.038748:0:95319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95319:1875729135193344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788838333.038781:0:95319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788838333.038792:0:95319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838333.038794:0:95319:0:(obd_config.c:1563:class_process_config()) marker 45 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1788838333.038825:0:95319:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1788838333.038840:0:95319:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:1.0:1788838333.038864:0:95319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95319:1875729135193472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.038894:0:95319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.038912:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135193472 00000100:00100000:1.0:1788838333.038916:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135193472 00000100:00100000:1.0:1788838333.038932:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788838333.038937:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+19:95319:x1875729135193472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.038991:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+19:95319:x1875729135193472:12345-0@lo:502:llog_process_th.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.038998:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788838333.039038:0:95319:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60b7e1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.039050:0:95319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95319:1875729135193472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788838333.039066:0:95319:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788838333.039070:0:95319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788838333.039072:0:95319:0:(obd_config.c:1563:class_process_config()) marker 45 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1788838333.039075:0:95319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:0.0:1788838333.039613:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:0.0:1788838333.040364:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788838333.040376:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838333.040399:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838333.040410:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788838333.040412:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff63f7ce800 from 58 10000000:01000000:0.0:1788838333.040416:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788838333.040447:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838333.040455:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838333.040463:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838333.040481:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135193600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838333.040527:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838333.040552:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.040638:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135193600 00000100:00100000:3.0:1788838333.040644:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135193600 00000100:00100000:3.0:1788838333.040699:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788838333.040707:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135193600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838333.040718:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838333.040729:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50f3ee000/0x88da08396ccca2cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca2c6 expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.040751:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50f3ee000/0x88da08396ccca2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca2c6 expref: 20 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.040760:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50f3ee000/0x88da08396ccca2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2c6 expref: 20 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.040768:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ee000, rc 0) 00000100:00100000:3.0:1788838333.040834:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135193600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.040840:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788838333.041788:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135193600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838333.041833:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838333.041843:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838333.041908:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135193728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838333.041944:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838333.041980:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.042062:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135193728 00000100:00100000:1.0:1788838333.042067:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135193728 00000100:00100000:1.0:1788838333.042099:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788838333.042106:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135193728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.042215:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135193728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.042223:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788838333.042563:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135193728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838333.042593:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135193856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838333.042633:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838333.043127:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135193856 00000100:00100000:3.0:1788838333.043134:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135193856 00000100:00100000:3.0:1788838333.043174:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788838333.043182:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135193856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838333.043334:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.045187:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135193856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1997us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.045212:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788838333.045315:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135193856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.045740:0:95320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95320:1875729135193984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838333.045974:0:95320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838333.046046:0:95320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947780 going to sleep for 11 seconds 00000100:00100000:0.0:1788838333.046083:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135193984 00000100:00100000:0.0:1788838333.046089:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135193984 00000100:00100000:0.0:1788838333.046155:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788838333.046164:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:95320:x1875729135193984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838333.046281:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:95320:x1875729135193984:12345-0@lo:502:llog_process_th.0 Request processed in 117us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838333.046289:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788838333.046358:0:95320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95320:1875729135193984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838333.046403:0:95320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95320:1875729135194112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838333.046436:0:95320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838333.046501:0:95320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947780 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.046559:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135194112 00000100:00100000:1.0:1788838333.046564:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135194112 00000100:00100000:1.0:1788838333.046595:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788838333.046602:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+20:95320:x1875729135194112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.046841:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+20:95320:x1875729135194112:12345-0@lo:502:llog_process_th.0 Request processed in 239us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.046849:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788838333.046918:0:95320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95320:1875729135194112:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788838333.046938:0:95320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1788838333.047381:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1788838333.047425:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838333.047434:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.047446:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838333.047456:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788838333.047459:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788838333.047462:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788838333.047488:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.047496:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.047506:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838333.047522:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.047554:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.047588:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503623900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.047630:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135194240 00000100:00100000:3.0:1788838333.047635:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135194240 00000100:00100000:3.0:1788838333.047679:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788838333.047687:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135194240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838333.047698:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838333.047709:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50f3ef200/0x88da08396ccca2db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca2d4 expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.047730:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50f3ef200/0x88da08396ccca2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca2d4 expref: 21 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.047740:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50f3ef200/0x88da08396ccca2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2d4 expref: 21 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.047749:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ef200, rc 0) 00000100:00100000:3.0:1788838333.047794:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135194240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.047835:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788838333.047870:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838333.047885:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.047894:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838333.047943:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.047967:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838333.047979:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.047990:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135194368 00000100:00100000:3.0:1788838333.047993:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135194368 00000100:00100000:3.0:1788838333.048009:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788838333.048015:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a3cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135194368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.048109:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a3cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135194368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.048116:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788838333.048143:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.048166:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.048201:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838333.048214:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947900 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.048226:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135194496 00000100:00100000:3.0:1788838333.048229:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135194496 00000100:00100000:3.0:1788838333.048252:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788838333.048263:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5056c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135194496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.048341:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5056c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135194496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838333.048348:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788838333.048386:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788838333.049029:0:95321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788838333.049079:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788838333.049094:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788838333.049102:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.049112:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838333.049121:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788838333.049123:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627f9a800 from 58 10000000:01000000:3.0:1788838333.049125:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788838333.050304:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.050318:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.050329:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838333.050354:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.050437:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838333.050501:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504947f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.050616:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135194624 00000100:00100000:1.0:1788838333.050624:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135194624 00000100:00100000:1.0:1788838333.050684:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788838333.050702:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135194624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838333.050717:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838333.050728:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca2e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca2e2 expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.050752:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca2e2 expref: 22 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.050762:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2e2 expref: 22 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.050780:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6d000, rc 0) 00000100:00100000:1.0:1788838333.050840:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135194624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.050846:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788838333.050890:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838333.050904:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.050911:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838333.050971:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.051001:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.051019:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036ded80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.051030:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135194752 00000100:00100000:1.0:1788838333.051034:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135194752 00000100:00100000:1.0:1788838333.051052:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788838333.051064:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135194752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.051173:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135194752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.051180:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788838333.051209:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.051238:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.051276:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.051290:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036ded80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.051301:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135194880 00000100:00100000:1.0:1788838333.051304:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135194880 00000100:00100000:1.0:1788838333.051321:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788838333.051326:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135194880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.051402:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135194880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.051408:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788838333.051445:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135194880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.051608:0:95322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95322:1875729135195008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.051641:0:95322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.051659:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135195008 00000100:00100000:1.0:1788838333.051663:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135195008 00000100:00100000:1.0:1788838333.051681:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788838333.051686:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:95322:x1875729135195008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.051760:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:95322:x1875729135195008:12345-0@lo:502:llog_process_th.0 Request processed in 73us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.051791:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788838333.051852:0:95322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036de0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.051865:0:95322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95322:1875729135195008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.051909:0:95322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95322:1875729135195136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.051943:0:95322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.051961:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135195136 00000100:00100000:1.0:1788838333.051964:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135195136 00000100:00100000:1.0:1788838333.051982:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788838333.051988:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:95322:x1875729135195136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838333.052045:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:95322:x1875729135195136:12345-0@lo:502:llog_process_th.0 Request processed in 57us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.052052:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788838333.052080:0:95322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036de0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.052092:0:95322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95322:1875729135195136:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788838333.052111:0:95322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1788838333.052165:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1788838333.052184:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788838333.052192:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.052202:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838333.052211:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788838333.052215:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788838333.052218:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788838333.052242:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.052250:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.052259:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838333.052271:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135195264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.052296:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.052310:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036de0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.052322:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135195264 00000100:00100000:1.0:1788838333.052325:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135195264 00000100:00100000:1.0:1788838333.052341:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788838333.052346:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135195264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838333.052354:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838333.052363:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca2f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca2f0 expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.052380:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca2f0 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.052390:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2f0 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.052399:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6c400, rc 0) 00000100:00100000:1.0:1788838333.052423:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135195264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.052429:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788838333.052462:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135195264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838333.052472:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.052481:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838333.052517:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135195392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.052539:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.052550:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036de0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.052560:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135195392 00000100:00100000:1.0:1788838333.052564:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135195392 00000100:00100000:1.0:1788838333.052578:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788838333.052583:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135195392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.052660:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135195392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.052667:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788838333.052691:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135195392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.052712:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135195520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.052743:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.052754:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036de0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838333.052765:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135195520 00000100:00100000:1.0:1788838333.052768:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135195520 00000100:00100000:1.0:1788838333.052819:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788838333.052825:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135195520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.052913:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135195520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.052925:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788838333.052957:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135195520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788838333.054483:0:95323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788838333.054643:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788838333.054730:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788838333.054742:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.054754:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838333.054765:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788838333.054768:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ff610244d28 from 1 10000000:01000000:1.0:1788838333.054780:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788838333.055041:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.055050:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.055060:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838333.055081:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135195648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.055133:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.055209:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036de0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838333.055250:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135195648 00000100:00100000:2.0:1788838333.055256:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135195648 00000100:00100000:2.0:1788838333.055337:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788838333.055347:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135195648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838333.055359:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838333.055370:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e800/0x88da08396ccca305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca2fe expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838333.055391:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e800/0x88da08396ccca305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca2fe expref: 24 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838333.055401:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e800/0x88da08396ccca305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2fe expref: 24 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838333.055410:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e800, rc 0) 00000100:00100000:2.0:1788838333.055456:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135195648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838333.055463:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788838333.055524:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135195648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838333.055537:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.055553:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838333.055608:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135195776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838333.055633:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.055701:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036de0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838333.057030:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135195776 00000100:00100000:3.0:1788838333.057042:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135195776 00000100:00100000:3.0:1788838333.057104:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788838333.057114:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135195776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838333.057221:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135195776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (1586us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788838333.057241:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788838333.057352:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135195776:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788838333.057423:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788838333.057435:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838333.057446:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838333.502140:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838333.821098:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135195904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838333.821180:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838333.821318:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135195904 00000100:00100000:1.0:1788838333.821327:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135195904 00000100:00100000:1.0:1788838333.821379:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:1.0:1788838333.821390:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135195904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838333.821410:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838333.821454:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135195904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838333.821461:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00100000:3.0:1788838333.821541:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135195904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838333.822005:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838333.822016:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135196032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788838333.822049:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838333.822151:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135196032 00000100:00100000:2.0:1788838333.822157:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135196032 00000100:00100000:2.0:1788838333.822197:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:2.0:1788838333.822205:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135196032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838333.822219:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838333.822265:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135196032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838333.822271:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:3.0:1788838333.822417:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135196032:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788838334.528086:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838335.156230:0:95421:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff601bfee0 20000000:00000080:1.0:1788838335.156247:0:95421:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8ff604985c00 uarg=0000000000000000 00000040:00100000:1.0:1788838335.157031:0:95421:0:(llog.c:1072:llog_reverse_process()) index 60 : idx 49 20000000:01000000:1.0:1788838335.157039:0:95421:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:1.0:1788838335.157065:0:95421:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:3.0:1788838335.157523:0:95422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 39 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:3.0:1788838335.157566:0:95422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 54 marker 39 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:3.0:1788838335.157584:0:95422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:1.0:1788838335.157988:0:95421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:1.0:1788838335.158005:0:95421:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1788838335.158022:0:95421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:1.0:1788838335.158038:0:95421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:1.0:1788838335.158052:0:95421:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:3.0:1788838335.158373:0:95423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 40 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:3.0:1788838335.158400:0:95423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 40 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:3.0:1788838335.158415:0:95423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:1.0:1788838335.160938:0:95421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:1.0:1788838335.160962:0:95421:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1788838335.160982:0:95421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:1.0:1788838335.161001:0:95421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:1.0:1788838335.161021:0:95421:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:3.0:1788838335.161521:0:95424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 41 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:3.0:1788838335.161555:0:95424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 41 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:3.0:1788838335.161573:0:95424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:1.0:1788838335.161989:0:95421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:1.0:1788838335.162002:0:95421:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1788838335.162019:0:95421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:1.0:1788838335.162037:0:95421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:1.0:1788838335.162049:0:95421:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788838335.162069:0:95421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162088:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff60148e400/0x88da08396ccca280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfee expref: 9 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162096:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff509c6c800/0x88da08396ccca287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cff5 expref: 9 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162104:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff509c6da00/0x88da08396ccca295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca28e expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162110:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50f3eea00/0x88da08396ccca2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca29c expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162130:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff60148e600/0x88da08396ccca2b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2aa expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162137:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff601528e00/0x88da08396ccca2bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2b8 expref: 23 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162143:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50f3ee000/0x88da08396ccca2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2c6 expref: 23 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162151:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50f3ef200/0x88da08396ccca2db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2d4 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162158:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca2e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2e2 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162165:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca2f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2f0 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162171:0:95421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff60148e800/0x88da08396ccca305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca2fe expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162179:0:95421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162217:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff60148e800/0x88da08396ccca305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccca2fe expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162232:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff60148e800/0x88da08396ccca305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccca2fe expref: 23 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.162392:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135196160:0@lo:104: 00000100:00100000:1.0:1788838335.162457:0:95421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788838335.162554:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccca2f0 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162564:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca2f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccca2f0 expref: 23 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.162573:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640669c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135196288:0@lo:104: 00000100:00100000:1.0:1788838335.162596:0:95421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788838335.162764:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccca2e2 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.162773:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccca2e2 expref: 23 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.162782:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135196416:0@lo:104: 00000100:00100000:1.0:1788838335.162834:0:95421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838335.162978:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135196160 00000100:00100000:0.0:1788838335.162985:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135196160 00000100:00100000:0.0:1788838335.163054:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788838335.163063:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:95421:x1875729135196160:12345-0@lo:104: 00010000:00010000:0.0:1788838335.163075:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.163124:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788838335.163130:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:95421:x1875729135196160:12345-0@lo:104: Request processed in 69us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838335.163136:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788838335.163154:0:10414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135196288 00000100:00100000:0.0:1788838335.163164:0:10414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135196288 00010000:00010000:1.0:1788838335.163397:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50f3ef200/0x88da08396ccca2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccca2d4 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.163407:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50f3ef200/0x88da08396ccca2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccca2d4 expref: 23 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.163416:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135196544:0@lo:104: 00000100:00100000:1.0:1788838335.163438:0:95421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.163465:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135196416 00000100:00100000:2.0:1788838335.163469:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135196416 00000100:00100000:2.0:1788838335.163490:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788838335.163496:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+4:95421:x1875729135196288:12345-0@lo:104: 00010000:00010000:2.0:1788838335.163511:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163546:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788838335.163550:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+4:95421:x1875729135196288:12345-0@lo:104: Request processed in 55us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.163556:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788838335.163568:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788838335.163573:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+3:95421:x1875729135196416:12345-0@lo:104: 00010000:00010000:2.0:1788838335.163579:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163604:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788838335.163608:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+3:95421:x1875729135196416:12345-0@lo:104: Request processed in 36us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.163614:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:2.0:1788838335.163627:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838335.163633:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163650:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d800 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838335.163655:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163663:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838335.163671:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838335.163682:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838335.163714:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163721:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838335.163740:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163748:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396ccca2fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca305 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163770:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838335.163773:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163778:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6c200 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838335.163781:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163787:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838335.163792:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838335.163818:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838335.163832:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163838:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838335.163851:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163858:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c200/0x88da08396ccca2f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2f7 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163869:0:6535:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838335.163871:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163877:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3eee00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838335.163879:0:6535:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163885:0:6535:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838335.163890:0:6535:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838335.163896:0:6535:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838335.163908:0:6535:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163915:0:6535:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838335.163930:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163937:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eee00/0x88da08396ccca2e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2e9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.163945:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838335.163952:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838335.163954:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838335.163961:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838335.163974:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135196672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.164002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.164026:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838335.164032:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135196800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.164051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.164078:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135196928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.164101:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.164132:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135196672 00000100:00100000:2.0:1788838335.164137:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135196672 00010000:00010000:2.0:1788838335.164156:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff60148e800/0x88da08396ccca305 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2fe expref: 24 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838335.164176:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135196800 00000100:00100000:2.0:1788838335.164178:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135196800 00010000:00010000:2.0:1788838335.164196:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca2f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2f0 expref: 25 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838335.164214:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135196928 00000100:00100000:2.0:1788838335.164217:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135196928 00010000:00010000:2.0:1788838335.164229:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca2e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2e2 expref: 26 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.164233:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838335.164431:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:2.0:1788838335.164440:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+26:3645:x1875729135196672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838335.164450:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838335.164456:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff60148e800/0x88da08396ccca305 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2fe expref: 26 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.164473:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff60148e800/0x88da08396ccca305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccca2fe expref: 26 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.164489:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838335.164531:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+26:3645:x1875729135196672:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.164537:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:2.0:1788838335.164552:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:2.0:1788838335.164559:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+25:3645:x1875729135196800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838335.164567:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838335.164572:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca2f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2f0 expref: 25 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.164581:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca2f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccca2f0 expref: 25 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.164591:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838335.164613:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+25:3645:x1875729135196800:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.164618:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:2.0:1788838335.164630:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:2.0:1788838335.164649:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135196928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838335.164658:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838335.164663:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca2e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2e2 expref: 24 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.164671:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccca2e2 expref: 24 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.164691:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838335.164706:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135196800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838335.164720:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135196672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.164726:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135196928:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.164734:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:2.0:1788838335.164841:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135196928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788838335.165189:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50f3ee000/0x88da08396ccca2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccca2c6 expref: 23 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.165210:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50f3ee000/0x88da08396ccca2cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccca2c6 expref: 23 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.165220:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197056:0@lo:104: 00000100:00100000:1.0:1788838335.165378:0:95421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788838335.165495:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff601528e00/0x88da08396ccca2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccca2b8 expref: 23 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.165505:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff601528e00/0x88da08396ccca2bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccca2b8 expref: 23 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.165513:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197184:0@lo:104: 00010000:00010000:1.0:1788838335.165541:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff60148e600/0x88da08396ccca2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccca2aa expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.165549:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff60148e600/0x88da08396ccca2b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccca2aa expref: 23 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.165556:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197312:0@lo:104: 00010000:00010000:1.0:1788838335.165581:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50f3eea00/0x88da08396ccca2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccca29c expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.165590:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50f3eea00/0x88da08396ccca2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccca29c expref: 23 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.165598:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197440:0@lo:104: 00010000:00010000:1.0:1788838335.165623:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff509c6da00/0x88da08396ccca295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccca28e expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.165710:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff509c6da00/0x88da08396ccca295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccca28e expref: 23 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.165720:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197568:0@lo:104: 00010000:00010000:1.0:1788838335.165752:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff509c6c800/0x88da08396ccca287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cff5 expref: 9 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.165770:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff509c6c800/0x88da08396ccca287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cff5 expref: 9 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.165779:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197696:192.168.203.30@tcp:104: 00010000:00010000:1.0:1788838335.166007:0:95421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff60148e400/0x88da08396ccca280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfee expref: 9 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.166016:0:95421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff60148e400/0x88da08396ccca280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfee expref: 9 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.166025:0:95421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197824:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788838335.166050:0:95421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aec00 going to sleep for 11 seconds 00010000:00010000:1.0:1788838335.166067:0:95421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148e800/0x88da08396ccca305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccca2fe expref: 23 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.166078:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135196160:0@lo:104: 00010000:00010000:1.0:1788838335.166088:0:95421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca2f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccca2f0 expref: 22 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.166097:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640669c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135196288:0@lo:104: 00010000:00010000:1.0:1788838335.166115:0:95421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca2e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccca2e2 expref: 21 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.166124:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135196416:0@lo:104: 00000100:00100000:1.0:1788838335.168909:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197696:192.168.203.30@tcp:104: 00000100:00100000:1.0:1788838335.168922:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e64a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197824:192.168.203.30@tcp:104: 00000100:00100000:2.0:1788838335.169382:0:6529:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788838335.169412:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.169445:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.169456:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.169465:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.169474:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135196544 00000100:00100000:2.0:1788838335.169481:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135196544 00000100:00100000:2.0:1788838335.169524:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135197056 00000100:00100000:2.0:1788838335.169527:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135197056 00000100:00100000:2.0:1788838335.169536:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135197184 00000100:00100000:2.0:1788838335.169538:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135197184 00000100:00100000:2.0:1788838335.169545:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135197312 00000100:00100000:2.0:1788838335.169546:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135197312 00000100:00100000:2.0:1788838335.169554:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135197440 00000100:00100000:2.0:1788838335.169556:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135197440 00000100:00100000:2.0:1788838335.169563:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135197568 00000100:00100000:2.0:1788838335.169565:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135197568 00000100:00100000:2.0:1788838335.169577:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788838335.169585:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:95421:x1875729135196544:12345-0@lo:104: 00010000:00010000:2.0:1788838335.169600:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.169672:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788838335.169678:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+8:95421:x1875729135196544:12345-0@lo:104: Request processed in 94us (6239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.169698:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788838335.169715:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788838335.169722:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:95421:x1875729135197056:12345-0@lo:104: 00010000:00010000:2.0:1788838335.169730:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.169777:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788838335.169782:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+7:95421:x1875729135197056:12345-0@lo:104: Request processed in 61us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.169787:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788838335.169840:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788838335.169847:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+6:95421:x1875729135197184:12345-0@lo:104: 00010000:00010000:2.0:1788838335.169855:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.169888:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788838335.169894:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+6:95421:x1875729135197184:12345-0@lo:104: Request processed in 48us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.169899:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788838335.169910:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788838335.169916:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:95421:x1875729135197312:12345-0@lo:104: 00010000:00010000:2.0:1788838335.169922:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.169952:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788838335.169957:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+5:95421:x1875729135197312:12345-0@lo:104: Request processed in 42us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.169968:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788838335.169978:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788838335.169984:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+4:95421:x1875729135197440:12345-0@lo:104: 00010000:00010000:2.0:1788838335.169991:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170016:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788838335.170020:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+4:95421:x1875729135197440:12345-0@lo:104: Request processed in 37us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.170026:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788838335.170036:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788838335.170041:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+3:95421:x1875729135197568:12345-0@lo:104: 00010000:00010000:2.0:1788838335.170047:0:6529:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170069:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788838335.170074:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+3:95421:x1875729135197568:12345-0@lo:104: Request processed in 34us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.170079:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00010000:00010000:2.0:1788838335.170097:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788838335.170102:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170110:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6de00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838335.170114:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170133:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838335.170140:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838335.170146:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838335.170186:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170192:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838335.170211:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170218:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff509c6de00/0x88da08396ccca2d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2db expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170232:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788838335.170235:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170241:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838335.170244:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170251:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838335.170413:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135196544:0@lo:104: 00000100:00100000:1.0:1788838335.170422:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197056:0@lo:104: 00000100:00100000:1.0:1788838335.170428:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197184:0@lo:104: 00000100:00100000:1.0:1788838335.170435:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197312:0@lo:104: 00000100:00100000:1.0:1788838335.170441:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197440:0@lo:104: 00000100:00100000:1.0:1788838335.170448:0:95421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95421:1875729135197568:0@lo:104: 00010000:00010000:1.0:1788838335.170492:0:95421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838335.170538:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838335.170549:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838335.170566:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170572:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788838335.170614:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135198080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838335.170663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788838335.170707:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170714:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff601529600/0x88da08396ccca2c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2cd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170725:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788838335.170729:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170734:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3efa00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838335.170737:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170744:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838335.170750:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838335.170755:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838335.170779:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.170784:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788838335.171213:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788838335.171221:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135198208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838335.171348:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788838335.171418:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171426:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50f3efa00/0x88da08396ccca2b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2bf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171436:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788838335.171439:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171446:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3ee800 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838335.171449:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171456:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838335.171462:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838335.171467:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838335.171483:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171488:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838335.171495:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171501:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee800/0x88da08396ccca2aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2b1 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171510:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788838335.171519:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171525:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6c600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838335.171528:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171534:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838335.171540:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838335.171544:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838335.171556:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171561:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838335.171566:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171572:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c600/0x88da08396ccca29c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca2a3 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171583:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838335.171586:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171591:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148f600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838335.171594:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171609:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838335.171615:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838335.171620:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788838335.171633:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171650:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838335.171656:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171662:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca28e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccca295 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.171677:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838335.171679:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838335.171681:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838335.171693:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135197952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.171719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.171738:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135198464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.171770:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.171787:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838335.171793:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135198336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.171834:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.171862:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135198080 00000100:00100000:2.0:1788838335.171873:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135198080 00010000:00010000:2.0:1788838335.171899:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50f3ee000/0x88da08396ccca2cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2c6 expref: 21 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838335.171922:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135198208 00000100:00100000:2.0:1788838335.171924:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135198208 00010000:00010000:2.0:1788838335.171935:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff601528e00/0x88da08396ccca2bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2b8 expref: 22 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838335.171945:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135197952 00000100:00100000:2.0:1788838335.171947:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135197952 00010000:00010000:2.0:1788838335.171954:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50f3ef200/0x88da08396ccca2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2d4 expref: 23 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838335.171962:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135198464 00000100:00100000:2.0:1788838335.171964:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135198464 00010000:00010000:2.0:1788838335.171972:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50f3eea00/0x88da08396ccca2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca29c expref: 24 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838335.171981:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135198336 00000100:00100000:2.0:1788838335.171983:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135198336 00010000:00010000:2.0:1788838335.171991:0:26219:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff60148e600/0x88da08396ccca2b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2aa expref: 25 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838335.172002:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1788838335.172009:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+25:3645:x1875729135198080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838335.172020:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838335.172025:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50f3ee000/0x88da08396ccca2cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2c6 expref: 25 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172035:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50f3ee000/0x88da08396ccca2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccca2c6 expref: 25 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172059:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50f3ee000/0x88da08396ccca2cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccca2c6 expref: 25 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172377:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838335.172410:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135198080:12345-0@lo:103:ldlm_bl.0 Request processed in 400us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.172417:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1788838335.172436:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:2.0:1788838335.172444:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3645:x1875729135198208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838335.172452:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838335.172457:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff601528e00/0x88da08396ccca2bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2b8 expref: 23 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172466:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff601528e00/0x88da08396ccca2bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccca2b8 expref: 23 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172476:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601528e00/0x88da08396ccca2bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccca2b8 expref: 23 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172486:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838335.172507:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3645:x1875729135198208:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.172513:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:2.0:1788838335.172524:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1788838335.172529:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3644:x1875729135197952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838335.172536:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838335.172540:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50f3ef200/0x88da08396ccca2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2d4 expref: 21 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172554:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50f3ef200/0x88da08396ccca2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccca2d4 expref: 21 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172564:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50f3ef200/0x88da08396ccca2db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccca2d4 expref: 21 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172572:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838335.172599:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+20:3644:x1875729135197952:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.172605:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1788838335.172616:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1788838335.172622:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+19:3644:x1875729135198464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838335.172629:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838335.172644:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50f3eea00/0x88da08396ccca2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca29c expref: 19 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172653:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50f3eea00/0x88da08396ccca2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccca29c expref: 19 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172663:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50f3eea00/0x88da08396ccca2a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccca29c expref: 19 pid: 94395 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172671:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838335.172692:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+18:3644:x1875729135198464:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.172697:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1788838335.172709:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1788838335.172715:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+17:3644:x1875729135198336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838335.172729:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838335.172733:0:26219:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff60148e600/0x88da08396ccca2b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca2aa expref: 17 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172742:0:26219:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff60148e600/0x88da08396ccca2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccca2aa expref: 17 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172751:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148e600/0x88da08396ccca2b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccca2aa expref: 17 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.172770:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838335.172792:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:57943c9a-ca27-46d8-8845-5d2bce640e45+16:3644:x1875729135198336:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.172818:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1788838335.172853:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135198336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.172861:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135197952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.172867:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135198464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.172891:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788838335.172898:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135198592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838335.172922:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838335.172945:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135198592 00000100:00100000:2.0:1788838335.172948:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135198592 00010000:00010000:2.0:1788838335.172962:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff509c6da00/0x88da08396ccca295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca28e expref: 16 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838335.172981:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1788838335.172987:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640669c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+16:3646:x1875729135198592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838335.173001:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838335.173005:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff509c6da00/0x88da08396ccca295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccca28e expref: 16 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.173013:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff509c6da00/0x88da08396ccca295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccca28e expref: 16 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.173023:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff509c6da00/0x88da08396ccca295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccca28e expref: 16 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.173032:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838335.173057:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640669c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+15:3646:x1875729135198592:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838335.173063:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00010000:00010000:2.0:1788838335.173079:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838335.173089:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838335.173102:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135198592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838335.173118:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838335.173192:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135198208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788838335.173200:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135198080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838335.173452:0:10414:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1788838335.173564:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838335.173677:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838335.174608:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116480896 00000100:00100000:2.0:1788838335.174615:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116480896 00010000:00010000:2.0:1788838335.174650:0:6531:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff60148e400/0x88da08396ccca280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfee expref: 10 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838335.174728:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116481024 00000100:00100000:0.0:1788838335.174733:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116481024 00010000:00010000:0.0:1788838335.174750:0:6532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff509c6c800/0x88da08396ccca287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cff5 expref: 11 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838335.174787:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2601 00000100:00100000:0.0:1788838335.174822:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2af93169-6705-472b-b7ff-fd7cc5c04782+11:2404:x1875729116480896:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838335.174835:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838335.174840:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff60148e400/0x88da08396ccca280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfee expref: 11 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.174850:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff60148e400/0x88da08396ccca280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfee expref: 11 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.174865:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff60148e400/0x88da08396ccca280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfee expref: 11 pid: 94392 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.174877:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838335.174922:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116480896:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 127us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838335.174929:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2601 00000100:00100000:0.0:1788838335.174965:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2602 00000100:00100000:0.0:1788838335.174972:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:2404:x1875729116481024:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788838335.174989:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838335.174994:0:6532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff509c6c800/0x88da08396ccca287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cff5 expref: 9 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175002:0:6532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff509c6c800/0x88da08396ccca287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cff5 expref: 9 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175013:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff509c6c800/0x88da08396ccca287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cff5 expref: 9 pid: 94398 timeout: 3829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175026:0:6532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175033:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175046:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175053:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175060:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175067:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175073:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6cc00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838335.175077:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175096:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175109:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838335.175120:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838335.175138:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2af93169-6705-472b-b7ff-fd7cc5c04782+8:2404:x1875729116481024:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 167us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838335.175144:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2602 00010000:00010000:1.0:1788838335.175309:0:95421:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.175328:0:95421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838335.175335:0:95421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff509c6cc00/0x88da08396ccca30c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838335.549029:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838336.573037:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838336.829076:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838336.830114:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116481152 00000100:00100000:3.0:1788838336.830125:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116481152 00000100:00100000:3.0:1788838336.830490:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:3.0:1788838336.830503:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+8:70927:x1875729116481152:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838336.830520:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838336.830539:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50f3ef600/0x88da08396ccca313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005cffc expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838336.830566:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50f3ef600/0x88da08396ccca313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cffc expref: 9 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838336.830577:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50f3ef600/0x88da08396ccca313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cffc expref: 9 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838336.830585:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ef600, rc 0) 00000100:00100000:3.0:1788838336.831024:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116481152:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 523us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838336.831032:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:0.0:1788838336.836884:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838336.837010:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116481280 00000100:00100000:2.0:1788838336.837020:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116481280 00000100:00100000:2.0:1788838336.837077:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:2.0:1788838336.837088:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116481280:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838336.837261:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116481280:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 175us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838336.837270:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:0.0:1788838336.842043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838336.842172:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116481408 00000100:00100000:1.0:1788838336.842183:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116481408 00000100:00100000:1.0:1788838336.842291:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:1.0:1788838336.842301:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116481408:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838336.842451:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116481408:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 151us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838336.842459:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:1.0:1788838336.847466:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838336.848720:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116481536 00000100:00100000:2.0:1788838336.848734:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116481536 00000100:00100000:2.0:1788838336.848828:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:2.0:1788838336.848840:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:73323:x1875729116481536:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788838336.849004:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+9:73323:x1875729116481536:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 165us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838336.849013:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:0.0:1788838336.852950:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838336.853041:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116481664 00000100:00100000:3.0:1788838336.853052:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116481664 00000100:00100000:3.0:1788838336.853109:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:3.0:1788838336.853119:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+9:73323:x1875729116481664:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788838336.853268:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+9:73323:x1875729116481664:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 150us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838336.853276:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:0.0:1788838336.858888:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838336.859269:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116481792 00000100:00100000:3.0:1788838336.859278:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116481792 00000100:00100000:3.0:1788838336.859338:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1788838336.859348:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116481792:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838336.859364:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838336.859383:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50f3eec00/0x88da08396ccca31a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d003 expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838336.859412:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50f3eec00/0x88da08396ccca31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d003 expref: 10 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838336.859423:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50f3eec00/0x88da08396ccca31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d003 expref: 10 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838336.859432:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3eec00, rc 0) 00000100:00100000:3.0:1788838336.859824:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116481792:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 476us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838336.859832:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:2.0:1788838336.865586:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838336.868878:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116481920 00000100:00100000:3.0:1788838336.868894:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116481920 00000100:00100000:3.0:1788838336.868970:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:3.0:1788838336.868981:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116481920:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838336.869183:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116481920:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 203us (3605us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788838336.869196:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 138 10000000:01000000:2.0:1788838337.085412:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788838337.085419:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff50a9bc000 from 61 10000000:01000000:2.0:1788838337.085425:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788838337.085472:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.085484:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.085497:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838337.085766:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135198720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.085876:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.085927:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503684840 going to sleep for 11 seconds 00000100:00100000:1.0:1788838337.086029:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135198720 00000100:00100000:1.0:1788838337.086037:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135198720 00000100:00100000:1.0:1788838337.086105:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788838337.086115:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+15:6544:x1875729135198720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838337.086128:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838337.086143:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca321 expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.086169:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca321 expref: 16 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.086181:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca321 expref: 16 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.086205:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6d000, rc 0) 00000100:00100000:1.0:1788838337.086257:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135198720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838337.086264:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788838337.088219:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135198720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838337.088256:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca328 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.088269:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca328 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838337.088348:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135198848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.088400:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.088515:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503684840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.091033:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135198848 00000100:00100000:3.0:1788838337.091048:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135198848 00000100:00100000:3.0:1788838337.091134:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788838337.091144:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135198848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.091310:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135198848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (2908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.091318:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788838337.091860:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135198848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.091913:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135198976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.091966:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.092277:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.093373:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135198976 00000100:00100000:3.0:1788838337.093384:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135198976 00000100:00100000:3.0:1788838337.093455:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788838337.093466:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135198976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.093609:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135198976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.093617:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788838337.095253:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135198976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.099740:0:95425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95425:1875729135199104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838337.100066:0:95425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.100180:0:95425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503684840 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.100230:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135199104 00000100:00100000:3.0:1788838337.100238:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135199104 00000100:00100000:3.0:1788838337.100329:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788838337.100340:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:95425:x1875729135199104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838337.100472:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:95425:x1875729135199104:12345-0@lo:502:llog_process_th.0 Request processed in 134us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.100479:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788838337.100612:0:95425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95425:1875729135199104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838337.100741:0:95425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95425:1875729135199232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838337.100788:0:95425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.101889:0:95425:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036dea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.102465:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135199232 00000100:00100000:0.0:1788838337.102474:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135199232 00000100:00100000:0.0:1788838337.102518:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788838337.102526:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:95425:x1875729135199232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.102669:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+16:95425:x1875729135199232:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.102701:0:95425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95425:1875729135199232:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788838337.102756:0:95425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000100:00100000:0.0:1788838337.103031:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000020:01000000:3.0:1788838337.103039:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1788838337.103069:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788838337.103080:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca328 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.103091:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca328 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838337.103112:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788838337.103115:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:3.0:1788838337.103117:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788838337.103147:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee400/0x88da08396ccca32f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.103153:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee400/0x88da08396ccca32f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.103162:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee400/0x88da08396ccca32f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838337.103180:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135199360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.103213:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838337.103245:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff606616840 going to sleep for 11 seconds 00000100:00100000:2.0:1788838337.103291:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135199360 00000100:00100000:2.0:1788838337.103295:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135199360 00000100:00100000:2.0:1788838337.103328:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788838337.103335:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+16:6544:x1875729135199360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838337.103344:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838337.103357:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e600/0x88da08396ccca336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca32f expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.103388:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e600/0x88da08396ccca336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca32f expref: 17 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.103397:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e600/0x88da08396ccca336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca32f expref: 17 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.103405:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e600, rc 0) 00000100:00100000:2.0:1788838337.103449:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135199360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.103455:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788838337.103679:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135199360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838337.103694:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee400/0x88da08396ccca32f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca336 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.103703:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee400/0x88da08396ccca32f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca336 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838337.103765:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135199488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.103794:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.104305:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966180 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.104366:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135199488 00000100:00100000:3.0:1788838337.104371:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135199488 00000100:00100000:3.0:1788838337.104407:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788838337.104416:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135199488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.104691:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135199488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.104699:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788838337.104780:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135199488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.104983:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135199616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.105024:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.105040:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966180 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.105087:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135199616 00000100:00100000:3.0:1788838337.105092:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135199616 00000100:00100000:3.0:1788838337.105125:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788838337.105132:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135199616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.105207:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135199616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.105218:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788838337.105313:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135199616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.105948:0:95426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95426:1875729135199744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838337.105992:0:95426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838337.106069:0:95426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611fce900 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.106149:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135199744 00000100:00100000:0.0:1788838337.106155:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135199744 00000100:00100000:0.0:1788838337.106232:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788838337.106241:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:95426:x1875729135199744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.106340:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:95426:x1875729135199744:12345-0@lo:502:llog_process_th.0 Request processed in 100us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.106347:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788838337.106413:0:95426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95426:1875729135199744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838337.106436:0:95426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838337.106446:0:95426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838337.106448:0:95426:0:(obd_config.c:1563:class_process_config()) marker 47 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:2.0:1788838337.106452:0:95426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1788838337.107240:0:95426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95426:1875729135199872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838337.107289:0:95426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.107327:0:95426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036decc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.107536:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135199872 00000100:00100000:0.0:1788838337.107549:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135199872 00000100:00100000:0.0:1788838337.107580:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788838337.107587:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:95426:x1875729135199872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.107694:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+17:95426:x1875729135199872:12345-0@lo:502:llog_process_th.0 Request processed in 107us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.107703:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788838337.109209:0:95426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95426:1875729135199872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838337.109255:0:95426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838337.109265:0:95426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838337.109267:0:95426:0:(obd_config.c:1563:class_process_config()) marker 47 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:2.0:1788838337.109272:0:95426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:0.0:1788838337.109386:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:0.0:1788838337.109417:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788838337.109427:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee400/0x88da08396ccca32f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca336 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.109437:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee400/0x88da08396ccca32f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca336 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838337.109449:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788838337.109451:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff503592800 from 61 10000000:01000000:0.0:1788838337.109455:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788838337.109484:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529800/0x88da08396ccca33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.109492:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff601529800/0x88da08396ccca33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.109502:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff601529800/0x88da08396ccca33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838337.109521:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.109580:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.109623:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966240 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.110229:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135200000 00000100:00100000:3.0:1788838337.110237:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135200000 00000100:00100000:3.0:1788838337.110293:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788838337.110302:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+17:6544:x1875729135200000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838337.110316:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838337.110329:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50f3ee200/0x88da08396ccca344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca33d expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.110351:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50f3ee200/0x88da08396ccca344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca33d expref: 18 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.110361:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50f3ee200/0x88da08396ccca344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca33d expref: 18 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.110369:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ee200, rc 0) 00000100:00100000:3.0:1788838337.110427:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135200000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.110434:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788838337.110758:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838337.110776:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff601529800/0x88da08396ccca33d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca344 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.110786:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff601529800/0x88da08396ccca33d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca344 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838337.110888:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838337.110921:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838337.110944:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.111072:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135200128 00000100:00100000:0.0:1788838337.111076:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135200128 00000100:00100000:0.0:1788838337.111112:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788838337.111120:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135200128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.111239:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135200128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.111246:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788838337.111987:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838337.112026:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838337.112075:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838337.112106:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.112161:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135200256 00000100:00100000:0.0:1788838337.112166:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135200256 00000100:00100000:0.0:1788838337.112205:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788838337.112213:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135200256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.112359:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135200256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.112366:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788838337.112991:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.113388:0:95427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95427:1875729135200384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.113435:0:95427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.113514:0:95427:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504966240 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.113717:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135200384 00000100:00100000:3.0:1788838337.113723:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135200384 00000100:00100000:3.0:1788838337.113830:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788838337.113840:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+18:95427:x1875729135200384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838337.113949:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+18:95427:x1875729135200384:12345-0@lo:502:llog_process_th.0 Request processed in 110us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.113956:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788838337.114047:0:95427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95427:1875729135200384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838337.114090:0:95427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95427:1875729135200512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838337.114126:0:95427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.114334:0:95427:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5036decc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.114408:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135200512 00000100:00100000:0.0:1788838337.114412:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135200512 00000100:00100000:0.0:1788838337.114470:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788838337.114478:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:95427:x1875729135200512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.114575:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+18:95427:x1875729135200512:12345-0@lo:502:llog_process_th.0 Request processed in 97us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.114582:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788838337.114791:0:95427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95427:1875729135200512:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788838337.115287:0:95427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1788838337.115464:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1788838337.115485:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788838337.115504:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529800/0x88da08396ccca33d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca344 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.115524:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff601529800/0x88da08396ccca33d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca344 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838337.115534:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788838337.115536:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:0.0:1788838337.115538:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788838337.115577:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529000/0x88da08396ccca34b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.115584:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff601529000/0x88da08396ccca34b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.115592:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff601529000/0x88da08396ccca34b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838337.115609:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.115658:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.115691:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d27300 going to sleep for 11 seconds 00000100:00100000:2.0:1788838337.116862:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135200640 00000100:00100000:2.0:1788838337.116871:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135200640 00000100:00100000:2.0:1788838337.116919:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788838337.116929:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+18:6544:x1875729135200640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838337.116943:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838337.116959:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff60148e400/0x88da08396ccca352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca34b expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.116984:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff60148e400/0x88da08396ccca352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca34b expref: 19 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.116995:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff60148e400/0x88da08396ccca352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca34b expref: 19 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.117004:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148e400, rc 0) 00000100:00100000:2.0:1788838337.117064:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135200640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.117071:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788838337.117883:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838337.117904:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff601529000/0x88da08396ccca34b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca352 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.117914:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff601529000/0x88da08396ccca34b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca352 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838337.117992:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.118029:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.118071:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d27300 going to sleep for 11 seconds 00000100:00100000:2.0:1788838337.118210:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135200768 00000100:00100000:2.0:1788838337.118215:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135200768 00000100:00100000:2.0:1788838337.118247:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788838337.118255:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135200768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.118381:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135200768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.118395:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788838337.121290:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.121353:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.121427:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.121473:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d27300 going to sleep for 11 seconds 00000100:00100000:2.0:1788838337.121582:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135200896 00000100:00100000:2.0:1788838337.121589:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135200896 00000100:00100000:2.0:1788838337.121653:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788838337.121662:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135200896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.121790:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135200896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.121843:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788838337.122282:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135200896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.124002:0:95428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95428:1875729135201024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838337.124081:0:95428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838337.124126:0:95428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611fcef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.127198:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135201024 00000100:00100000:0.0:1788838337.127213:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135201024 00000100:00100000:0.0:1788838337.127280:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788838337.127291:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:95428:x1875729135201024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.127488:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:95428:x1875729135201024:12345-0@lo:502:llog_process_th.0 Request processed in 198us (3406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.127507:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788838337.128368:0:95428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95428:1875729135201024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838337.128410:0:95428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838337.128422:0:95428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838337.128424:0:95428:0:(obd_config.c:1563:class_process_config()) marker 48 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:2.0:1788838337.128428:0:95428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1788838337.128578:0:95428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95428:1875729135201152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838337.128816:0:95428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.128861:0:95428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff61939dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.128917:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135201152 00000100:00100000:0.0:1788838337.128923:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135201152 00000100:00100000:0.0:1788838337.128964:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788838337.128973:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:95428:x1875729135201152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.129077:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+19:95428:x1875729135201152:12345-0@lo:502:llog_process_th.0 Request processed in 104us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.129085:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788838337.129412:0:95428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95428:1875729135201152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788838337.129438:0:95428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838337.129444:0:95428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838337.129446:0:95428:0:(obd_config.c:1563:class_process_config()) marker 48 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:2.0:1788838337.129449:0:95428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:0.0:1788838337.130033:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:0.0:1788838337.130055:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788838337.130065:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601529000/0x88da08396ccca34b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca352 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.130076:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff601529000/0x88da08396ccca34b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca352 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838337.130096:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788838337.130098:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff63f7ce800 from 61 10000000:01000000:0.0:1788838337.130101:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788838337.130129:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601528800/0x88da08396ccca359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.130137:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff601528800/0x88da08396ccca359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.130146:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff601528800/0x88da08396ccca359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838337.130166:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135201280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.130208:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.130246:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.130401:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135201280 00000100:00100000:3.0:1788838337.130407:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135201280 00000100:00100000:3.0:1788838337.130452:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788838337.130463:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+19:6544:x1875729135201280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838337.130475:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838337.130493:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50f3ef800/0x88da08396ccca360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca359 expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.130514:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50f3ef800/0x88da08396ccca360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca359 expref: 20 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.130525:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50f3ef800/0x88da08396ccca360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca359 expref: 20 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.130533:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ef800, rc 0) 00000100:00100000:3.0:1788838337.130582:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135201280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.130589:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788838337.131009:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135201280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838337.131023:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff601528800/0x88da08396ccca359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca360 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.131032:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff601528800/0x88da08396ccca359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca360 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838337.131088:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135201408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.131116:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.131147:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838337.131193:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135201408 00000100:00100000:2.0:1788838337.131198:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135201408 00000100:00100000:2.0:1788838337.131239:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788838337.131247:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135201408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.131362:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135201408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.131380:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788838337.132768:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135201408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.132865:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135201536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.132945:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.132987:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.133293:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135201536 00000100:00100000:3.0:1788838337.133299:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135201536 00000100:00100000:3.0:1788838337.133346:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788838337.133354:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135201536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.133465:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135201536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.133471:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788838337.133977:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135201536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.136228:0:95429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95429:1875729135201664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.136307:0:95429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.136352:0:95429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838337.136407:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135201664 00000100:00100000:2.0:1788838337.136413:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135201664 00000100:00100000:2.0:1788838337.136465:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788838337.136476:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:95429:x1875729135201664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838337.136610:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+20:95429:x1875729135201664:12345-0@lo:502:llog_process_th.0 Request processed in 137us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.136970:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788838337.137139:0:95429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95429:1875729135201664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.137190:0:95429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95429:1875729135201792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.137229:0:95429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.137311:0:95429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6054d2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.141876:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135201792 00000100:00100000:3.0:1788838337.141890:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135201792 00000100:00100000:3.0:1788838337.141955:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788838337.141966:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:95429:x1875729135201792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838337.142282:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+20:95429:x1875729135201792:12345-0@lo:502:llog_process_th.0 Request processed in 317us (5052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.142291:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788838337.142729:0:95429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95429:1875729135201792:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788838337.142969:0:95429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1788838337.144132:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1788838337.144161:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788838337.144173:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff601528800/0x88da08396ccca359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca360 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.144185:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff601528800/0x88da08396ccca359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca360 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838337.144196:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788838337.144199:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788838337.144203:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788838337.144243:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148e800/0x88da08396ccca367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.144252:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148e800/0x88da08396ccca367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.144262:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148e800/0x88da08396ccca367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838337.144288:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135201920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.144360:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.144843:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff61939dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788838337.145167:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135201920 00000100:00100000:1.0:1788838337.145175:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135201920 00000100:00100000:1.0:1788838337.145227:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788838337.145236:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+20:6544:x1875729135201920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838337.145249:0:94393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838337.145263:0:94393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca36e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca367 expref: -99 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.145295:0:94393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca367 expref: 21 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.145306:0:94393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca367 expref: 21 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.145314:0:94393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6c400, rc 0) 00000100:00100000:1.0:1788838337.145371:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135201920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838337.145378:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788838337.145463:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135201920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838337.145490:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148e800/0x88da08396ccca367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca36e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.145500:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148e800/0x88da08396ccca367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca36e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838337.145561:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.145591:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.145714:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff624d276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.145773:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135202048 00000100:00100000:3.0:1788838337.145777:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135202048 00000100:00100000:3.0:1788838337.145832:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788838337.145840:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135202048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.145973:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135202048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.145980:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788838337.146090:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838337.146125:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838337.146173:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838337.146293:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.146408:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135202176 00000100:00100000:0.0:1788838337.146413:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135202176 00000100:00100000:0.0:1788838337.146445:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788838337.146460:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135202176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.146729:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135202176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.146737:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788838337.146964:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838337.156305:0:95430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788838337.156707:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788838337.156735:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788838337.156755:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148e800/0x88da08396ccca367 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca36e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.156767:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148e800/0x88da08396ccca367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca36e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838337.156776:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788838337.156779:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff627f9a800 from 61 10000000:01000000:0.0:1788838337.156782:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788838337.158341:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.158357:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.158368:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838337.158395:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788838337.158478:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838337.158519:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.158733:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135202304 00000100:00100000:0.0:1788838337.158751:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135202304 00000100:00100000:0.0:1788838337.158936:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788838337.158948:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:6544:x1875729135202304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838337.158962:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838337.158976:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601528a00/0x88da08396ccca37c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca375 expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.158997:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601528a00/0x88da08396ccca37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca375 expref: 22 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.159008:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601528a00/0x88da08396ccca37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca375 expref: 22 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.159029:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528a00, rc 0) 00000100:00100000:0.0:1788838337.159075:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135202304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.159082:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788838337.159267:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788838337.159283:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.159292:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838337.159357:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838337.159385:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838337.164245:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788838337.164370:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135202432 00000100:00100000:2.0:1788838337.164380:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135202432 00000100:00100000:2.0:1788838337.165344:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788838337.165361:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135202432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.165522:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135202432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (6135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.165530:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788838337.165712:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788838337.165769:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838337.165839:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838337.165862:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135202560 00000100:00100000:1.0:1788838337.165867:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135202560 00000100:00100000:1.0:1788838337.165891:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788838337.165897:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135202560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788838337.165994:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135202560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838337.166001:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788838337.166049:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5057aed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788838337.166061:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.166741:0:95431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95431:1875729135202688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788838337.166833:0:95431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.166857:0:95431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6054d2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788838337.166942:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135202688 00000100:00100000:1.0:1788838337.166953:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135202688 00000100:00100000:1.0:1788838337.166988:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788838337.166996:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:95431:x1875729135202688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788838337.167098:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:95431:x1875729135202688:12345-0@lo:502:llog_process_th.0 Request processed in 103us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838337.167106:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788838337.167271:0:95431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95431:1875729135202688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838337.167550:0:95431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95431:1875729135202816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788838337.167588:0:95431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838337.167705:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135202816 00000100:00100000:3.0:1788838337.167710:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135202816 00000100:00100000:3.0:1788838337.167755:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788838337.167763:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:95431:x1875729135202816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788838337.167861:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:95431:x1875729135202816:12345-0@lo:502:llog_process_th.0 Request processed in 99us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838337.167868:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788838337.168114:0:95431:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff6054d2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788838337.168131:0:95431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57943c9a-ca27-46d8-8845-5d2bce640e45:95431:1875729135202816:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788838337.168154:0:95431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1788838337.168342:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1788838337.168363:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788838337.168379:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.168388:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838337.168397:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788838337.168399:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788838337.168402:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788838337.168427:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.168435:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838337.168445:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838337.168459:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50719e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.168488:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838337.168515:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff611fce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.168563:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135202944 00000100:00100000:0.0:1788838337.168568:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135202944 00000100:00100000:0.0:1788838337.168602:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788838337.168610:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135202944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838337.168629:0:94395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838337.168640:0:94395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601529e00/0x88da08396ccca38a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca383 expref: -99 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.168661:0:94395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601529e00/0x88da08396ccca38a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca383 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.168672:0:94395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601529e00/0x88da08396ccca38a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca383 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.168680:0:94395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529e00, rc 0) 00000100:00100000:0.0:1788838337.168722:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135202944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.168728:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788838337.168952:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50719e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135202944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838337.168965:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.168973:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838337.169026:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135203072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.169052:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.169082:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503623f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.169127:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135203072 00000100:00100000:0.0:1788838337.169137:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135203072 00000100:00100000:0.0:1788838337.169168:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788838337.169175:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135203072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.169272:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135203072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.169279:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788838337.169343:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135203072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.169371:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135203200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.169400:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.169418:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff503623f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.169450:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135203200 00000100:00100000:0.0:1788838337.169454:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135203200 00000100:00100000:0.0:1788838337.169480:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788838337.169486:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135203200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788838337.169554:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135203200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.169560:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788838337.170432:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135203200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788838337.174462:0:95432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788838337.175147:0:6544:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788838337.175175:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788838337.175187:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.175198:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838337.175209:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788838337.175211:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ff610244d28 from 1 10000000:01000000:2.0:1788838337.175214:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788838337.175251:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.175259:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.175269:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838337.175293:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135203328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.175356:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.175447:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff603015e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788838337.175705:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135203328 00000100:00100000:0.0:1788838337.175714:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135203328 00000100:00100000:0.0:1788838337.176262:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788838337.176274:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135203328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838337.176288:0:94393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838337.176303:0:94393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff601529400/0x88da08396ccca398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396ccca391 expref: -99 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.176328:0:94393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff601529400/0x88da08396ccca398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396ccca391 expref: 24 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.176338:0:94393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff601529400/0x88da08396ccca398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca391 expref: 24 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838337.176346:0:94393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529400, rc 0) 00000100:00100000:0.0:1788838337.176419:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135203328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.176426:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788838337.176541:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135203328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788838337.176556:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca398 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838337.176566:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca398 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838337.176624:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135203456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788838337.176653:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.176673:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff603015e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788838337.176734:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135203456 00000100:00100000:3.0:1788838337.176739:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135203456 00000100:00100000:3.0:1788838337.176781:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788838337.176788:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135203456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788838337.176903:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135203456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (249us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788838337.176911:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788838337.177000:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135203456:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788838337.177033:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788838337.177040:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca398 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838337.177047:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca398 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838337.405551:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838337.405574:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135203584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838337.405769:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.405852:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135203584 00000100:00100000:2.0:1788838337.405860:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135203584 00000100:00100000:2.0:1788838337.405908:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4275 00000100:00100000:2.0:1788838337.405918:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135203584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838337.405950:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445052416 avail 1298812928 00000100:00100000:2.0:1788838337.405993:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135203584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.406000:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4275 00000100:00100000:2.0:1788838337.406049:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135203712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838337.406075:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.406106:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135203712 00000100:00100000:2.0:1788838337.406109:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135203712 00000100:00100000:2.0:1788838337.406131:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4276 00000100:00100000:2.0:1788838337.406138:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135203712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838337.406166:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:2.0:1788838337.406199:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640669c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135203712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.406205:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4276 00000100:00100000:2.0:1788838337.406244:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135203712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838337.406271:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135203584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838337.408302:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135204096:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.408356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.408386:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135204608:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.408405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.408440:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788838337.408446:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135203968:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.408469:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.408485:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135204480:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.408510:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.408529:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135204992:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.408549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.408576:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135204096 00000100:00100000:2.0:1788838337.408581:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135204096 00000100:00100000:2.0:1788838337.408645:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135204608 00000100:00100000:2.0:1788838337.408649:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135204608 00000100:00100000:2.0:1788838337.408669:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135203968 00000100:00100000:2.0:1788838337.408671:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135203968 00000100:00100000:2.0:1788838337.408683:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135204992 00000100:00100000:2.0:1788838337.408685:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135204992 00000100:00100000:2.0:1788838337.408697:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1788838337.408716:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135204096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.408775:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135204096:12345-0@lo:400:kworker.0 Request processed in 60us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.408782:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1788838337.408823:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1788838337.408831:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135204608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.408859:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135204608:12345-0@lo:400:kworker.0 Request processed in 30us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.408865:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1788838337.408876:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1788838337.408883:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135203968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.408910:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135203968:12345-0@lo:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.408916:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1788838337.408927:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1788838337.408933:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135204992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.408960:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135204992:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.408966:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1788838337.408991:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135204480 00000100:00100000:2.0:1788838337.408995:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135204480 00000100:00100000:2.0:1788838337.409022:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1788838337.409029:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135204480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409058:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135204480:12345-0@lo:400:kworker.0 Request processed in 30us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.409073:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00080000:2.0:1788838337.409091:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838337.409095:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838337.409097:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838337.409117:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135203840:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409145:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.409164:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135204352:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409184:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.409198:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135204864:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409216:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.409233:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788838337.409239:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135204224:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409259:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.409275:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135204736:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409295:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.409326:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135203840 00000100:00100000:2.0:1788838337.409330:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135203840 00000100:00100000:2.0:1788838337.409358:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135204224 00000100:00100000:2.0:1788838337.409361:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135204224 00000100:00100000:2.0:1788838337.409379:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1788838337.409385:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135203840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409419:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135203840:12345-0@lo:400:kworker.0 Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.409425:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1788838337.409442:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1788838337.409449:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135204224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409484:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135204224:12345-0@lo:400:kworker.0 Request processed in 37us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.409491:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00080000:2.0:1788838337.409508:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838337.409511:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838337.409542:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135204224:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409552:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135203840:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409580:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff64066ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135203968:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409590:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135204480:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409599:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135204992:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409609:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135204096:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.409619:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135204608:0@lo:400:kworker.0 00000100:00100000:1.0:1788838337.410106:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135204352 00000100:00100000:1.0:1788838337.410112:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135204352 00000100:00100000:1.0:1788838337.410161:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135204864 00000100:00100000:1.0:1788838337.410164:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135204864 00000100:00100000:1.0:1788838337.410185:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135204736 00000100:00100000:1.0:1788838337.410187:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135204736 00000100:00100000:1.0:1788838337.410204:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:1.0:1788838337.410211:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135204352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838337.410254:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135204352:12345-0@lo:400:kworker.0 Request processed in 44us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838337.410260:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:1.0:1788838337.410272:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:1.0:1788838337.410278:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135204864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838337.410312:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135204864:12345-0@lo:400:kworker.0 Request processed in 34us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838337.410319:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:1.0:1788838337.410331:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00100000:1.0:1788838337.410338:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135204736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838337.410363:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135204736:12345-0@lo:400:kworker.0 Request processed in 27us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838337.410369:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00080000:1.0:1788838337.410400:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838337.410404:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838337.414026:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135204736:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.414045:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135204352:0@lo:400:kworker.0 00000100:00100000:2.0:1788838337.414055:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135204864:0@lo:400:kworker.0 00000100:00100000:0.0:1788838337.596241:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838337.596278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838337.596305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838337.596321:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838337.596351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838337.596375:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116482432 00000100:00100000:0.0:1788838337.596385:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116482432 00000100:00100000:0.0:1788838337.596435:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116482560 00000100:00100000:0.0:1788838337.596438:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116482560 00000100:00100000:0.0:1788838337.596464:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2734 00000100:00100000:0.0:1788838337.596474:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116482432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838337.596544:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2407:x1875729116482432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.596552:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2734 00000100:00100000:0.0:1788838337.596568:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2735 00000100:00100000:0.0:1788838337.596575:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116482560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838337.596603:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116482560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.596609:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2735 00000100:00080000:1.0:1788838337.596630:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838337.596635:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838337.596652:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116482176 00000100:00100000:1.0:1788838337.596656:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116482176 00000100:00100000:1.0:1788838337.596701:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116482304 00000100:00100000:1.0:1788838337.596705:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116482304 00000100:00100000:1.0:1788838337.596727:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1450 00000100:00100000:1.0:1788838337.596735:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2407:x1875729116482176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838337.596785:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2407:x1875729116482176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 51us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838337.596792:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1450 00000100:00100000:1.0:1788838337.596838:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1451 00000100:00100000:1.0:1788838337.596846:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116482304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838337.596873:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116482304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838337.596880:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1451 00000100:00100000:1.0:1788838337.596923:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116482048 00000100:00100000:1.0:1788838337.596926:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116482048 00000100:00100000:1.0:1788838337.596953:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:1.0:1788838337.596960:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116482048:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838337.596985:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116482048:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838337.596991:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00080000:1.0:1788838337.597017:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838337.597019:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788838337.601343:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838337.917082:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135205120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838337.917167:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838337.917381:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135205120 00000100:00100000:0.0:1788838337.917390:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135205120 00000100:00100000:0.0:1788838337.917455:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:0.0:1788838337.917467:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135205120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788838337.917505:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788838337.917558:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135205120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838337.917565:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:2.0:1788838337.917869:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838337.917882:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135205248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838337.917916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838337.917949:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135205248 00000100:00100000:2.0:1788838337.917953:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135205248 00000100:00100000:2.0:1788838337.917984:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:2.0:1788838337.917992:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135205248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838337.918017:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838337.918052:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135205248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838337.918059:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00100000:2.0:1788838337.918673:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135205248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838337.918892:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135205120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788838338.621718:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838338.944352:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838338.944376:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff632e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135205376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838338.944445:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838338.944550:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135205376 00000100:00100000:1.0:1788838338.944558:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135205376 00000100:00100000:1.0:1788838338.944614:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:1.0:1788838338.944624:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135205376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838338.944646:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838338.944690:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135205376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838338.944697:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00100000:0.0:1788838338.944900:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff632e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135205376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838338.945119:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838338.945128:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135205504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838338.945158:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838338.945308:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135205504 00000100:00100000:2.0:1788838338.945313:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135205504 00000100:00100000:2.0:1788838338.945351:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:2.0:1788838338.945359:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135205504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788838338.945371:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788838338.945418:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135205504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838338.945425:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:3.0:1788838338.945499:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135205504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788838339.645025:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788838340.255308:0:95530:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 23:32:19 (1788838339) 00000100:00100000:1.0:1788838340.506790:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.516338:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116482816 00000100:00100000:2.0:1788838340.516355:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116482816 00000100:00100000:2.0:1788838340.516426:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1452 00000100:00100000:2.0:1788838340.516440:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+10:73495:x1875729116482816:12345-192.168.203.30@tcp:36:mkdir.0 00010000:00010000:2.0:1788838340.516501:0:76060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838340.516531:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccca1ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa8 expref: 10 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.516547:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:2.0:1788838340.516553:0:76060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838340.516773:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.516820:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.516938:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.516956:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.516964:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.516972:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518065:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518078:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518087:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.518102:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cda11381 reply state 00000000058af837 transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518113:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518120:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838340.518128:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838340.518131:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788838340.518136:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1788838340.518145:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518151:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518157:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518163:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518168:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148fe00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838340.518172:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518179:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.518188:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:2.0:1788838340.518190:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838340.518193:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.521302:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca39f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.521336:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cda11381 reply state 00000000058af837 transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.521365:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.521373:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8ff60b5cfb00) 00010000:00010000:2.0:1788838340.521376:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838340.521381:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788838340.521498:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+11:73495:x1875729116482816:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 5058us (14713us total) trans 124554051585 rc 0/0 00000100:00100000:2.0:1788838340.521508:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1452 00000100:00080000:2.0:1788838340.521550:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838340.555620:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.555843:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116482944 00000100:00100000:2.0:1788838340.555854:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116482944 00000100:00100000:1.0:1788838340.556030:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1453 00000100:00100000:1.0:1788838340.556056:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+11:73499:x1875729116482944:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788838340.556082:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838340.556103:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca3b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d00a expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.556161:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca3bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.556175:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca3bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.556187:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca3bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838340.556245:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788838340.556250:0:66254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788838340.556272:0:66254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca3bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.556298:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca3b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d00a expref: 13 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.556329:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca3bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d00a expref: 12 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.556337:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:1.0:1788838340.556339:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788838340.556343:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6c200, rc 0) 00000100:00100000:1.0:1788838340.556399:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+12:73499:x1875729116482944:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 346us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838340.556414:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1453 00000100:00100000:0.0:1788838340.559475:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838340.559556:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116483200 00000100:00100000:3.0:1788838340.559566:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116483200 00000100:00100000:3.0:1788838340.559631:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1454 00000100:00100000:3.0:1788838340.559642:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+12:73499:x1875729116483200:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1788838340.559662:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838340.559664:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788838340.559689:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca3bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d00a expref: 12 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.559710:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:3.0:1788838340.559715:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838340.559737:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca3c2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d011 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.559916:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.559930:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.559939:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.559950:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca3d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.559958:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.559980:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560045:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca3d7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560054:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca3d7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560061:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca3d7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838340.560070:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1788838340.560082:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca3d7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560089:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca3d7 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560095:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca3d7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560101:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3efa00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838340.560106:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca3d7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560113:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca3d7 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560122:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:3.0:1788838340.560125:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838340.560136:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca3d7 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560142:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca3d7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560159:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560166:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560171:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560176:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560181:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3ee000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838340.560184:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560189:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560196:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:3.0:1788838340.560472:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838340.560477:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560484:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca3c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560496:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560509:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca3d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560515:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560520:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3ee800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838340.560524:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560530:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560539:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8ff60b5cfb00) 00010000:00010000:3.0:1788838340.560541:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838340.560544:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca3d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560550:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca3d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560577:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca3c2 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d011 expref: 12 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560587:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:3.0:1788838340.560589:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838340.560593:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca3c2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d011 expref: 12 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.560621:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ef200, rc 0) 00000100:00100000:0.0:1788838340.566421:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:73499:x1875729116483200:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 6768us (6941us total) trans 0 rc 301/301 00000100:00100000:0.0:1788838340.566435:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1454 00000100:00100000:0.0:1788838340.585936:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.586115:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116483328 00000100:00100000:2.0:1788838340.586126:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116483328 00000100:00100000:2.0:1788838340.586207:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1455 00000100:00100000:2.0:1788838340.586219:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+11:73499:x1875729116483328:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1788838340.586241:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838340.586261:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca3de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d018 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.586326:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396ccca3e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.586340:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396ccca3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.586351:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396ccca3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838340.586411:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838340.586415:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838340.586433:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396ccca3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.586456:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca3de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d018 expref: 13 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.586474:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396ccca3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d018 expref: 12 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.586482:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:2.0:1788838340.586485:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838340.586489:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cb600, rc 0) 00000100:00100000:2.0:1788838340.586553:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+12:73499:x1875729116483328:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 336us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838340.586561:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1455 00000100:00100000:2.0:1788838340.591303:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838340.591377:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116483584 00000100:00100000:1.0:1788838340.591387:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116483584 00000100:00100000:1.0:1788838340.591445:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1456 00000100:00100000:1.0:1788838340.591455:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+12:73499:x1875729116483584:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1788838340.591475:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838340.591495:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca3ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d01f expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.591568:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.591582:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.591593:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.591605:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca3fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.591613:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca3fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.591620:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca3fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838340.591738:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1788838340.591964:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.591990:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.591996:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592002:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592008:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838340.592012:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592019:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592031:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:1.0:1788838340.592034:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838340.592039:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592045:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca3f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592059:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca3fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592064:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca3fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592070:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca3fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592081:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6dc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838340.592084:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca3fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592090:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca3fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592099:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8ff60b5cfb00) 00010000:00010000:1.0:1788838340.592101:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838340.592104:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca3fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592111:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca3fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592146:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca3ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d01f expref: 14 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592156:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:1.0:1788838340.592158:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788838340.592162:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca3ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d01f expref: 14 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.592171:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6de00, rc 0) 00000100:00100000:1.0:1788838340.592225:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+13:73499:x1875729116483584:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 772us (932us total) trans 124554051586 rc 301/301 00000100:00100000:1.0:1788838340.592233:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1456 00000100:00100000:3.0:1788838340.596218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.596327:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116483840 00000100:00100000:2.0:1788838340.596337:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116483840 00000100:00100000:2.0:1788838340.596404:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1457 00000100:00100000:2.0:1788838340.596415:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+13:73499:x1875729116483840:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:2.0:1788838340.596506:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.596525:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.596558:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.596749:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d50d33b3 reply state 0000000054d0baf0 transno 124554051587 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.596764:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.596772:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838340.596775:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1788838340.596779:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788838340.596787:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000100:00100000:2.0:1788838340.597388:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+15:73499:x1875729116483840:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 972us (1176us total) trans 124554051587 rc 0/0 00000100:00100000:2.0:1788838340.597397:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1457 00000100:00100000:0.0:1788838340.605317:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838340.605421:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116484096 00000100:00100000:3.0:1788838340.605432:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116484096 00000100:00100000:3.0:1788838340.605489:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:3.0:1788838340.605500:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+15:73499:x1875729116484096:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1788838340.605742:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+16:73499:x1875729116484096:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 243us (433us total) trans 124554051588 rc 0/0 00000100:00100000:3.0:1788838340.605750:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:1.0:1788838340.633410:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.633525:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116484224 00000100:00100000:2.0:1788838340.633535:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116484224 00000100:00100000:2.0:1788838340.633611:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1458 00000100:00100000:2.0:1788838340.633622:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+16:73505:x1875729116484224:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838340.633645:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838340.633667:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca400/0x88da08396ccca40f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d026 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.633743:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.633759:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.633778:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.633790:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca41d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.633849:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca41d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.633857:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca41d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.633939:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb800/0x88da08396ccca424 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.633948:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb800/0x88da08396ccca424 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.633956:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb800/0x88da08396ccca424 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838340.633991:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1788838340.633995:0:76060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788838340.634032:0:76060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb800/0x88da08396ccca424 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634046:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634053:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634068:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634075:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634080:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3caa00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838340.634085:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634092:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634104:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:2.0:1788838340.634107:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838340.634111:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634118:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca416 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634132:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca41d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634138:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca41d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634144:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca41d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634150:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cbc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838340.634159:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca41d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634165:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca41d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634174:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8ff60b5cfb00) 00010000:00010000:2.0:1788838340.634176:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838340.634180:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca41d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634186:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca41d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634212:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca400/0x88da08396ccca40f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d026 expref: 18 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634226:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb800/0x88da08396ccca424 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d026 expref: 17 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.634233:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838340.634236:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788838340.634238:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cb800, rc 0) 00000100:00100000:2.0:1788838340.634296:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+17:73505:x1875729116484224:12345-192.168.203.30@tcp:101:touch.0 Request processed in 677us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838340.634304:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1458 00000100:00100000:0.0:1788838340.643792:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838340.643954:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116484480 00000100:00100000:3.0:1788838340.643975:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116484480 00000100:00100000:2.0:1788838340.644170:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1459 00000100:00100000:2.0:1788838340.644190:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+17:73505:x1875729116484480:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838340.644231:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838340.644279:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca400/0x88da08396ccca42b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d02d expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.644429:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.644449:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.644466:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.644484:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.644492:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.644498:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838340.645085:0:67312:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x323:0x0], count =95 00000004:00080000:2.0:1788838340.645096:0:67312:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x323:0x0]+95 in llog 00000004:00080000:2.0:1788838340.645126:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x382:0x0], index 0: 0 00010000:00010000:2.0:1788838340.646114:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca440 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646140:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca440 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646151:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca440 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646361:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646370:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646376:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646384:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646391:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cbc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838340.646396:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646404:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646420:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838340.646423:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838340.646428:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646435:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca432 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.646453:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efcf8504 reply state 0000000006e9b47b transno 124554051589 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646464:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646479:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff8ff60b5cf600) 00010000:00010000:2.0:1788838340.646482:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838340.646486:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838340.646532:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca400/0x88da08396ccca42b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d02d expref: 20 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646551:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca440 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d02d expref: 19 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.646561:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8ff60b5cf400) 00010000:00010000:2.0:1788838340.646564:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838340.646566:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cb000, rc 0) 00000100:00100000:2.0:1788838340.646763:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+20:73505:x1875729116484480:12345-192.168.203.30@tcp:101:touch.0 Request processed in 2580us (2979us total) trans 124554051589 rc 0/0 00000100:00100000:2.0:1788838340.646772:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1459 00000100:00100000:1.0:1788838340.656259:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.656370:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116484736 00000100:00100000:0.0:1788838340.656385:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116484736 00000100:00100000:0.0:1788838340.656468:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1460 00000100:00100000:0.0:1788838340.656480:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+20:73505:x1875729116484736:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:0.0:1788838340.656559:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838340.656596:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca440 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d02d expref: 20 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.656620:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8ff60b5cf400) 00010000:00010000:0.0:1788838340.656652:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838340.656738:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.656753:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.656764:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838340.656965:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0af4467 reply state 0000000023a505cc transno 124554051590 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.656978:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.656985:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8ff508af1800) 00010000:00010000:0.0:1788838340.656987:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838340.656990:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838340.657118:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+21:73505:x1875729116484736:12345-192.168.203.30@tcp:36:touch.0 Request processed in 639us (873us total) trans 124554051590 rc 0/0 00000100:00100000:0.0:1788838340.657126:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1460 00010000:00010000:2.0:1788838340.670150:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838340.670312:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.670453:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116484864 00000100:00100000:2.0:1788838340.670466:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116484864 00000100:00100000:2.0:1788838340.670547:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1461 00000100:00100000:2.0:1788838340.670559:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+21:73505:x1875729116484864:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838340.670590:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838340.670616:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca400/0x88da08396ccca455 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d034 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.670697:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca400/0x88da08396ccca455 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d034 expref: 22 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.670749:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca400/0x88da08396ccca455 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d034 expref: 22 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.670774:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8ff508af1800) 00010000:00010000:2.0:1788838340.670778:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838340.670783:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3ca400, rc 0) 00000100:00100000:2.0:1788838340.671019:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+22:73505:x1875729116484864:12345-192.168.203.30@tcp:101:touch.0 Request processed in 462us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838340.671028:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1461 00000100:00100000:3.0:1788838340.680768:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.680994:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116484992 00000100:00100000:0.0:1788838340.681008:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116484992 00000100:00100000:0.0:1788838340.681102:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5994 00000100:00100000:0.0:1788838340.681114:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2404:x1875729116484992:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:0.0:1788838340.681453:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2404:x1875729116484992:12345-192.168.203.30@tcp:2:touch.0 Request processed in 340us (700us total) trans 4294969457 rc 0/0 00000100:00100000:0.0:1788838340.681462:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5994 00000100:00080000:2.0:1788838340.682129:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838340.694615:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.694856:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116485248 00000100:00100000:2.0:1788838340.694870:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116485248 00000100:00100000:2.0:1788838340.694945:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:2.0:1788838340.694957:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502464850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+22:73505:x1875729116485248:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838340.695363:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502464850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+23:73505:x1875729116485248:12345-192.168.203.30@tcp:35:touch.0 Request processed in 406us (760us total) trans 124554051591 rc 0/0 00000100:00100000:2.0:1788838340.695372:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:3.0:1788838340.703433:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838340.703619:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116485504 00000100:00100000:1.0:1788838340.703634:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116485504 00000100:00100000:1.0:1788838340.703718:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1462 00000100:00100000:1.0:1788838340.703738:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+23:73505:x1875729116485504:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:1.0:1788838340.703773:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838340.703855:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca45c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d03b expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.704029:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.704053:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.704068:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.704085:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.704091:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.704098:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838340.705377:0:66254:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x383:0x0], index 0: 0 00010000:00010000:2.0:1788838340.705665:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca471 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.705685:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca471 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.705699:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca471 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.705770:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.705778:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.705785:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.705792:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.705994:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6dc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838340.706000:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.706008:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.706024:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838340.706027:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838340.706032:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.706039:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca463 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.706059:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ca03e15 reply state 0000000085b00b3c transno 124554051592 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.706072:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.706085:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff8ff61d841000) 00010000:00010000:2.0:1788838340.706087:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838340.706091:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838340.706141:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca45c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d03b expref: 26 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.706158:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca471 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d03b expref: 25 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.706165:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8ff60b5cf400) 00010000:00010000:2.0:1788838340.706168:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838340.706170:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cbc00, rc 0) 00000100:00100000:2.0:1788838340.706396:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+26:73505:x1875729116485504:12345-192.168.203.30@tcp:101:touch.0 Request processed in 2659us (2978us total) trans 124554051592 rc 0/0 00000100:00100000:2.0:1788838340.706407:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1462 00000100:00100000:0.0:1788838340.713071:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.713216:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116485760 00000100:00100000:2.0:1788838340.713229:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116485760 00000100:00100000:2.0:1788838340.713310:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1463 00000100:00100000:2.0:1788838340.713323:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+26:73505:x1875729116485760:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:2.0:1788838340.713423:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838340.713459:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca471 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d03b expref: 26 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.713485:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8ff60b5cf400) 00010000:00010000:2.0:1788838340.713498:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838340.713580:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.713604:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.713616:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.713767:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffa77322 reply state 00000000cc27d462 transno 124554051593 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.713782:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.713789:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8ff60b5cf500) 00010000:00010000:2.0:1788838340.713791:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838340.713794:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838340.713982:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+27:73505:x1875729116485760:12345-192.168.203.30@tcp:36:touch.0 Request processed in 661us (924us total) trans 124554051593 rc 0/0 00000100:00100000:2.0:1788838340.713992:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1463 00000100:00100000:1.0:1788838340.717421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.717532:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116485888 00000100:00100000:0.0:1788838340.717545:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116485888 00000100:00100000:0.0:1788838340.717658:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1464 00000100:00100000:0.0:1788838340.717672:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+27:73505:x1875729116485888:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838340.717706:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838340.717746:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528c00/0x88da08396ccca486 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d042 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.717868:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528c00/0x88da08396ccca486 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d042 expref: 28 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.717886:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528c00/0x88da08396ccca486 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d042 expref: 28 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.717908:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8ff60b5cf500) 00010000:00010000:0.0:1788838340.717912:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788838340.717916:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528c00, rc 0) 00000100:00100000:0.0:1788838340.717997:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+28:73505:x1875729116485888:12345-192.168.203.30@tcp:101:touch.0 Request processed in 329us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838340.718003:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1464 00000100:00100000:1.0:1788838340.724990:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838340.725167:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116486016 00000100:00100000:3.0:1788838340.725180:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116486016 00000100:00100000:3.0:1788838340.725267:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5995 00000100:00100000:3.0:1788838340.725279:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2407:x1875729116486016:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:3.0:1788838340.725592:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116486016:12345-192.168.203.30@tcp:2:touch.0 Request processed in 314us (616us total) trans 4294969458 rc 0/0 00000100:00100000:3.0:1788838340.725601:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5995 00000100:00100000:3.0:1788838340.730980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.731114:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116486272 00000100:00100000:2.0:1788838340.731126:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116486272 00000100:00100000:2.0:1788838340.731192:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:2.0:1788838340.731215:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+28:73505:x1875729116486272:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838340.732817:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+29:73505:x1875729116486272:12345-192.168.203.30@tcp:35:touch.0 Request processed in 1575us (1822us total) trans 124554051594 rc 0/0 00000100:00100000:2.0:1788838340.732833:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:3.0:1788838340.740894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.741119:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116486528 00000100:00100000:2.0:1788838340.741137:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116486528 00000100:00100000:2.0:1788838340.741250:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1465 00000100:00100000:2.0:1788838340.741284:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+29:73505:x1875729116486528:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838340.741316:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838340.741342:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca48d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d049 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.741490:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.741519:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.741533:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.741550:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.741557:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.741565:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838340.742234:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x384:0x0], index 0: 0 00010000:00010000:2.0:1788838340.742433:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4a2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.742447:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4a2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.742457:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4a2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.742528:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.742537:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.742544:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.742552:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.742558:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838340.742563:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.742977:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.742998:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838340.743001:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838340.743006:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.743013:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca494 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.743032:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2b4b57c reply state 000000006f0f367f transno 124554051595 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.743045:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.743061:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff8ff60b5cf400) 00010000:00010000:2.0:1788838340.743063:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838340.743067:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838340.743114:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca48d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d049 expref: 32 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.743132:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4a2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d049 expref: 31 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.743139:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8ff60b5cf700) 00010000:00010000:2.0:1788838340.743142:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838340.743144:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3ca200, rc 0) 00000100:00100000:2.0:1788838340.743266:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+32:73505:x1875729116486528:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1986us (2381us total) trans 124554051595 rc 0/0 00000100:00100000:2.0:1788838340.743276:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1465 00000100:00100000:2.0:1788838340.755700:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.755851:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116486784 00000100:00100000:0.0:1788838340.755869:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116486784 00000100:00100000:0.0:1788838340.755956:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1466 00000100:00100000:0.0:1788838340.755970:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+32:73505:x1875729116486784:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:0.0:1788838340.756054:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838340.756091:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4a2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d049 expref: 32 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.756139:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8ff60b5cf700) 00010000:00010000:0.0:1788838340.756153:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838340.756238:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.756254:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.756266:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838340.756407:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020e92646 reply state 0000000074fa569a transno 124554051596 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.756421:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.756428:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8ff508af1100) 00010000:00010000:0.0:1788838340.756430:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838340.756433:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838340.756561:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+33:73505:x1875729116486784:12345-192.168.203.30@tcp:36:touch.0 Request processed in 594us (869us total) trans 124554051596 rc 0/0 00000100:00100000:0.0:1788838340.756569:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1466 00000100:00100000:3.0:1788838340.767571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.767741:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116486912 00000100:00100000:2.0:1788838340.767754:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116486912 00000100:00100000:2.0:1788838340.767871:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1467 00000100:00100000:2.0:1788838340.767883:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+33:73505:x1875729116486912:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838340.767907:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838340.767929:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca4b7 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d050 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.768092:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca4b7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d050 expref: 34 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.768138:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbc00/0x88da08396ccca4b7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d050 expref: 34 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.768164:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8ff508af1100) 00010000:00010000:3.0:1788838340.768167:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788838340.768171:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cbc00, rc 0) 00000100:00100000:3.0:1788838340.768250:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+34:73505:x1875729116486912:12345-192.168.203.30@tcp:101:touch.0 Request processed in 368us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838340.768258:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1467 00000100:00100000:1.0:1788838340.781471:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838340.781755:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116487040 00000100:00100000:3.0:1788838340.781770:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116487040 00000100:00100000:3.0:1788838340.781876:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5996 00000100:00100000:3.0:1788838340.781899:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116487040:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:3.0:1788838340.782367:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2405:x1875729116487040:12345-192.168.203.30@tcp:2:touch.0 Request processed in 476us (907us total) trans 4294969459 rc 0/0 00000100:00100000:3.0:1788838340.782378:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5996 00000100:00100000:2.0:1788838340.796772:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838340.796996:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116487296 00000100:00100000:3.0:1788838340.797009:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116487296 00000100:00100000:3.0:1788838340.797087:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:3.0:1788838340.797100:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+34:73505:x1875729116487296:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:3.0:1788838340.797508:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+35:73505:x1875729116487296:12345-192.168.203.30@tcp:35:touch.0 Request processed in 408us (748us total) trans 124554051597 rc 0/0 00000100:00100000:3.0:1788838340.797517:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:1.0:1788838340.801341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.801506:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116487552 00000100:00100000:2.0:1788838340.801533:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116487552 00000100:00100000:2.0:1788838340.801625:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1468 00000100:00100000:2.0:1788838340.801638:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+35:73505:x1875729116487552:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838340.801669:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838340.801699:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cae00/0x88da08396ccca4be lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d057 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.801895:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.801915:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.801929:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.801946:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.801953:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.801960:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838340.802496:0:66254:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x385:0x0], index 0: 0 00010000:00010000:2.0:1788838340.802676:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb400/0x88da08396ccca4d3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.802689:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb400/0x88da08396ccca4d3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.802716:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb400/0x88da08396ccca4d3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.802774:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.802782:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.802789:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.802954:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.802964:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838340.802970:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.802980:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.802998:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838340.803002:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838340.803007:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.803013:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca4c5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.803031:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffefaef6 reply state 000000003bf69a23 transno 124554051598 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.803052:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.803060:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff8ff60b5cfa00) 00010000:00010000:2.0:1788838340.803062:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838340.803066:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838340.803105:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cae00/0x88da08396ccca4be lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d057 expref: 38 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.803122:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb400/0x88da08396ccca4d3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d057 expref: 37 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.803131:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:2.0:1788838340.803134:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838340.803136:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cb400, rc 0) 00000100:00100000:2.0:1788838340.803294:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+38:73505:x1875729116487552:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1659us (1968us total) trans 124554051598 rc 0/0 00000100:00100000:2.0:1788838340.803303:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1468 00000100:00100000:1.0:1788838340.807557:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838340.807666:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116487808 00000100:00100000:3.0:1788838340.807700:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116487808 00000100:00100000:3.0:1788838340.807793:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1469 00000100:00100000:3.0:1788838340.807848:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+38:73505:x1875729116487808:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:3.0:1788838340.807933:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838340.807968:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb400/0x88da08396ccca4d3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d057 expref: 38 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.807992:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:3.0:1788838340.808005:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838340.808076:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.808093:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.808105:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838340.808244:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f06cbe9 reply state 000000007f27770a transno 124554051599 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.808257:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.808263:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8ff605587000) 00010000:00010000:3.0:1788838340.808266:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838340.808269:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788838340.808371:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+39:73505:x1875729116487808:12345-192.168.203.30@tcp:36:touch.0 Request processed in 526us (828us total) trans 124554051599 rc 0/0 00000100:00100000:3.0:1788838340.808380:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1469 00000100:00100000:1.0:1788838340.813500:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.813616:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116487936 00000100:00100000:0.0:1788838340.813630:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116487936 00000100:00100000:0.0:1788838340.813706:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1470 00000100:00100000:0.0:1788838340.813728:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+39:73505:x1875729116487936:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838340.813759:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838340.813848:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529600/0x88da08396ccca4e8 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d05e expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.813936:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529600/0x88da08396ccca4e8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d05e expref: 40 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.813953:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529600/0x88da08396ccca4e8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d05e expref: 40 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.813975:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8ff605587000) 00010000:00010000:0.0:1788838340.813979:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788838340.813982:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601529600, rc 0) 00000100:00100000:0.0:1788838340.814053:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+40:73505:x1875729116487936:12345-192.168.203.30@tcp:101:touch.0 Request processed in 337us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838340.814060:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1470 00000100:00100000:1.0:1788838340.819961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838340.820150:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116488064 00000100:00100000:3.0:1788838340.820163:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116488064 00000100:00100000:3.0:1788838340.820251:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5997 00000100:00100000:3.0:1788838340.820264:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2404:x1875729116488064:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:3.0:1788838340.820550:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2404:x1875729116488064:12345-192.168.203.30@tcp:2:touch.0 Request processed in 287us (607us total) trans 4294969460 rc 0/0 00000100:00100000:3.0:1788838340.820558:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5997 00000100:00100000:1.0:1788838340.825945:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.830908:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116488320 00000100:00100000:2.0:1788838340.830931:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116488320 00000100:00100000:2.0:1788838340.831024:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:2.0:1788838340.831036:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+40:73505:x1875729116488320:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838340.833423:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+41:73505:x1875729116488320:12345-192.168.203.30@tcp:35:touch.0 Request processed in 1760us (7004us total) trans 124554051600 rc 0/0 00000100:00100000:2.0:1788838340.833439:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:1.0:1788838340.838284:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.840356:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116488576 00000100:00100000:0.0:1788838340.840375:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116488576 00000100:00100000:0.0:1788838340.840473:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1471 00000100:00100000:0.0:1788838340.840486:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+41:73505:x1875729116488576:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838340.840522:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838340.840552:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccca4ef lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d065 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.841468:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.841491:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.841529:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.841549:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.841556:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.841563:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838340.843120:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x386:0x0], index 0: 0 00010000:00010000:0.0:1788838340.843353:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca504 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843374:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca504 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843387:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca504 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843431:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843439:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843446:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843454:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843476:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838340.843481:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843490:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843505:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838340.843508:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838340.843513:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843521:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca4f6 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838340.843540:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f37e486 reply state 00000000990042d3 transno 124554051601 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843554:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843560:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff8ff508af1a00) 00010000:00010000:0.0:1788838340.843562:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838340.843566:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838340.843623:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccca4ef lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d065 expref: 44 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843642:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca504 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d065 expref: 43 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.843663:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8ff508af1c00) 00010000:00010000:0.0:1788838340.843666:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838340.843669:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600031c00, rc 0) 00000100:00100000:0.0:1788838340.843780:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+44:73505:x1875729116488576:12345-192.168.203.30@tcp:101:touch.0 Request processed in 3294us (5508us total) trans 124554051601 rc 0/0 00000100:00100000:0.0:1788838340.843790:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1471 00000100:00100000:1.0:1788838340.851412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838340.851705:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116488832 00000100:00100000:3.0:1788838340.851728:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116488832 00000100:00100000:3.0:1788838340.851862:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1472 00000100:00100000:3.0:1788838340.851875:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+44:73505:x1875729116488832:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:3.0:1788838340.851963:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838340.852001:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca504 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d065 expref: 44 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.852027:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8ff508af1c00) 00010000:00010000:3.0:1788838340.852042:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838340.852116:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.852134:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.852147:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.853009:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea3808e8 reply state 00000000a63b378f transno 124554051602 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.853049:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.853056:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8ff5037c5200) 00010000:00010000:2.0:1788838340.853059:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838340.853063:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838340.853254:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+45:73505:x1875729116488832:12345-192.168.203.30@tcp:36:touch.0 Request processed in 1379us (1853us total) trans 124554051602 rc 0/0 00000100:00100000:2.0:1788838340.853264:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1472 00000100:00100000:1.0:1788838340.865847:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.865954:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116488960 00000100:00100000:0.0:1788838340.865969:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116488960 00000100:00100000:0.0:1788838340.866046:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1473 00000100:00100000:0.0:1788838340.866058:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+45:73505:x1875729116488960:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838340.866090:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838340.866117:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccca519 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d06c expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.866190:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccca519 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d06c expref: 46 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.866218:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030c00/0x88da08396ccca519 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d06c expref: 46 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.866238:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8ff5037c5200) 00010000:00010000:0.0:1788838340.866242:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788838340.866246:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030c00, rc 0) 00000100:00100000:0.0:1788838340.866322:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+46:73505:x1875729116488960:12345-192.168.203.30@tcp:101:touch.0 Request processed in 266us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838340.866353:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1473 00000100:00100000:1.0:1788838340.870429:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.870551:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116489088 00000100:00100000:2.0:1788838340.870566:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116489088 00000100:00100000:2.0:1788838340.870646:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5998 00000100:00100000:2.0:1788838340.870660:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2405:x1875729116489088:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:2.0:1788838340.871033:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2405:x1875729116489088:12345-192.168.203.30@tcp:2:touch.0 Request processed in 375us (617us total) trans 4294969461 rc 0/0 00000100:00100000:2.0:1788838340.871042:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5998 00000100:00100000:1.0:1788838340.877076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.877183:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116489344 00000100:00100000:2.0:1788838340.877196:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116489344 00000100:00100000:2.0:1788838340.877276:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:2.0:1788838340.877287:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+46:73505:x1875729116489344:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838340.877644:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+47:73505:x1875729116489344:12345-192.168.203.30@tcp:35:touch.0 Request processed in 357us (582us total) trans 124554051603 rc 0/0 00000100:00100000:2.0:1788838340.877652:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:3.0:1788838340.883952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.884091:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116489600 00000100:00100000:2.0:1788838340.884105:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116489600 00000100:00100000:2.0:1788838340.884246:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1474 00000100:00100000:2.0:1788838340.884278:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+47:73505:x1875729116489600:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838340.884310:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838340.884337:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cae00/0x88da08396ccca520 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d073 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.884480:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.884500:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.884513:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.884531:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.884538:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.884545:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838340.885058:0:66254:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x387:0x0], index 0: 0 00010000:00010000:2.0:1788838340.885239:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca600/0x88da08396ccca535 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885251:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca600/0x88da08396ccca535 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885260:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca600/0x88da08396ccca535 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885311:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885321:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885326:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885333:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885339:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838340.885344:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885353:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885368:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838340.885371:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838340.885376:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885383:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca527 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.885401:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3179f95 reply state 000000003c438269 transno 124554051604 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885413:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885426:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff8ff60b5cf900) 00010000:00010000:2.0:1788838340.885429:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838340.885432:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838340.885467:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cae00/0x88da08396ccca520 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d073 expref: 50 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885485:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca600/0x88da08396ccca535 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d073 expref: 49 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.885492:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:2.0:1788838340.885495:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838340.885497:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3ca600, rc 0) 00000100:00100000:2.0:1788838340.885585:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+50:73505:x1875729116489600:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1311us (1648us total) trans 124554051604 rc 0/0 00000100:00100000:2.0:1788838340.885594:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1474 00000100:00100000:1.0:1788838340.891729:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.891844:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116489856 00000100:00100000:0.0:1788838340.891858:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116489856 00000100:00100000:0.0:1788838340.891987:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1475 00000100:00100000:0.0:1788838340.892001:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+50:73505:x1875729116489856:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:0.0:1788838340.892108:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838340.892143:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca600/0x88da08396ccca535 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d073 expref: 50 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.892169:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:0.0:1788838340.892182:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838340.892272:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.892289:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.892301:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838340.892439:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c46fc32 reply state 00000000cb3da1a6 transno 124554051605 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.892454:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.892460:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8ff508af1400) 00010000:00010000:0.0:1788838340.892463:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838340.892465:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838340.892709:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+51:73505:x1875729116489856:12345-192.168.203.30@tcp:36:touch.0 Request processed in 710us (1002us total) trans 124554051605 rc 0/0 00000100:00100000:0.0:1788838340.892728:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1475 00000100:00100000:1.0:1788838340.902923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.903038:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116489984 00000100:00100000:2.0:1788838340.903051:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116489984 00000100:00100000:2.0:1788838340.903126:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1476 00000100:00100000:2.0:1788838340.903140:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+51:73505:x1875729116489984:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838340.903171:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838340.903198:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cae00/0x88da08396ccca54a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d07a expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.903271:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cae00/0x88da08396ccca54a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d07a expref: 52 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.903289:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cae00/0x88da08396ccca54a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d07a expref: 52 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.903333:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8ff508af1400) 00010000:00010000:2.0:1788838340.903336:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838340.903341:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cae00, rc 0) 00000100:00100000:2.0:1788838340.903411:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+52:73505:x1875729116489984:12345-192.168.203.30@tcp:101:touch.0 Request processed in 275us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838340.903420:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1476 00000100:00100000:2.0:1788838340.909032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838340.909185:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116490112 00000100:00100000:1.0:1788838340.909200:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116490112 00000100:00100000:1.0:1788838340.909284:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5999 00000100:00100000:1.0:1788838340.909297:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2407:x1875729116490112:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:1.0:1788838340.909631:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116490112:12345-192.168.203.30@tcp:2:touch.0 Request processed in 335us (612us total) trans 4294969462 rc 0/0 00000100:00100000:1.0:1788838340.909641:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5999 00000100:00100000:1.0:1788838340.913883:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.914937:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116490368 00000100:00100000:2.0:1788838340.914954:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116490368 00000100:00100000:2.0:1788838340.915043:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 251 00000100:00100000:2.0:1788838340.915057:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+52:73505:x1875729116490368:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838340.915459:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+53:73505:x1875729116490368:12345-192.168.203.30@tcp:35:touch.0 Request processed in 403us (1589us total) trans 124554051606 rc 0/0 00000100:00100000:2.0:1788838340.915468:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 251 00000100:00100000:3.0:1788838340.921665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.921780:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116490624 00000100:00100000:0.0:1788838340.921794:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116490624 00000100:00100000:0.0:1788838340.921917:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1477 00000100:00100000:0.0:1788838340.921928:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+53:73505:x1875729116490624:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838340.921960:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838340.921996:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccca551 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d081 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.922132:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.922151:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.922165:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.922183:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.922190:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.922197:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788838340.925163:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x388:0x0], index 0: 0 00010000:00010000:1.0:1788838340.925404:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca566 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.925426:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca566 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.927669:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca566 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928082:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928093:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928099:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928108:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928114:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838340.928119:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928127:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928145:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:1.0:1788838340.928149:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838340.928155:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928162:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca558 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838340.928185:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000365b2846 reply state 00000000c31cd47d transno 124554051607 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928210:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928218:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff8ff508af1b00) 00010000:00010000:1.0:1788838340.928221:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838340.928224:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788838340.928289:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccca551 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d081 expref: 56 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928308:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca566 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d081 expref: 55 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.928316:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8ff61d841200) 00010000:00010000:1.0:1788838340.928319:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838340.928321:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6c800, rc 0) 00000100:00100000:1.0:1788838340.928447:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+56:73505:x1875729116490624:12345-192.168.203.30@tcp:101:touch.0 Request processed in 6520us (6796us total) trans 124554051607 rc 0/0 00000100:00100000:1.0:1788838340.928458:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1477 00000100:00100000:3.0:1788838340.934445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838340.934702:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116490880 00000100:00100000:2.0:1788838340.934730:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116490880 00000100:00100000:2.0:1788838340.934865:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1478 00000100:00100000:2.0:1788838340.934881:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+56:73505:x1875729116490880:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:2.0:1788838340.936037:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838340.936086:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca566 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d081 expref: 56 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.936175:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8ff61d841200) 00010000:00010000:2.0:1788838340.936191:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838340.936353:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.936371:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.936383:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838340.936541:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f403659 reply state 000000007f9be3be transno 124554051608 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.936555:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838340.936561:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8ff60b5cf700) 00010000:00010000:2.0:1788838340.936564:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838340.936568:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838340.936910:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+57:73505:x1875729116490880:12345-192.168.203.30@tcp:36:touch.0 Request processed in 2028us (2471us total) trans 124554051608 rc 0/0 00000100:00100000:2.0:1788838340.936924:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1478 00000100:00100000:2.0:1788838340.940354:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.942732:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116491008 00000100:00100000:0.0:1788838340.942756:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116491008 00000100:00100000:0.0:1788838340.943144:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1479 00000100:00100000:0.0:1788838340.943157:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+57:73505:x1875729116491008:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838340.943191:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838340.943221:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccca57b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d088 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.943367:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccca57b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d088 expref: 58 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.943389:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030200/0x88da08396ccca57b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d088 expref: 58 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.943415:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8ff60b5cf700) 00010000:00010000:0.0:1788838340.943418:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788838340.943424:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff600030200, rc 0) 00000100:00100000:0.0:1788838340.943518:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+58:73505:x1875729116491008:12345-192.168.203.30@tcp:101:touch.0 Request processed in 363us (3179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838340.943526:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1479 00000100:00100000:3.0:1788838340.946619:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838340.946744:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116491136 00000100:00100000:1.0:1788838340.946758:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116491136 00000100:00100000:1.0:1788838340.946878:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6000 00000100:00100000:1.0:1788838340.946890:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116491136:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:1.0:1788838340.947482:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2407:x1875729116491136:12345-192.168.203.30@tcp:2:touch.0 Request processed in 591us (881us total) trans 4294969463 rc 0/0 00000100:00100000:1.0:1788838340.947492:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6000 00000100:00100000:3.0:1788838340.955033:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.955330:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116491392 00000100:00100000:0.0:1788838340.955343:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116491392 00000100:00100000:0.0:1788838340.955430:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 252 00000100:00100000:0.0:1788838340.955442:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50358e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+58:73505:x1875729116491392:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:0.0:1788838340.955950:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50358e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+59:73505:x1875729116491392:12345-192.168.203.30@tcp:35:touch.0 Request processed in 506us (929us total) trans 124554051609 rc 0/0 00000100:00100000:0.0:1788838340.955960:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 252 00000100:00100000:2.0:1788838340.965566:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838340.965890:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116491648 00000100:00100000:0.0:1788838340.965906:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116491648 00000100:00100000:0.0:1788838340.966006:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1480 00000100:00100000:0.0:1788838340.966019:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+59:73505:x1875729116491648:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838340.966057:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838340.966085:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca582 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d08f expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.966240:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.966260:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.966273:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.966292:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.966300:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838340.966307:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788838340.970488:0:66255:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x389:0x0], index 0: 0 00010000:00010000:1.0:1788838340.971054:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca597 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971077:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca597 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971092:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca597 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971294:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971303:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971310:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971318:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971324:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838340.971330:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971339:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971355:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:1.0:1788838340.971358:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838340.971364:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971387:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca589 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838340.971408:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cccd1f3 reply state 00000000e301dde4 transno 124554051610 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971422:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971429:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff8ff508af1300) 00010000:00010000:1.0:1788838340.971431:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838340.971435:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788838340.971486:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca582 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d08f expref: 62 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971503:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca597 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d08f expref: 61 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.971523:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8ff61d841b00) 00010000:00010000:1.0:1788838340.971526:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838340.971529:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6c200, rc 0) 00000100:00100000:1.0:1788838340.971912:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+62:73505:x1875729116491648:12345-192.168.203.30@tcp:101:touch.0 Request processed in 5893us (6358us total) trans 124554051610 rc 0/0 00000100:00100000:1.0:1788838340.971923:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1480 00000100:00100000:3.0:1788838340.976338:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838340.976738:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116491904 00000100:00100000:1.0:1788838340.976752:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116491904 00000100:00100000:1.0:1788838340.976976:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1481 00000100:00100000:1.0:1788838340.976989:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+62:73505:x1875729116491904:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:1.0:1788838340.977225:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838340.977262:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca597 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d08f expref: 62 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.977291:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8ff61d841b00) 00010000:00010000:1.0:1788838340.977305:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838340.977382:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.977399:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.977411:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838340.978042:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001adac2be reply state 0000000003105186 transno 124554051611 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.978061:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838340.978068:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8ff61d841300) 00010000:00010000:1.0:1788838340.978255:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838340.978260:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838340.978475:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+63:73505:x1875729116491904:12345-192.168.203.30@tcp:36:touch.0 Request processed in 1486us (2149us total) trans 124554051611 rc 0/0 00000100:00100000:1.0:1788838340.978484:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1481 00000100:00100000:1.0:1788838340.982333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838340.982555:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116492032 00000100:00100000:3.0:1788838340.982570:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116492032 00000100:00100000:3.0:1788838340.982940:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1482 00000100:00100000:3.0:1788838340.982953:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+63:73505:x1875729116492032:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:3.0:1788838340.982986:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838340.983014:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca5ac lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d096 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.983095:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca5ac lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d096 expref: 64 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.983298:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee000/0x88da08396ccca5ac lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d096 expref: 64 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838340.983325:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8ff61d841300) 00010000:00010000:3.0:1788838340.983328:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788838340.983333:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ee000, rc 0) 00000100:00100000:3.0:1788838340.983456:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+64:73505:x1875729116492032:12345-192.168.203.30@tcp:101:touch.0 Request processed in 506us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838340.983463:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1482 00000100:00100000:2.0:1788838340.987741:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838340.987982:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116492160 00000100:00100000:1.0:1788838340.987996:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116492160 00000100:00100000:1.0:1788838340.988133:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6001 00000100:00100000:1.0:1788838340.988146:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2404:x1875729116492160:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:1.0:1788838340.988507:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:efc561ba-875e-4857-b79b-9bd7023bd57c+13:2404:x1875729116492160:12345-192.168.203.30@tcp:2:touch.0 Request processed in 362us (789us total) trans 4294969464 rc 0/0 00000100:00100000:1.0:1788838340.988527:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6001 00000100:00100000:0.0:1788838340.996258:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838340.996415:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116492416 00000100:00100000:1.0:1788838340.996429:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116492416 00000100:00100000:1.0:1788838340.996503:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00100000:1.0:1788838340.996526:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+64:73505:x1875729116492416:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:1.0:1788838340.997154:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+65:73505:x1875729116492416:12345-192.168.203.30@tcp:35:touch.0 Request processed in 637us (908us total) trans 124554051612 rc 0/0 00000100:00100000:1.0:1788838340.997165:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00100000:3.0:1788838341.001193:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.001587:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116492672 00000100:00100000:1.0:1788838341.001607:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116492672 00000100:00100000:1.0:1788838341.001692:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1483 00000100:00100000:1.0:1788838341.001704:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+65:73505:x1875729116492672:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:1.0:1788838341.001747:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838341.001777:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5b3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d09d expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.001965:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.001985:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.001998:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002034:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002041:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002047:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788838341.002499:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38a:0x0], index 0: 0 00010000:00010000:1.0:1788838341.002684:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca5c8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002695:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca5c8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002703:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca5c8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002757:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002766:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002773:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002781:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002788:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838341.002845:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002854:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002871:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:1.0:1788838341.002875:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838341.002880:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002886:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5ba lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838341.002903:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ad2bf37 reply state 00000000bff91078 transno 124554051613 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002915:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002921:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff8ff61d841b00) 00010000:00010000:1.0:1788838341.002923:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838341.002926:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788838341.002966:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5b3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d09d expref: 68 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.002985:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca5c8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d09d expref: 67 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.003004:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8ff61d841400) 00010000:00010000:1.0:1788838341.003007:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838341.003019:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6c800, rc 0) 00000100:00100000:1.0:1788838341.003102:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+68:73505:x1875729116492672:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1400us (1926us total) trans 124554051613 rc 0/0 00000100:00100000:1.0:1788838341.003111:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1483 00000100:00100000:2.0:1788838341.012776:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.012973:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116492928 00000100:00100000:1.0:1788838341.012987:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116492928 00000100:00100000:1.0:1788838341.013067:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1484 00000100:00100000:1.0:1788838341.013090:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+68:73505:x1875729116492928:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:1.0:1788838341.013223:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838341.013259:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca5c8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d09d expref: 68 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.013286:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8ff61d841400) 00010000:00010000:1.0:1788838341.013300:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838341.013374:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.013391:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.013403:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838341.013548:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003864e80b reply state 0000000006d4e961 transno 124554051614 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.013563:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.013569:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8ff61d841700) 00010000:00010000:1.0:1788838341.013580:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838341.013584:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838341.013704:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+69:73505:x1875729116492928:12345-192.168.203.30@tcp:36:touch.0 Request processed in 617us (943us total) trans 124554051614 rc 0/0 00000100:00100000:1.0:1788838341.013712:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1484 00000100:00100000:0.0:1788838341.021135:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.021264:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116493056 00000100:00100000:2.0:1788838341.021277:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116493056 00000100:00100000:2.0:1788838341.021351:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1485 00000100:00100000:2.0:1788838341.021362:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+69:73505:x1875729116493056:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838341.021394:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838341.021439:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb400/0x88da08396ccca5dd lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0a4 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.021516:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb400/0x88da08396ccca5dd lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0a4 expref: 70 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.021534:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb400/0x88da08396ccca5dd lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0a4 expref: 70 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.021556:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8ff61d841700) 00010000:00010000:2.0:1788838341.021560:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838341.021565:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cb400, rc 0) 00000100:00100000:2.0:1788838341.021656:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+70:73505:x1875729116493056:12345-192.168.203.30@tcp:101:touch.0 Request processed in 296us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838341.021664:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1485 00000100:00100000:3.0:1788838341.025473:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.025611:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116493184 00000100:00100000:1.0:1788838341.025624:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116493184 00000100:00100000:1.0:1788838341.025699:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6002 00000100:00100000:1.0:1788838341.025711:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64134ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+13:2405:x1875729116493184:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:1.0:1788838341.026069:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64134ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+14:2405:x1875729116493184:12345-192.168.203.30@tcp:2:touch.0 Request processed in 357us (609us total) trans 4294969465 rc 0/0 00000100:00100000:1.0:1788838341.026078:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6002 00000100:00100000:0.0:1788838341.031512:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.031638:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116493440 00000100:00100000:2.0:1788838341.031651:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116493440 00000100:00100000:2.0:1788838341.031742:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:2.0:1788838341.031754:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+70:73505:x1875729116493440:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838341.032307:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+71:73505:x1875729116493440:12345-192.168.203.30@tcp:35:touch.0 Request processed in 443us (701us total) trans 124554051615 rc 0/0 00000100:00100000:2.0:1788838341.032318:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:3.0:1788838341.035100:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.035243:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116493696 00000100:00100000:1.0:1788838341.035257:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116493696 00000100:00100000:1.0:1788838341.035340:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1486 00000100:00100000:1.0:1788838341.035353:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+71:73505:x1875729116493696:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:1.0:1788838341.035388:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838341.035416:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca5e4 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0ab expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.035560:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.035581:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.035596:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.035635:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.035643:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.035650:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838341.036409:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38b:0x0], index 0: 0 00010000:00010000:0.0:1788838341.036597:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627000/0x88da08396ccca5f9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036622:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627000/0x88da08396ccca5f9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036631:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627000/0x88da08396ccca5f9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036676:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036683:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036690:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036697:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036704:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838341.036710:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036727:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036743:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838341.036747:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838341.036755:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036763:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca5eb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838341.036787:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080f8c5a9 reply state 00000000f5f552d5 transno 124554051616 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036851:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036859:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff8ff61d841400) 00010000:00010000:0.0:1788838341.036861:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838341.036864:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838341.036906:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca5e4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0ab expref: 74 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036926:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627000/0x88da08396ccca5f9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0ab expref: 73 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.036934:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8ff508af1000) 00010000:00010000:0.0:1788838341.036936:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838341.036938:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627000, rc 0) 00000100:00100000:0.0:1788838341.037042:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+74:73505:x1875729116493696:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1690us (1968us total) trans 124554051616 rc 0/0 00000100:00100000:0.0:1788838341.037051:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1486 00000100:00100000:3.0:1788838341.041577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.041840:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116493952 00000100:00100000:1.0:1788838341.041854:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116493952 00000100:00100000:1.0:1788838341.041921:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1487 00000100:00100000:1.0:1788838341.041933:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+74:73505:x1875729116493952:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:1.0:1788838341.042010:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838341.042047:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627000/0x88da08396ccca5f9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0ab expref: 74 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.042086:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8ff508af1000) 00010000:00010000:1.0:1788838341.042102:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838341.042178:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.042204:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.042216:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838341.042363:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac608ddc reply state 00000000b1ad5c5b transno 124554051617 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.042388:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.042395:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8ff61d841600) 00010000:00010000:1.0:1788838341.042398:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838341.042401:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838341.042527:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+75:73505:x1875729116493952:12345-192.168.203.30@tcp:36:touch.0 Request processed in 594us (963us total) trans 124554051617 rc 0/0 00000100:00100000:1.0:1788838341.042535:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1487 00000100:00100000:3.0:1788838341.045574:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.045849:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116494080 00000100:00100000:2.0:1788838341.045864:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116494080 00000100:00100000:2.0:1788838341.045945:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1488 00000100:00100000:2.0:1788838341.045957:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+75:73505:x1875729116494080:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838341.045993:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838341.046041:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca600/0x88da08396ccca60e lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0b2 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.046137:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca600/0x88da08396ccca60e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0b2 expref: 76 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.046155:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca600/0x88da08396ccca60e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0b2 expref: 76 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.046178:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8ff61d841600) 00010000:00010000:2.0:1788838341.046182:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838341.046186:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3ca600, rc 0) 00000100:00100000:2.0:1788838341.046275:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+76:73505:x1875729116494080:12345-192.168.203.30@tcp:101:touch.0 Request processed in 320us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838341.046283:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1488 00000100:00100000:3.0:1788838341.050729:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838341.052831:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116494208 00000100:00100000:0.0:1788838341.052850:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116494208 00000100:00100000:0.0:1788838341.052936:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6003 00000100:00100000:0.0:1788838341.052946:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+14:2405:x1875729116494208:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:0.0:1788838341.053261:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+15:2405:x1875729116494208:12345-192.168.203.30@tcp:2:touch.0 Request processed in 315us (2556us total) trans 4294969466 rc 0/0 00000100:00100000:0.0:1788838341.053290:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6003 00000100:00100000:1.0:1788838341.055739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838341.056179:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116494464 00000100:00100000:0.0:1788838341.056191:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116494464 00000100:00100000:0.0:1788838341.056266:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 255 00000100:00100000:0.0:1788838341.056277:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+76:73505:x1875729116494464:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:0.0:1788838341.056989:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+77:73505:x1875729116494464:12345-192.168.203.30@tcp:35:touch.0 Request processed in 709us (1274us total) trans 124554051618 rc 0/0 00000100:00100000:0.0:1788838341.056998:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 255 00000100:00100000:3.0:1788838341.059777:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.059923:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116494720 00000100:00100000:1.0:1788838341.059937:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116494720 00000100:00100000:1.0:1788838341.060014:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1489 00000100:00100000:1.0:1788838341.060026:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+77:73505:x1875729116494720:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:1.0:1788838341.060061:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838341.060101:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca615 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0b9 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.060310:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.060331:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.060345:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.060364:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.060390:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.060397:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788838341.060859:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38c:0x0], index 0: 0 00010000:00010000:1.0:1788838341.061034:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca62a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061045:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca62a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061054:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca62a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061093:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061102:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061108:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061116:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061122:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6ca00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838341.061128:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061149:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061164:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:1.0:1788838341.061168:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838341.061174:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061181:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca61c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838341.061915:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df7df95c reply state 0000000093343a79 transno 124554051619 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061938:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.061945:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff8ff61d841900) 00010000:00010000:1.0:1788838341.061948:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838341.061952:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788838341.062011:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca615 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0b9 expref: 80 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.062034:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca62a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0b9 expref: 79 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.062042:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8ff61d841a00) 00010000:00010000:1.0:1788838341.062045:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838341.062047:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6c800, rc 0) 00000100:00100000:1.0:1788838341.062358:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+80:73505:x1875729116494720:12345-192.168.203.30@tcp:101:touch.0 Request processed in 2332us (2593us total) trans 124554051619 rc 0/0 00000100:00100000:1.0:1788838341.062368:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1489 00000100:00100000:3.0:1788838341.065687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.065763:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116494976 00000100:00100000:1.0:1788838341.065776:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116494976 00000100:00100000:1.0:1788838341.065879:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1490 00000100:00100000:1.0:1788838341.065894:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+80:73505:x1875729116494976:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:1.0:1788838341.065974:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838341.066010:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca62a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0b9 expref: 80 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.066039:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8ff61d841a00) 00010000:00010000:1.0:1788838341.066051:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838341.066134:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.066150:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.066162:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838341.066328:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ffbf79b reply state 000000005eca4c61 transno 124554051620 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.066343:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.066349:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8ff61d841500) 00010000:00010000:1.0:1788838341.066372:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838341.066375:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838341.067013:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+81:73505:x1875729116494976:12345-192.168.203.30@tcp:36:touch.0 Request processed in 1118us (1335us total) trans 124554051620 rc 0/0 00000100:00100000:1.0:1788838341.067024:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1490 00000100:00100000:3.0:1788838341.069193:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.069441:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116495104 00000100:00100000:2.0:1788838341.069454:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116495104 00000100:00100000:2.0:1788838341.069537:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1491 00000100:00100000:2.0:1788838341.069551:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+81:73505:x1875729116495104:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838341.069585:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838341.069732:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccca63f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0c0 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.070690:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccca63f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0c0 expref: 82 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.070713:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fc00/0x88da08396ccca63f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0c0 expref: 82 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.070783:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8ff61d841500) 00010000:00010000:2.0:1788838341.070787:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838341.070792:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148fc00, rc 0) 00000100:00100000:2.0:1788838341.071018:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+82:73505:x1875729116495104:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1469us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838341.071027:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1491 00000100:00100000:3.0:1788838341.074087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.074379:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116495232 00000100:00100000:1.0:1788838341.074393:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116495232 00000100:00100000:1.0:1788838341.074468:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6004 00000100:00100000:1.0:1788838341.074479:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+15:2405:x1875729116495232:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:1.0:1788838341.074785:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+16:2405:x1875729116495232:12345-192.168.203.30@tcp:2:touch.0 Request processed in 307us (712us total) trans 4294969467 rc 0/0 00000100:00100000:1.0:1788838341.074995:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6004 00000100:00100000:1.0:1788838341.077785:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.077915:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116495488 00000100:00100000:2.0:1788838341.077927:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116495488 00000100:00100000:2.0:1788838341.077993:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 256 00000100:00100000:2.0:1788838341.078003:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+82:73505:x1875729116495488:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838341.078379:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+83:73505:x1875729116495488:12345-192.168.203.30@tcp:35:touch.0 Request processed in 376us (609us total) trans 124554051621 rc 0/0 00000100:00100000:2.0:1788838341.078388:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 256 00000100:00100000:0.0:1788838341.082043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.082158:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116495744 00000100:00100000:3.0:1788838341.082173:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116495744 00000100:00100000:3.0:1788838341.082270:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1492 00000100:00100000:3.0:1788838341.082283:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+83:73505:x1875729116495744:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:3.0:1788838341.082321:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838341.082352:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca646 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0c7 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.082502:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.082522:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.082538:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.082558:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.082566:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.082573:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788838341.083081:0:66255:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38d:0x0], index 0: 0 00010000:00010000:3.0:1788838341.083270:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccca65b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083282:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccca65b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083292:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccca65b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083335:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083343:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083349:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083356:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083362:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3eee00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838341.083367:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083375:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083390:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:3.0:1788838341.083393:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838341.083410:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083418:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca64d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838341.083435:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000ffb2b6 reply state 000000009fbb545c transno 124554051622 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083447:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083454:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff8ff5037c5400) 00010000:00010000:3.0:1788838341.083456:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838341.083459:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788838341.083498:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca646 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0c7 expref: 86 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083516:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccca65b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0c7 expref: 85 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.083525:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8ff5037c5800) 00010000:00010000:3.0:1788838341.083527:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838341.083529:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8200, rc 0) 00000100:00100000:3.0:1788838341.083618:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+86:73505:x1875729116495744:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1338us (1590us total) trans 124554051622 rc 0/0 00000100:00100000:3.0:1788838341.083626:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1492 00000100:00100000:3.0:1788838341.087339:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.087932:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116496000 00000100:00100000:2.0:1788838341.087948:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116496000 00000100:00100000:2.0:1788838341.088135:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1493 00000100:00100000:2.0:1788838341.088149:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+86:73505:x1875729116496000:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:2.0:1788838341.088310:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838341.088351:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccca65b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0c7 expref: 86 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.088378:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8ff5037c5800) 00010000:00010000:2.0:1788838341.088392:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838341.088472:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.088505:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.088516:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838341.088747:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f9b405c reply state 0000000037a6f437 transno 124554051623 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.088762:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.088769:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:2.0:1788838341.088772:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838341.088775:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838341.089414:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+87:73505:x1875729116496000:12345-192.168.203.30@tcp:36:touch.0 Request processed in 1263us (2086us total) trans 124554051623 rc 0/0 00000100:00100000:2.0:1788838341.089425:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1493 00000100:00100000:2.0:1788838341.091957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.092058:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116496128 00000100:00100000:3.0:1788838341.092139:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116496128 00000100:00100000:3.0:1788838341.092332:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1494 00000100:00100000:3.0:1788838341.092346:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+87:73505:x1875729116496128:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:3.0:1788838341.092381:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838341.092411:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccca670 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0ce expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.092496:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccca670 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0ce expref: 88 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.092516:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9200/0x88da08396ccca670 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0ce expref: 88 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.092539:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:3.0:1788838341.092543:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788838341.092548:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9200, rc 0) 00000100:00100000:3.0:1788838341.092762:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+88:73505:x1875729116496128:12345-192.168.203.30@tcp:101:touch.0 Request processed in 418us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838341.092770:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1494 00000100:00100000:1.0:1788838341.101894:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.102009:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116496256 00000100:00100000:3.0:1788838341.102026:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116496256 00000100:00100000:3.0:1788838341.102102:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6005 00000100:00100000:3.0:1788838341.102114:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+16:2404:x1875729116496256:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:3.0:1788838341.102440:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+17:2404:x1875729116496256:12345-192.168.203.30@tcp:2:touch.0 Request processed in 327us (561us total) trans 4294969468 rc 0/0 00000100:00100000:3.0:1788838341.102449:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6005 00000100:00100000:1.0:1788838341.104852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838341.104990:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116496512 00000100:00100000:0.0:1788838341.105003:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116496512 00000100:00100000:0.0:1788838341.105082:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00100000:0.0:1788838341.105095:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+88:73505:x1875729116496512:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:0.0:1788838341.105555:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+89:73505:x1875729116496512:12345-192.168.203.30@tcp:35:touch.0 Request processed in 460us (714us total) trans 124554051624 rc 0/0 00000100:00100000:0.0:1788838341.105565:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00100000:3.0:1788838341.108682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.108765:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116496768 00000100:00100000:2.0:1788838341.108780:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116496768 00000100:00100000:2.0:1788838341.108899:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1495 00000100:00100000:2.0:1788838341.108913:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+89:73505:x1875729116496768:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838341.108946:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838341.108977:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca677 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0d5 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109129:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109166:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109180:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109210:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109218:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109225:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838341.109638:0:66255:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38e:0x0], index 0: 0 00010000:00010000:2.0:1788838341.109872:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396ccca68c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109884:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396ccca68c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109893:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396ccca68c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109935:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109942:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109948:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109966:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109973:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838341.109978:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.109987:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.110002:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838341.110005:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838341.110010:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.110017:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca67e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838341.110034:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000baa7ad57 reply state 000000001307913e transno 124554051625 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.110047:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.110053:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff8ff61254c000) 00010000:00010000:2.0:1788838341.110055:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838341.110059:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838341.110105:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca677 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0d5 expref: 92 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.110121:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396ccca68c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0d5 expref: 91 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.110136:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8ff61254c700) 00010000:00010000:2.0:1788838341.110138:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838341.110141:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f10400, rc 0) 00000100:00100000:2.0:1788838341.111060:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+92:73505:x1875729116496768:12345-192.168.203.30@tcp:101:touch.0 Request processed in 2143us (2383us total) trans 124554051625 rc 0/0 00000100:00100000:2.0:1788838341.111085:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1495 00000100:00100000:3.0:1788838341.114429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.114934:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116497024 00000100:00100000:1.0:1788838341.114949:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116497024 00000100:00100000:1.0:1788838341.115068:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1496 00000100:00100000:1.0:1788838341.115168:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+92:73505:x1875729116497024:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:1.0:1788838341.115320:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838341.115360:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396ccca68c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0d5 expref: 92 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.115385:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8ff61254c700) 00010000:00010000:1.0:1788838341.115400:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838341.115481:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.115515:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.115528:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838341.115850:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c968084 reply state 000000007666ccd9 transno 124554051626 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.115867:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.115875:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8ff61d841a00) 00010000:00010000:1.0:1788838341.115877:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838341.115880:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838341.116054:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+93:73505:x1875729116497024:12345-192.168.203.30@tcp:36:touch.0 Request processed in 890us (1644us total) trans 124554051626 rc 0/0 00000100:00100000:1.0:1788838341.116063:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1496 00000100:00100000:1.0:1788838341.119391:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.119500:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116497152 00000100:00100000:2.0:1788838341.119516:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116497152 00000100:00100000:2.0:1788838341.119726:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1497 00000100:00100000:2.0:1788838341.119742:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+93:73505:x1875729116497152:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838341.119781:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838341.119863:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10200/0x88da08396ccca6a1 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0dc expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.119949:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10200/0x88da08396ccca6a1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0dc expref: 94 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.119967:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10200/0x88da08396ccca6a1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0dc expref: 94 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.119989:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8ff61d841a00) 00010000:00010000:2.0:1788838341.119993:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838341.119997:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f10200, rc 0) 00000100:00100000:2.0:1788838341.120079:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+94:73505:x1875729116497152:12345-192.168.203.30@tcp:101:touch.0 Request processed in 341us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838341.120108:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1497 00000100:00100000:0.0:1788838341.124393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.124490:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116497280 00000100:00100000:3.0:1788838341.124504:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116497280 00000100:00100000:3.0:1788838341.124627:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6006 00000100:00100000:3.0:1788838341.124640:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+17:2404:x1875729116497280:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:3.0:1788838341.124973:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2404:x1875729116497280:12345-192.168.203.30@tcp:2:touch.0 Request processed in 334us (595us total) trans 4294969469 rc 0/0 00000100:00100000:3.0:1788838341.124983:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6006 00000100:00100000:1.0:1788838341.127496:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838341.127658:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116497536 00000100:00100000:0.0:1788838341.127671:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116497536 00000100:00100000:0.0:1788838341.127784:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:0.0:1788838341.128041:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50358d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+94:73505:x1875729116497536:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:0.0:1788838341.128441:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50358d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+95:73505:x1875729116497536:12345-192.168.203.30@tcp:35:touch.0 Request processed in 644us (958us total) trans 124554051627 rc 0/0 00000100:00100000:0.0:1788838341.128451:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:1.0:1788838341.131111:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.132432:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116497792 00000100:00100000:3.0:1788838341.132454:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116497792 00000100:00100000:3.0:1788838341.132557:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1498 00000100:00100000:3.0:1788838341.132574:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+95:73505:x1875729116497792:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:3.0:1788838341.132766:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838341.132890:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca6a8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0e3 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.133040:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.133061:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.133076:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.133094:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.133101:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.133137:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788838341.134904:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38f:0x0], index 0: 0 00010000:00010000:3.0:1788838341.135589:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca6bd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135669:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca6bd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135684:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca6bd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135754:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135762:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135769:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135777:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135785:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838341.135831:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135842:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135877:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:3.0:1788838341.135880:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838341.135886:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135892:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca6af lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838341.135910:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088d2e3f6 reply state 000000005bb554ae transno 124554051628 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135923:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.135930:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff8ff5037c5500) 00010000:00010000:3.0:1788838341.135933:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838341.135936:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788838341.135984:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca6a8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0e3 expref: 98 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.136001:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca6bd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0e3 expref: 97 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.136009:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8ff5037c5900) 00010000:00010000:3.0:1788838341.136012:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838341.136014:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9400, rc 0) 00000100:00100000:3.0:1788838341.136105:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+98:73505:x1875729116497792:12345-192.168.203.30@tcp:101:touch.0 Request processed in 3535us (5008us total) trans 124554051628 rc 0/0 00000100:00100000:3.0:1788838341.136114:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1498 00000100:00100000:1.0:1788838341.138898:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.139061:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116498048 00000100:00100000:3.0:1788838341.139081:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116498048 00000100:00100000:3.0:1788838341.139143:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1499 00000100:00100000:3.0:1788838341.139153:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+98:73505:x1875729116498048:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:3.0:1788838341.139367:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838341.139403:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca6bd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0e3 expref: 98 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.139427:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8ff5037c5900) 00010000:00010000:3.0:1788838341.139439:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838341.139501:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.139514:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.139525:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838341.140293:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011504df8 reply state 0000000023e6142f transno 124554051629 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.140315:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.140324:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8ff5037c5700) 00010000:00010000:2.0:1788838341.140327:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838341.140330:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838341.140505:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+99:73505:x1875729116498048:12345-192.168.203.30@tcp:36:touch.0 Request processed in 1351us (1617us total) trans 124554051629 rc 0/0 00000100:00100000:2.0:1788838341.140514:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1499 00000100:00100000:1.0:1788838341.142991:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.143100:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116498176 00000100:00100000:3.0:1788838341.143115:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116498176 00000100:00100000:3.0:1788838341.143307:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1500 00000100:00100000:3.0:1788838341.143320:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+99:73505:x1875729116498176:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:3.0:1788838341.143354:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838341.143383:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccca6d2 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0ea expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.143460:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccca6d2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0ea expref: 100 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.143500:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8200/0x88da08396ccca6d2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0ea expref: 100 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.143524:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8ff5037c5700) 00010000:00010000:3.0:1788838341.143528:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788838341.143533:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8200, rc 0) 00000100:00100000:3.0:1788838341.143757:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+100:73505:x1875729116498176:12345-192.168.203.30@tcp:101:touch.0 Request processed in 438us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838341.143766:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1500 00000100:00100000:1.0:1788838341.147023:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.147111:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116498304 00000100:00100000:3.0:1788838341.147126:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116498304 00000100:00100000:0.0:1788838341.147292:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6007 00000100:00100000:0.0:1788838341.147310:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2404:x1875729116498304:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:0.0:1788838341.147625:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+19:2404:x1875729116498304:12345-192.168.203.30@tcp:2:touch.0 Request processed in 320us (617us total) trans 4294969470 rc 0/0 00000100:00100000:0.0:1788838341.147634:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6007 00000100:00100000:1.0:1788838341.150187:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.150343:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116498560 00000100:00100000:3.0:1788838341.150355:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116498560 00000100:00100000:3.0:1788838341.150430:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:3.0:1788838341.150442:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+100:73505:x1875729116498560:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:3.0:1788838341.151109:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+101:73505:x1875729116498560:12345-192.168.203.30@tcp:35:touch.0 Request processed in 665us (932us total) trans 124554051630 rc 0/0 00000100:00100000:3.0:1788838341.151120:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:1.0:1788838341.154538:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.154713:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116498816 00000100:00100000:2.0:1788838341.154735:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116498816 00000100:00100000:2.0:1788838341.154979:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1501 00000100:00100000:2.0:1788838341.154992:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+101:73505:x1875729116498816:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838341.155024:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838341.155051:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca6d9 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0f1 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.155355:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.155376:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.155390:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.155433:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.155442:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.155449:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838341.160373:0:66255:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x390:0x0], index 0: 0 00010000:00010000:0.0:1788838341.160861:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca6ee lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.160884:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca6ee lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.160900:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca6ee lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.160974:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.160983:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.160989:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.160997:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.161004:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838341.161010:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.161041:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.161058:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838341.161061:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838341.161067:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.161074:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca6e0 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838341.161089:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000304fa4e reply state 000000001dac522b transno 124554051631 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.161103:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.161109:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff8ff61254cb00) 00010000:00010000:0.0:1788838341.161111:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838341.161115:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838341.161162:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca6d9 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0f1 expref: 104 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.161180:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca6ee lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0f1 expref: 103 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.161189:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8ff508af1500) 00010000:00010000:0.0:1788838341.161192:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838341.161327:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626a00, rc 0) 00000100:00100000:0.0:1788838341.161481:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+104:73505:x1875729116498816:12345-192.168.203.30@tcp:101:touch.0 Request processed in 6489us (6955us total) trans 124554051631 rc 0/0 00000100:00100000:0.0:1788838341.161491:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1501 00000100:00100000:1.0:1788838341.166544:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.166735:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116499072 00000100:00100000:2.0:1788838341.166750:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116499072 00000100:00100000:2.0:1788838341.166986:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1502 00000100:00100000:2.0:1788838341.167000:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+104:73505:x1875729116499072:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:2.0:1788838341.167127:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838341.167164:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca6ee lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0f1 expref: 104 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.167187:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8ff508af1500) 00010000:00010000:2.0:1788838341.167273:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838341.167350:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.167368:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.167379:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838341.167518:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000994507ae reply state 0000000026c334bc transno 124554051632 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.167540:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.167547:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8ff61254c300) 00010000:00010000:2.0:1788838341.167550:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838341.167553:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838341.167763:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+105:73505:x1875729116499072:12345-192.168.203.30@tcp:36:touch.0 Request processed in 766us (1234us total) trans 124554051632 rc 0/0 00000100:00100000:2.0:1788838341.167771:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1502 00000100:00100000:3.0:1788838341.170237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.170419:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116499200 00000100:00100000:2.0:1788838341.170431:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116499200 00000100:00100000:2.0:1788838341.170543:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1503 00000100:00100000:2.0:1788838341.170556:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+105:73505:x1875729116499200:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838341.170593:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838341.170631:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11000/0x88da08396ccca703 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0f8 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.170710:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11000/0x88da08396ccca703 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0f8 expref: 106 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.170740:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11000/0x88da08396ccca703 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0f8 expref: 106 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.170762:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8ff61254c300) 00010000:00010000:2.0:1788838341.170766:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838341.170771:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f11000, rc 0) 00000100:00100000:2.0:1788838341.171035:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+106:73505:x1875729116499200:12345-192.168.203.30@tcp:101:touch.0 Request processed in 479us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838341.171063:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1503 00000100:00100000:1.0:1788838341.173511:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.173670:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116499328 00000100:00100000:2.0:1788838341.173683:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116499328 00000100:00100000:2.0:1788838341.173934:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6008 00000100:00100000:2.0:1788838341.173950:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+19:2407:x1875729116499328:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:2.0:1788838341.174319:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+20:2407:x1875729116499328:12345-192.168.203.30@tcp:2:touch.0 Request processed in 372us (822us total) trans 4294969471 rc 0/0 00000100:00100000:2.0:1788838341.174328:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6008 00000100:00100000:3.0:1788838341.176413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.176565:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116499584 00000100:00100000:2.0:1788838341.176580:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116499584 00000100:00100000:2.0:1788838341.176668:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 260 00000100:00100000:2.0:1788838341.176680:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+106:73505:x1875729116499584:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838341.177575:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+107:73505:x1875729116499584:12345-192.168.203.30@tcp:35:touch.0 Request processed in 892us (1169us total) trans 124554051633 rc 0/0 00000100:00100000:2.0:1788838341.177586:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 260 00000100:00100000:2.0:1788838341.180507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.180755:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116499840 00000100:00100000:3.0:1788838341.180769:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116499840 00000100:00100000:3.0:1788838341.180880:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1504 00000100:00100000:3.0:1788838341.180895:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+107:73505:x1875729116499840:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:3.0:1788838341.180928:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838341.180972:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca70a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d0ff expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.181121:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.181139:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.181152:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.181171:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.181179:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.181186:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838341.182487:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x391:0x0], index 0: 0 00010000:00010000:2.0:1788838341.182786:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11400/0x88da08396ccca71f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.182905:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11400/0x88da08396ccca71f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.182917:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11400/0x88da08396ccca71f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.182967:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.182993:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.182999:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.183007:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.183013:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838341.183018:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.183026:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.183042:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838341.183045:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838341.183050:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.183056:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca711 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838341.183305:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aef6a0a9 reply state 00000000badde68a transno 124554051634 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.183321:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.183327:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff8ff5037c5900) 00010000:00010000:2.0:1788838341.183337:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838341.183341:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838341.183391:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca70a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0ff expref: 110 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.183410:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11400/0x88da08396ccca71f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0ff expref: 109 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.183418:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:2.0:1788838341.183420:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838341.183423:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f11400, rc 0) 00000100:00100000:2.0:1788838341.183590:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+110:73505:x1875729116499840:12345-192.168.203.30@tcp:101:touch.0 Request processed in 2698us (3098us total) trans 124554051634 rc 0/0 00000100:00100000:2.0:1788838341.183608:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1504 00000100:00100000:0.0:1788838341.187048:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.187175:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116500096 00000100:00100000:2.0:1788838341.187188:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116500096 00000100:00100000:2.0:1788838341.187284:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1505 00000100:00100000:2.0:1788838341.187296:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+110:73505:x1875729116500096:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:2.0:1788838341.187379:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838341.187415:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11400/0x88da08396ccca71f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d0ff expref: 110 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.187438:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:2.0:1788838341.187449:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838341.187522:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.187539:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.187568:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838341.188483:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083b0461e reply state 000000008c9d747b transno 124554051635 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.188507:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.188516:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8ff61254ca00) 00010000:00010000:0.0:1788838341.188519:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838341.188522:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838341.188786:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+111:73505:x1875729116500096:12345-192.168.203.30@tcp:36:touch.0 Request processed in 1488us (1746us total) trans 124554051635 rc 0/0 00000100:00100000:0.0:1788838341.188822:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1505 00000100:00100000:3.0:1788838341.191290:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.191502:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116500224 00000100:00100000:1.0:1788838341.191537:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116500224 00000100:00100000:1.0:1788838341.191699:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1506 00000100:00100000:1.0:1788838341.191712:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+111:73505:x1875729116500224:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:1.0:1788838341.191755:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838341.191782:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca734 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d106 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.191882:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca734 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d106 expref: 112 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.191899:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6ca00/0x88da08396ccca734 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d106 expref: 112 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.191919:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8ff61254ca00) 00010000:00010000:1.0:1788838341.191923:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788838341.191927:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6ca00, rc 0) 00000100:00100000:1.0:1788838341.192000:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+112:73505:x1875729116500224:12345-192.168.203.30@tcp:101:touch.0 Request processed in 291us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838341.192007:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1506 00000100:00100000:3.0:1788838341.194320:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838341.194425:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116500352 00000100:00100000:0.0:1788838341.194438:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116500352 00000100:00100000:0.0:1788838341.194516:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6009 00000100:00100000:0.0:1788838341.194528:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+20:2404:x1875729116500352:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:0.0:1788838341.194864:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+21:2404:x1875729116500352:12345-192.168.203.30@tcp:2:touch.0 Request processed in 337us (560us total) trans 4294969472 rc 0/0 00000100:00100000:0.0:1788838341.194872:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6009 00000100:00100000:0.0:1788838341.197190:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.197284:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116500608 00000100:00100000:3.0:1788838341.197296:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116500608 00000100:00100000:3.0:1788838341.197372:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 261 00000100:00100000:3.0:1788838341.197385:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+112:73505:x1875729116500608:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:3.0:1788838341.197902:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+113:73505:x1875729116500608:12345-192.168.203.30@tcp:35:touch.0 Request processed in 518us (722us total) trans 124554051636 rc 0/0 00000100:00100000:3.0:1788838341.197911:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 261 00000100:00100000:3.0:1788838341.200288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.200481:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116500864 00000100:00100000:2.0:1788838341.200492:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116500864 00000100:00100000:2.0:1788838341.200572:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1507 00000100:00100000:2.0:1788838341.200587:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+113:73505:x1875729116500864:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838341.200628:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838341.200656:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca73b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d10d expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.200827:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.200846:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.200859:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.200877:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.200884:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.200891:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788838341.201293:0:66255:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x392:0x0], index 0: 0 00010000:00010000:2.0:1788838341.201490:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396ccca750 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201501:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396ccca750 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201509:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396ccca750 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201548:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201555:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201561:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201567:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201573:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838341.201578:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201585:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201599:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838341.201602:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838341.201606:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201626:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396ccca742 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838341.201643:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e25a2357 reply state 00000000d30f0850 transno 124554051637 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201655:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201660:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff8ff61254c100) 00010000:00010000:2.0:1788838341.201662:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838341.201666:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788838341.201702:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca73b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d10d expref: 116 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201730:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396ccca750 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d10d expref: 115 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.201737:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8ff61254c600) 00010000:00010000:2.0:1788838341.201739:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838341.201742:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f10600, rc 0) 00000100:00100000:2.0:1788838341.201870:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+116:73505:x1875729116500864:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1288us (1595us total) trans 124554051637 rc 0/0 00000100:00100000:2.0:1788838341.201879:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1507 00000100:00100000:0.0:1788838341.202099:0:94406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63a361f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94406:1875729135205632:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788838341.202165:0:94406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838341.202229:0:94406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff62765d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838341.205470:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.205861:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135205632 00000100:00100000:2.0:1788838341.205875:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135205632 00000100:00100000:2.0:1788838341.205959:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6010 00000100:00100000:2.0:1788838341.205977:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:94406:x1875729135205632:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788838341.206068:0:8657:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 930 00000100:00100000:1.0:1788838341.207811:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116501120 00000100:00100000:1.0:1788838341.207826:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116501120 00000100:00100000:1.0:1788838341.207906:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1508 00000100:00100000:1.0:1788838341.207918:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+116:73505:x1875729116501120:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:1.0:1788838341.207996:0:76060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838341.208032:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396ccca750 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d10d expref: 116 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.208082:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8ff61254c600) 00010000:00010000:1.0:1788838341.208095:0:76060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838341.208170:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.208187:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.208198:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838341.208329:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2c12d77 reply state 000000001e7fbcc6 transno 124554051638 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.208344:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.208351:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8ff61d841200) 00010000:00010000:1.0:1788838341.208353:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838341.208356:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838341.208494:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+117:73505:x1875729116501120:12345-192.168.203.30@tcp:36:touch.0 Request processed in 577us (3038us total) trans 124554051638 rc 0/0 00000100:00100000:1.0:1788838341.208502:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1508 00000100:00080000:3.0:1788838341.208938:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838341.212082:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:94406:x1875729135205632:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6094us (9897us total) trans 4294969473 rc 0/0 00000100:00100000:0.0:1788838341.212121:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6010 00000100:00100000:0.0:1788838341.212662:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.213926:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116501248 00000100:00100000:1.0:1788838341.213945:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116501248 00000100:00100000:2.0:1788838341.216695:0:94406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63a361f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94406:1875729135205632:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788838341.216740:0:94406:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x392:0x0]-[0x280000401:0x3c1:0x0] 00000100:00100000:1.0:1788838341.217429:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1509 00000100:00100000:0.0:1788838341.219370:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+117:73505:x1875729116501248:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838341.219412:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838341.219446:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627000/0x88da08396ccca765 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d114 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.219933:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627000/0x88da08396ccca765 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d114 expref: 118 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.219952:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627000/0x88da08396ccca765 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d114 expref: 118 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.219976:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8ff61d841200) 00010000:00010000:0.0:1788838341.219980:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788838341.219985:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627000, rc 0) 00000100:00100000:0.0:1788838341.220085:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+118:73505:x1875729116501248:12345-192.168.203.30@tcp:101:touch.0 Request processed in 903us (7427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838341.220095:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1509 00000100:00100000:0.0:1788838341.223136:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.223234:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116501376 00000100:00100000:2.0:1788838341.223248:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116501376 00000100:00100000:2.0:1788838341.223328:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6011 00000100:00100000:2.0:1788838341.223341:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:efc561ba-875e-4857-b79b-9bd7023bd57c+21:2407:x1875729116501376:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:2.0:1788838341.223644:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2407:x1875729116501376:12345-192.168.203.30@tcp:2:touch.0 Request processed in 304us (531us total) trans 4294969474 rc 0/0 00000100:00100000:2.0:1788838341.223653:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6011 00000100:00100000:0.0:1788838341.230316:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.230400:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116501632 00000100:00100000:2.0:1788838341.230415:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116501632 00000100:00100000:2.0:1788838341.230498:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 262 00000100:00100000:2.0:1788838341.230520:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+118:73505:x1875729116501632:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838341.230975:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+119:73505:x1875729116501632:12345-192.168.203.30@tcp:35:touch.0 Request processed in 465us (673us total) trans 124554051639 rc 0/0 00000100:00100000:2.0:1788838341.230983:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 262 00000100:00100000:1.0:1788838341.233390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838341.233484:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116501888 00000100:00100000:0.0:1788838341.233497:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116501888 00000100:00100000:0.0:1788838341.233574:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1510 00000100:00100000:0.0:1788838341.233586:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+119:73505:x1875729116501888:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838341.233696:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838341.233751:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca76c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d11b expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.233947:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.233970:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.233991:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.234011:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.234019:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.234026:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838341.235574:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x393:0x0], index 0: 0 00010000:00010000:0.0:1788838341.236019:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccca781 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236038:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccca781 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236052:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccca781 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236096:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236117:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236123:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236131:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236138:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838341.236144:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236153:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236169:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838341.236172:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838341.236177:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236185:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca773 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838341.236204:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c08ab8a reply state 00000000152af90a transno 124554051640 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236219:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236225:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff8ff508af1d00) 00010000:00010000:0.0:1788838341.236233:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838341.236238:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838341.236294:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca76c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d11b expref: 122 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236312:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccca781 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d11b expref: 121 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.236321:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8ff508af1200) 00010000:00010000:0.0:1788838341.236324:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838341.236326:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626400, rc 0) 00000100:00100000:0.0:1788838341.236874:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+122:73505:x1875729116501888:12345-192.168.203.30@tcp:101:touch.0 Request processed in 3287us (3494us total) trans 124554051640 rc 0/0 00000100:00100000:0.0:1788838341.236887:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1510 00000100:00100000:0.0:1788838341.241858:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.242133:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116502144 00000100:00100000:2.0:1788838341.242146:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116502144 00000100:00100000:2.0:1788838341.242364:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1511 00000100:00100000:2.0:1788838341.242378:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+122:73505:x1875729116502144:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:2.0:1788838341.242459:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838341.242496:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396ccca781 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d11b expref: 122 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.242544:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8ff508af1200) 00010000:00010000:2.0:1788838341.242561:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838341.242660:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.242677:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.242689:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838341.242887:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca664f5c reply state 000000004b2ed0e3 transno 124554051641 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.242901:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.242908:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:2.0:1788838341.242911:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838341.242914:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838341.243045:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+123:73505:x1875729116502144:12345-192.168.203.30@tcp:36:touch.0 Request processed in 670us (1201us total) trans 124554051641 rc 0/0 00000100:00100000:2.0:1788838341.243055:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1511 00000100:00100000:3.0:1788838341.246589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838341.247426:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116502272 00000100:00100000:0.0:1788838341.247440:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116502272 00000100:00100000:0.0:1788838341.247580:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1512 00000100:00100000:0.0:1788838341.247592:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+123:73505:x1875729116502272:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838341.247640:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838341.247669:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccca796 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d122 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.247756:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccca796 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d122 expref: 124 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.247776:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627400/0x88da08396ccca796 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d122 expref: 124 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.247852:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:0.0:1788838341.247856:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788838341.247861:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627400, rc 0) 00000100:00100000:0.0:1788838341.247945:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+124:73505:x1875729116502272:12345-192.168.203.30@tcp:101:touch.0 Request processed in 354us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838341.247954:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1512 00000100:00100000:0.0:1788838341.253488:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.253732:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116502400 00000100:00100000:2.0:1788838341.253746:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116502400 00000100:00100000:0.0:1788838341.256330:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6012 00000100:00100000:0.0:1788838341.256367:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2407:x1875729116502400:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:0.0:1788838341.256712:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+23:2407:x1875729116502400:12345-192.168.203.30@tcp:2:touch.0 Request processed in 364us (3237us total) trans 4294969475 rc 0/0 00000100:00100000:0.0:1788838341.256733:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6012 00000100:00100000:0.0:1788838341.259570:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.259757:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116502656 00000100:00100000:2.0:1788838341.259772:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116502656 00000100:00100000:2.0:1788838341.259877:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 263 00000100:00100000:2.0:1788838341.259888:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+124:73505:x1875729116502656:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:2.0:1788838341.260405:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+125:73505:x1875729116502656:12345-192.168.203.30@tcp:35:touch.0 Request processed in 515us (845us total) trans 124554051642 rc 0/0 00000100:00100000:2.0:1788838341.260414:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 263 00000100:00100000:3.0:1788838341.266674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.266993:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116502912 00000100:00100000:1.0:1788838341.267009:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116502912 00000100:00100000:1.0:1788838341.267140:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1513 00000100:00100000:1.0:1788838341.267153:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+125:73505:x1875729116502912:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:1.0:1788838341.267190:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838341.267391:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca79d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d129 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.267542:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.267562:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.267576:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.267723:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.267734:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.267742:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788838341.268576:0:76060:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x394:0x0], index 0: 0 00010000:00010000:0.0:1788838341.270978:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca7b2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271009:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca7b2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271026:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca7b2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271164:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271174:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271340:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271349:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271356:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838341.271362:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271372:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271389:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838341.271392:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838341.271397:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271404:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031600/0x88da08396ccca7a4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838341.271423:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab3ad015 reply state 0000000060190496 transno 124554051643 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271436:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271442:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff8ff61d841c00) 00010000:00010000:0.0:1788838341.271444:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838341.271448:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838341.271498:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396ccca79d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d129 expref: 128 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271528:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca7b2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d129 expref: 127 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.271537:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8ff508af1900) 00010000:00010000:0.0:1788838341.271539:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838341.271542:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627a00, rc 0) 00000100:00100000:0.0:1788838341.271913:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+128:73505:x1875729116502912:12345-192.168.203.30@tcp:101:touch.0 Request processed in 4760us (5251us total) trans 124554051643 rc 0/0 00000100:00100000:0.0:1788838341.271924:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1513 00000100:00100000:0.0:1788838341.275577:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.278538:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116503168 00000100:00100000:1.0:1788838341.278563:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116503168 00000100:00100000:1.0:1788838341.278922:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1514 00000100:00100000:1.0:1788838341.278937:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+128:73505:x1875729116503168:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:1.0:1788838341.279049:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838341.279101:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca7b2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d129 expref: 128 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.279128:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8ff508af1900) 00010000:00010000:1.0:1788838341.279145:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838341.279231:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.279249:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.279260:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788838341.279410:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000546c77c2 reply state 0000000031712599 transno 124554051644 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.279425:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838341.279433:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8ff61d841800) 00010000:00010000:1.0:1788838341.279435:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838341.279439:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838341.279568:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+129:73505:x1875729116503168:12345-192.168.203.30@tcp:36:touch.0 Request processed in 633us (4004us total) trans 124554051644 rc 0/0 00000100:00100000:1.0:1788838341.279576:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1514 00000100:00100000:3.0:1788838341.282057:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.282758:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116503296 00000100:00100000:2.0:1788838341.282776:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116503296 00000100:00100000:2.0:1788838341.282924:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1515 00000100:00100000:2.0:1788838341.282936:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+129:73505:x1875729116503296:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:2.0:1788838341.282975:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838341.283006:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11400/0x88da08396ccca7c7 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d130 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.283093:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11400/0x88da08396ccca7c7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d130 expref: 130 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.283111:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11400/0x88da08396ccca7c7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d130 expref: 130 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838341.283136:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8ff61d841800) 00010000:00010000:2.0:1788838341.283140:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788838341.283145:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f11400, rc 0) 00000100:00100000:2.0:1788838341.283371:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+130:73505:x1875729116503296:12345-192.168.203.30@tcp:101:touch.0 Request processed in 435us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838341.283380:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1515 00000100:00100000:3.0:1788838341.285832:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.286099:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116503424 00000100:00100000:1.0:1788838341.286114:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116503424 00000100:00100000:1.0:1788838341.286190:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6013 00000100:00100000:1.0:1788838341.286210:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+23:2404:x1875729116503424:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:1.0:1788838341.286516:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2404:x1875729116503424:12345-192.168.203.30@tcp:2:touch.0 Request processed in 308us (726us total) trans 4294969476 rc 0/0 00000100:00100000:1.0:1788838341.286524:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6013 00000100:00100000:3.0:1788838341.290064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838341.290214:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116503680 00000100:00100000:1.0:1788838341.290227:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116503680 00000100:00100000:1.0:1788838341.290300:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 264 00000100:00100000:1.0:1788838341.290313:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50358f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+130:73505:x1875729116503680:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:1.0:1788838341.291108:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50358f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+131:73505:x1875729116503680:12345-192.168.203.30@tcp:35:touch.0 Request processed in 793us (1055us total) trans 124554051645 rc 0/0 00000100:00100000:1.0:1788838341.291118:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 264 00000100:00100000:3.0:1788838341.294675:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838341.294908:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116503936 00000100:00100000:0.0:1788838341.294920:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116503936 00000100:00100000:0.0:1788838341.295007:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1516 00000100:00100000:0.0:1788838341.295020:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+131:73505:x1875729116503936:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838341.295054:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838341.295093:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca7ce lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d137 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.295245:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.295266:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.295282:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.295327:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.295335:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.295341:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788838341.296032:0:67312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x395:0x0], index 0: 0 00010000:00010000:0.0:1788838341.296334:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca7e3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296346:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca7e3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296355:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca7e3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296400:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296408:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296414:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296421:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296428:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838341.296442:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296451:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296466:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838341.296469:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838341.296474:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296481:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca7d5 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838341.296498:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d41dca5e reply state 000000007aa32299 transno 124554051646 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296509:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296517:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff8ff508af1e00) 00010000:00010000:0.0:1788838341.296519:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838341.296522:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838341.296562:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca7ce lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d137 expref: 134 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296579:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca7e3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d137 expref: 133 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.296587:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8ff508af1f00) 00010000:00010000:0.0:1788838341.296589:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838341.296598:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627a00, rc 0) 00000100:00100000:0.0:1788838341.296982:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+134:73505:x1875729116503936:12345-192.168.203.30@tcp:101:touch.0 Request processed in 1963us (2316us total) trans 124554051646 rc 0/0 00000100:00100000:0.0:1788838341.296993:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1516 00000100:00100000:2.0:1788838341.306038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838341.306173:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116504192 00000100:00100000:3.0:1788838341.306186:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116504192 00000100:00100000:3.0:1788838341.306312:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1517 00000100:00100000:3.0:1788838341.306326:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+134:73505:x1875729116504192:12345-192.168.203.30@tcp:36:touch.0 00010000:00010000:3.0:1788838341.306406:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838341.306443:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627a00/0x88da08396ccca7e3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d137 expref: 134 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.306466:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8ff508af1f00) 00010000:00010000:3.0:1788838341.306481:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838341.306560:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.306575:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.306586:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788838341.306751:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f088a75 reply state 00000000dbe36de4 transno 124554051647 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.306783:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838341.306790:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8ff5037c5c00) 00010000:00010000:3.0:1788838341.306793:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838341.307088:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788838341.307286:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+135:73505:x1875729116504192:12345-192.168.203.30@tcp:36:touch.0 Request processed in 961us (1261us total) trans 124554051647 rc 0/0 00000100:00100000:3.0:1788838341.307295:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1517 00000100:00100000:1.0:1788838341.309418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838341.309530:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116504320 00000100:00100000:0.0:1788838341.309542:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116504320 00000100:00100000:0.0:1788838341.309633:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1518 00000100:00100000:0.0:1788838341.309645:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+135:73505:x1875729116504320:12345-192.168.203.30@tcp:101:touch.0 00010000:00010000:0.0:1788838341.309679:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838341.309708:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca7f8 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d13e expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.309795:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca7f8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d13e expref: 136 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.309846:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626600/0x88da08396ccca7f8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d13e expref: 136 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838341.309869:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8ff5037c5c00) 00010000:00010000:0.0:1788838341.309872:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788838341.309876:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626600, rc 0) 00000100:00100000:0.0:1788838341.309947:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+136:73505:x1875729116504320:12345-192.168.203.30@tcp:101:touch.0 Request processed in 304us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838341.309955:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1518 00000100:00100000:1.0:1788838341.315918:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838341.316026:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116504448 00000100:00100000:2.0:1788838341.316041:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116504448 00000100:00100000:2.0:1788838341.316149:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6014 00000100:00100000:2.0:1788838341.316161:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2405:x1875729116504448:12345-192.168.203.30@tcp:2:touch.0 00000100:00100000:2.0:1788838341.318731:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff610ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2405:x1875729116504448:12345-192.168.203.30@tcp:2:touch.0 Request processed in 299us (554us total) trans 4294969477 rc 0/0 00000100:00100000:2.0:1788838341.318754:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6014 00000100:00100000:3.0:1788838341.319080:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838341.319414:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116504704 00000100:00100000:0.0:1788838341.319427:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116504704 00000100:00100000:0.0:1788838341.319582:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 265 00000100:00100000:0.0:1788838341.319761:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+136:73505:x1875729116504704:12345-192.168.203.30@tcp:35:touch.0 00000100:00100000:0.0:1788838341.320504:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+137:73505:x1875729116504704:12345-192.168.203.30@tcp:35:touch.0 Request processed in 908us (1420us total) trans 124554051648 rc 0/0 00000100:00100000:0.0:1788838341.320516:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 265 00010000:00010000:3.0:1788838341.693207:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838342.525333:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135205760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838342.525469:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838342.525984:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135205760 00000100:00100000:1.0:1788838342.525995:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135205760 00000100:00100000:1.0:1788838342.526061:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4277 00000100:00100000:1.0:1788838342.526071:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135205760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838342.526115:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:1.0:1788838342.526176:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a361500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135205760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838342.526184:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4277 00000100:00100000:1.0:1788838342.526213:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135205888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838342.526254:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838342.526277:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838342.526308:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135206016:0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.526679:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838342.529516:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135205888 00000100:00100000:2.0:1788838342.529539:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135205888 00000100:00100000:1.0:1788838342.529616:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135205760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838342.529677:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135206016 00000100:00100000:1.0:1788838342.529684:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135206016 00000100:00100000:1.0:1788838342.530084:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788838342.530095:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135206016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.530172:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135206016:12345-0@lo:400:kworker.0 Request processed in 78us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838342.530179:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788838342.530417:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4278 00000100:00100000:3.0:1788838342.530430:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135205888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838342.530463:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00000100:00100000:1.0:1788838342.530556:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135206016:0@lo:400:kworker.0 00000100:00100000:3.0:1788838342.530678:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a362d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135205888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 251us (4422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838342.530684:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4278 00000100:00100000:1.0:1788838342.530758:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135205888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838342.534884:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135206528:0@lo:400:kworker.0 00000100:00100000:0.0:1788838342.534991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838342.535036:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135207040:0@lo:400:kworker.0 00000100:00100000:0.0:1788838342.535067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838342.535102:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788838342.535109:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135206400:0@lo:400:kworker.0 00000100:00100000:0.0:1788838342.535133:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838342.535150:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135206912:0@lo:400:kworker.0 00000100:00100000:0.0:1788838342.535172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838342.535213:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135207040 00000100:00100000:0.0:1788838342.535223:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135207040 00000100:00100000:0.0:1788838342.535284:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736 00000100:00100000:0.0:1788838342.535294:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135207040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838342.535358:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875729135207040:12345-0@lo:400:kworker.0 Request processed in 65us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838342.535366:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736 00000100:00100000:0.0:1788838342.535425:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135207040:0@lo:400:kworker.0 00000100:00100000:0.0:1788838342.535456:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135206528 00000100:00100000:0.0:1788838342.535460:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135206528 00000100:00100000:1.0:1788838342.535607:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135206272:0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.535644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838342.535663:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135206784:0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.535683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838342.535696:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135207296:0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.535727:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838342.535746:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788838342.535751:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135206144:0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.535772:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838342.535786:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135206656:0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.535826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838342.535844:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135207168:0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.535886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838342.536001:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135206784 00000100:00100000:3.0:1788838342.536006:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135206784 00000100:00100000:0.0:1788838342.536064:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135206656 00000100:00100000:0.0:1788838342.536069:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135206656 00000100:00100000:2.0:1788838342.536138:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135206400 00000100:00100000:2.0:1788838342.536144:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135206400 00000100:00080000:1.0:1788838342.540088:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788838342.540106:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838342.540111:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838342.540115:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838342.540155:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135206912 00000100:00100000:1.0:1788838342.540170:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135206912 00000100:00100000:1.0:1788838342.540239:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135206272 00000100:00100000:1.0:1788838342.540243:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135206272 00000100:00080000:1.0:1788838342.540275:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788838342.540292:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135207296 00000100:00100000:1.0:1788838342.540296:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135207296 00000100:00100000:1.0:1788838342.540308:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135206144 00000100:00100000:1.0:1788838342.540310:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135206144 00000100:00080000:1.0:1788838342.540329:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838342.540350:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:1.0:1788838342.540361:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135206912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.540917:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135206912:12345-0@lo:400:kworker.0 Request processed in 555us (5741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838342.540928:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:1.0:1788838342.540971:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:1.0:1788838342.540981:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135206272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.541024:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff633277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875729135206272:12345-0@lo:400:kworker.0 Request processed in 46us (5378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838342.541030:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:1.0:1788838342.541087:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875729135206272:0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.541219:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:1.0:1788838342.541227:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff609258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135207296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.541284:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff609258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135207296:12345-0@lo:400:kworker.0 Request processed in 58us (5555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838342.541291:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:1.0:1788838342.541319:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135207296:0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.541339:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:1.0:1788838342.541347:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135206144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838342.541383:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875729135206144:12345-0@lo:400:kworker.0 Request processed in 37us (5609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838342.541390:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:1.0:1788838342.541414:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875729135206144:0@lo:400:kworker.0 00000100:00100000:3.0:1788838342.543028:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135207168 00000100:00100000:3.0:1788838342.543053:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135207168 00000100:00100000:3.0:1788838342.543098:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737 00000100:00100000:3.0:1788838342.543109:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60925ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135206784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838342.543217:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60925ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135206784:12345-0@lo:400:kworker.0 Request processed in 110us (7532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838342.543224:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737 00000100:00100000:3.0:1788838342.543242:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:3.0:1788838342.543271:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135207168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838342.543305:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135207168:12345-0@lo:400:kworker.0 Request processed in 36us (7418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838342.543311:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000100:00080000:3.0:1788838342.543345:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838342.543402:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135207168:0@lo:400:kworker.0 00000100:00100000:3.0:1788838342.543417:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135206784:0@lo:400:kworker.0 00000100:00100000:3.0:1788838342.543458:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1788838342.543468:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135206528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838342.543520:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135206528:12345-0@lo:400:kworker.0 Request processed in 55us (8529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838342.543527:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1788838342.543615:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135206912:0@lo:400:kworker.0 00000100:00100000:3.0:1788838342.543628:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135206528:0@lo:400:kworker.0 00000100:00100000:0.0:1788838342.543937:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:0.0:1788838342.543958:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135206656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838342.544007:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135206656:12345-0@lo:400:kworker.0 Request processed in 53us (8179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838342.544014:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00100000:0.0:1788838342.544041:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135206656:0@lo:400:kworker.0 00000100:00100000:2.0:1788838342.545410:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:2.0:1788838342.545435:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135206400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838342.545550:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135206400:12345-0@lo:400:kworker.0 Request processed in 127us (10414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838342.545570:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1788838342.545659:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135206400:0@lo:400:kworker.0 00010000:00010000:2.0:1788838342.719313:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838342.722930:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838342.722995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838342.723030:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838342.723054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838342.723081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838342.723174:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116504832 00000100:00100000:2.0:1788838342.723189:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116504832 00000100:00100000:3.0:1788838342.723194:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116505344 00000100:00100000:3.0:1788838342.723198:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116505344 00000100:00100000:3.0:1788838342.723256:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116505216 00000100:00100000:3.0:1788838342.723260:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116505216 00000100:00100000:2.0:1788838342.723267:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:2.0:1788838342.723279:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63320d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116504832:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838342.723287:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2740 00000100:00100000:3.0:1788838342.723293:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116505344:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838342.723369:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116505344:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838342.723378:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2740 00000100:00100000:0.0:1788838342.723386:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2741 00000100:00100000:0.0:1788838342.723396:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2404:x1875729116505216:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838342.723404:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116505088 00000100:00080000:1.0:1788838342.723467:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838342.723473:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838342.723540:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116504960 00000100:00100000:1.0:1788838342.723545:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116504960 00000100:00080000:1.0:1788838342.723566:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838342.723599:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1458 00000100:00100000:1.0:1788838342.723606:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5059a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+137:2404:x1875729116504960:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838342.723652:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116505088 00000100:00080000:3.0:1788838342.723671:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788838342.723698:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1459 00000100:00100000:3.0:1788838342.723704:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2404:x1875729116505088:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838342.731583:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63320d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116504832:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 8287us (8647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838342.731603:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:0.0:1788838342.733736:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2404:x1875729116505216:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 10326us (10638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838342.733755:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2741 00000100:00100000:1.0:1788838342.735398:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5059a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+137:2404:x1875729116504960:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 11778us (12328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838342.735453:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1458 00000100:00100000:3.0:1788838342.737026:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2404:x1875729116505088:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 13308us (14016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838342.737050:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1459 00000100:00100000:1.0:1788838343.037494:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135207424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788838343.037610:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838343.038130:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff505932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135207552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838343.038172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838343.038297:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135207424 00000100:00100000:3.0:1788838343.038310:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135207424 00000100:00100000:3.0:1788838343.038389:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135207552 00000100:00100000:3.0:1788838343.038393:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135207552 00000100:00100000:3.0:1788838343.038412:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1788838343.038422:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135207424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838343.038463:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838343.038513:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135207424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838343.038521:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1788838343.038540:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:3.0:1788838343.038546:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135207552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838343.038564:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838343.038601:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135207552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838343.038607:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00100000:3.0:1788838343.038657:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff505932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135207552:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788838343.038739:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788838343.039053:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135207424:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788838343.040864:0:94387:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051648 is committed 00010000:00010000:0.0:1788838343.041232:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041250:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041260:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041266:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148e000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.041273:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041283:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041333:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8ff60b5cfb00) 00010000:00010000:0.0:1788838343.041336:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.041342:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041348:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396ccca3a6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041378:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041384:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041390:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041394:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.041397:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041403:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041410:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838343.041412:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.041415:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041421:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396ccca3ad lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041451:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041457:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041462:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041467:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cba00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.041469:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041475:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041482:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838343.041485:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788838343.041487:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041492:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cba00/0x88da08396ccca408 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041503:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041509:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041514:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041525:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3caa00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.041527:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041533:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041540:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff8ff60b5cf600) 00010000:00010000:0.0:1788838343.041542:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.041544:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041550:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396ccca439 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041566:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041586:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041592:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041597:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.041600:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041605:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041624:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8ff508af1800) 00010000:00010000:0.0:1788838343.041626:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.041629:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041635:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396ccca44e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041649:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041655:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041660:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041664:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6de00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.041667:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041672:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041679:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff8ff61d841000) 00010000:00010000:0.0:1788838343.041681:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.041684:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041689:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396ccca46a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041724:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041730:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041735:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041741:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cbe00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.041743:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041749:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041757:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8ff60b5cf500) 00010000:00010000:0.0:1788838343.041760:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.041763:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041768:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396ccca47f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041777:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041783:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041788:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041862:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.041866:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041872:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041880:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff8ff60b5cf400) 00010000:00010000:0.0:1788838343.041882:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.041885:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041890:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396ccca49b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041906:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041912:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041917:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041922:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.041924:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041929:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041946:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8ff508af1100) 00010000:00010000:0.0:1788838343.041948:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.041973:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041978:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396ccca4b0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.041993:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042000:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042006:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042012:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042015:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042021:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042032:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff8ff60b5cfa00) 00010000:00010000:0.0:1788838343.042035:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042038:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042044:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396ccca4cc lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042070:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042076:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042082:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042088:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3ef200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042091:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042098:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042118:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8ff605587000) 00010000:00010000:0.0:1788838343.042121:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042125:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042131:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca4e1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042144:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042150:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042156:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042167:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042170:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042176:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042183:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff8ff508af1a00) 00010000:00010000:0.0:1788838343.042186:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042189:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042194:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030400/0x88da08396ccca4fd lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042213:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042219:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042225:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042230:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3ee800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042232:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042237:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042257:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8ff5037c5200) 00010000:00010000:0.0:1788838343.042259:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042262:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042267:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca512 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042279:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042286:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042291:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042297:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042300:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042306:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042314:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff8ff60b5cf900) 00010000:00010000:0.0:1788838343.042316:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042319:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042325:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396ccca52e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042350:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042356:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042361:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042366:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042368:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042375:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042383:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8ff508af1400) 00010000:00010000:0.0:1788838343.042386:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042388:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042394:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031800/0x88da08396ccca543 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042405:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042410:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042416:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042426:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600030800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042429:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042435:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042443:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff8ff508af1b00) 00010000:00010000:0.0:1788838343.042446:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042448:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042454:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600030800/0x88da08396ccca55f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042469:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042474:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042479:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042483:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042486:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042491:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042509:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8ff60b5cf700) 00010000:00010000:0.0:1788838343.042511:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042514:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042519:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396ccca574 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042531:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042537:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042542:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042547:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042550:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042555:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042563:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff8ff508af1300) 00010000:00010000:0.0:1788838343.042565:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042568:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042574:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca590 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042600:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042606:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042612:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042618:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042621:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042627:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042635:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8ff61d841300) 00010000:00010000:0.0:1788838343.042637:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042640:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042645:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396ccca5a5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042655:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042661:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042668:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042679:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6dc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042682:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042689:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042697:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff8ff61d841b00) 00010000:00010000:0.0:1788838343.042700:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042717:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042725:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396ccca5c1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042742:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042748:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042754:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042759:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6c200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042762:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042768:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042786:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8ff61d841700) 00010000:00010000:0.0:1788838343.042788:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042792:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042830:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396ccca5d6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042845:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042852:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042858:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042863:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6c600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042865:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042871:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042878:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff8ff61d841400) 00010000:00010000:0.0:1788838343.042880:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042882:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042887:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396ccca5f2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042908:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042915:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042921:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042925:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6da00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042928:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042934:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042941:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8ff61d841600) 00010000:00010000:0.0:1788838343.042942:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.042945:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042950:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396ccca607 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042959:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042965:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042971:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042980:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.042984:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042990:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.042997:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff8ff61d841900) 00010000:00010000:0.0:1788838343.042999:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.043001:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043007:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396ccca623 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043023:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043029:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043034:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043038:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6cc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.043041:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043047:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043063:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8ff61d841500) 00010000:00010000:0.0:1788838343.043065:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.043068:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043074:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396ccca638 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043085:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043091:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043097:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043102:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3efc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.043104:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043110:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043117:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff8ff5037c5400) 00010000:00010000:0.0:1788838343.043119:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.043121:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043127:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca654 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043148:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043155:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043161:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043166:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148fe00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.043168:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043174:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043181:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:0.0:1788838343.043183:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.043185:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043191:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148fe00/0x88da08396ccca669 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043201:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043206:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043212:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043221:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.043224:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043230:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043237:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff8ff61254c000) 00010000:00010000:0.0:1788838343.043239:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.043241:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043247:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca685 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043259:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043265:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043270:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043275:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.043277:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043283:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043298:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8ff61d841a00) 00010000:00010000:0.0:1788838343.043300:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.043303:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043308:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396ccca69a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043331:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043336:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043341:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043347:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.043350:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043356:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043362:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff8ff5037c5500) 00010000:00010000:0.0:1788838343.043364:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.043366:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043371:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca6b6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043393:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043400:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043406:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043411:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.043414:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043420:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043427:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8ff5037c5700) 00010000:00010000:0.0:1788838343.043429:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.043432:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043438:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca6cb lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043448:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043454:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043461:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.043471:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.043475:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838343.045088:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838343.045203:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116505472 00000100:00100000:3.0:1788838343.045217:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116505472 00000100:00100000:3.0:1788838343.045309:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1519 00000100:00100000:3.0:1788838343.045321:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+43:73533:x1875729116505472:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838343.045373:0:66253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00000100:00100000:3.0:1788838343.045466:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+43:73533:x1875729116505472:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 146us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838343.045475:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1519 00010000:00010000:0.0:1788838343.046321:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046344:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff8ff61254cb00) 00010000:00010000:0.0:1788838343.046347:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.046354:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046362:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca6e7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046398:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046404:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046411:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046417:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.046421:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046427:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046457:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8ff61254c300) 00010000:00010000:0.0:1788838343.046459:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.046462:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046467:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca6fc lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046485:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046491:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046496:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046500:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.046503:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046508:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046515:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff8ff5037c5900) 00010000:00010000:0.0:1788838343.046517:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.046520:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046525:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca718 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046549:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046555:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.046561:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047012:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.047019:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047028:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047038:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8ff61254ca00) 00010000:00010000:0.0:1788838343.047041:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.047044:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047050:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca72d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047068:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047074:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047080:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047096:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.047099:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047106:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047114:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff8ff61254c100) 00010000:00010000:0.0:1788838343.047116:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.047119:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047126:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca749 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047144:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047150:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047156:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047161:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6c000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.047164:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047169:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047187:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8ff61d841200) 00010000:00010000:0.0:1788838343.047189:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.047192:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047198:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396ccca75e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047214:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047220:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047225:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047229:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.047232:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047237:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047244:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff8ff508af1d00) 00010000:00010000:0.0:1788838343.047247:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.047249:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047255:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca77a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047561:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047567:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047832:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047839:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.047842:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047849:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047861:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:0.0:1788838343.047863:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.047867:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047872:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca78f lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047886:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047892:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047898:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.047912:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff600031c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.047916:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048019:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048031:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff8ff61d841c00) 00010000:00010000:0.0:1788838343.048034:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.048037:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048043:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff600031c00/0x88da08396ccca7ab lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048065:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048070:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048074:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048079:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c7600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.048082:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048087:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048106:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8ff61d841800) 00010000:00010000:0.0:1788838343.048109:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.048112:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048118:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396ccca7c0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048132:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048140:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048151:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048156:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.048160:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048165:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048173:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff8ff508af1e00) 00010000:00010000:0.0:1788838343.048175:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.048177:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048185:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396ccca7dc lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048207:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048213:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048218:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048223:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838343.048225:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048230:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048237:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8ff5037c5c00) 00010000:00010000:0.0:1788838343.048239:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838343.048241:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838343.048246:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca7f1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838343.050052:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838343.050476:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116505600 00000100:00100000:3.0:1788838343.050485:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116505600 00000100:00100000:3.0:1788838343.050540:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1520 00000100:00100000:3.0:1788838343.050549:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+11:73533:x1875729116505600:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1788838343.050593:0:75504:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:3.0:1788838343.050664:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+11:73533:x1875729116505600:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 115us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838343.050671:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1520 00000100:00100000:1.0:1788838343.053336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838343.053518:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116505728 00000100:00100000:3.0:1788838343.053528:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116505728 00000100:00100000:3.0:1788838343.053591:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2162 00000100:00100000:3.0:1788838343.053600:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+25:73533:x1875729116505728:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1788838343.053636:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788838343.053715:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+25:73533:x1875729116505728:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 116us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838343.053723:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2162 00000100:00100000:1.0:1788838343.056897:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838343.057135:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116505856 00000100:00100000:2.0:1788838343.057145:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116505856 00000100:00100000:2.0:1788838343.057209:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2163 00000100:00100000:2.0:1788838343.057235:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+7:73533:x1875729116505856:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:2.0:1788838343.057278:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838343.057348:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efc561ba-875e-4857-b79b-9bd7023bd57c+7:73533:x1875729116505856:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 115us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838343.057356:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2163 00010000:00010000:2.0:1788838343.741794:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788838343.964159:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969477 is committed 00000001:00080000:1.0:1788838343.964389:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969473 is committed 00000100:00100000:0.0:1788838344.062451:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135207680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838344.062530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838344.063159:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6244b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135207808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838344.063206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838344.063246:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135207680 00000100:00100000:1.0:1788838344.063254:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135207680 00000100:00100000:1.0:1788838344.063301:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135207808 00000100:00100000:1.0:1788838344.063304:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135207808 00000100:00100000:1.0:1788838344.063319:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:1.0:1788838344.063327:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135207680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788838344.063349:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788838344.063387:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135207680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838344.063409:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:1.0:1788838344.063426:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:1.0:1788838344.063433:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135207808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838344.063457:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838344.063489:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135207808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838344.063494:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00080000:1.0:1788838344.063509:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838344.063513:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838344.063546:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6244b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135207808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838344.063581:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135207680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788838344.148116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838344.148187:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116506112 00000100:00100000:0.0:1788838344.148198:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116506112 00000100:00100000:0.0:1788838344.148263:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1521 00000100:00100000:0.0:1788838344.148273:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+31:73574:x1875729116506112:12345-192.168.203.30@tcp:36:mcreate.0 00010000:00010000:0.0:1788838344.148339:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838344.148369:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396ccca3e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d018 expref: 31 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.148385:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:0.0:1788838344.148401:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838344.148455:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.148468:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.148478:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.148491:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.148498:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.148504:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788838344.148749:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788838344.149174:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.149184:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.149190:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.149205:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.149212:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838344.149216:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.149223:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.149233:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:0.0:1788838344.149236:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838344.149239:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.149246:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396ccca7ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788838344.149256:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee4773d9 reply state 0000000025a79902 transno 124554051649 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.149266:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838344.149272:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50d5e2400) 00010000:00010000:0.0:1788838344.149274:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838344.149276:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838344.149346:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+32:73574:x1875729116506112:12345-192.168.203.30@tcp:36:mcreate.0 Request processed in 1073us (1238us total) trans 124554051649 rc 0/0 00000100:00100000:0.0:1788838344.149353:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1521 00000100:00100000:1.0:1788838344.173411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838344.173727:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116506240 00000100:00100000:3.0:1788838344.173739:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116506240 00000100:00100000:3.0:1788838344.173841:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1522 00000100:00100000:3.0:1788838344.173852:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+32:73577:x1875729116506240:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1788838344.173887:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838344.173910:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca80d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d145 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.173977:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca814 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.173994:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.174004:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838344.174049:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838344.174053:0:66253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838344.174074:0:66253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.174097:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca80d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d145 expref: 34 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.174113:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca814 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d145 expref: 33 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.174121:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:3.0:1788838344.174123:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838344.174127:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab9400, rc 0) 00000100:00100000:3.0:1788838344.174196:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+33:73577:x1875729116506240:12345-192.168.203.30@tcp:101:rm.0 Request processed in 346us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838344.174203:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1522 00000100:00100000:3.0:1788838344.183898:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838344.183932:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116506368 00000100:00100000:3.0:1788838344.183941:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116506368 00000100:00100000:3.0:1788838344.183988:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1523 00000100:00100000:3.0:1788838344.183998:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+33:73577:x1875729116506368:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:3.0:1788838344.184020:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838344.184040:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca81b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d14c expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184103:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184118:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184130:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184141:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184148:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184155:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184257:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca830 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184265:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca830 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184282:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca830 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838344.184325:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1a:0x0]: returning size 0 00000004:00200000:3.0:1788838344.184328:0:75504:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838344.184345:0:75504:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca830 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184356:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca830 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184365:0:75504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184371:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184376:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184383:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184389:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838344.184393:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184400:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184412:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:3.0:1788838344.184421:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838344.184426:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184432:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184445:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184450:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca829 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184457:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184461:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838344.184464:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184470:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca829 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184478:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50d5e2400) 00010000:00010000:3.0:1788838344.184480:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838344.184484:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca829 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184489:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184515:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca81b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d14c expref: 35 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184540:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca830 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d14c expref: 34 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838344.184548:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff8ff5037c5b00) 00010000:00010000:3.0:1788838344.184551:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838344.184553:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3efc00, rc 0) 00000100:00100000:3.0:1788838344.185965:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+34:73577:x1875729116506368:12345-192.168.203.30@tcp:101:rm.0 Request processed in 1961us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838344.185976:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1523 00000100:00100000:3.0:1788838344.195188:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838344.196232:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116506624 00000100:00100000:2.0:1788838344.196244:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116506624 00000100:00100000:2.0:1788838344.196305:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1524 00000100:00100000:2.0:1788838344.196315:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+34:73577:x1875729116506624:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1788838344.196369:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788838344.196397:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca830 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d14c expref: 34 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.196414:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff8ff5037c5b00) 00010000:00010000:2.0:1788838344.196430:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca814 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d145 expref: 33 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.196439:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:2.0:1788838344.196443:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838344.196464:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.196478:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.196512:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.196525:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.196532:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.196539:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.197764:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca845 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.197782:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca845 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.197792:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca845 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198002:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198012:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198021:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198027:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198045:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198051:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198071:0:66255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788838344.198094:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca845 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198100:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca845 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198106:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca845 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198112:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838344.198116:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca845 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198125:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca845 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198136:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff8ff61254c900) 00010000:00010000:2.0:1788838344.198139:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788838344.198143:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca845 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198150:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca845 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198179:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198185:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198191:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198197:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198202:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838344.198205:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198211:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198220:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:2.0:1788838344.198222:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838344.198225:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198230:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca837 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788838344.198240:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a51078e5 reply state 00000000050e9229 transno 124554051650 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198250:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198263:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50d5e2400) 00010000:00010000:2.0:1788838344.198265:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838344.198268:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838344.198355:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+34:73577:x1875729116506624:12345-192.168.203.30@tcp:36:rm.0 Request processed in 2039us (3174us total) trans 124554051650 rc 0/0 00000100:00100000:2.0:1788838344.198363:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1524 00010000:00010000:2.0:1788838344.198401:0:63563:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838344.198407:0:63563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198413:0:63563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10c00 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:2.0:1788838344.198417:0:63563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198424:0:63563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198432:0:63563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff8ff61254c900) 00010000:00010000:2.0:1788838344.198435:0:63563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788838344.198437:0:63563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198443:0:63563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca84c lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838344.198456:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838344.198457:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838344.198459:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838344.765128:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838345.789044:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838346.820038:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838347.646572:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135208064:0@lo:400:kworker.0 00000100:00100000:0.0:1788838347.646572:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135208192:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.647475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.647510:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135208576:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.647588:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.647614:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135209088:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.647738:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.647773:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788838347.647781:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135207936:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.647836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838347.647871:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135207936 00000100:00100000:2.0:1788838347.647876:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135208448:0@lo:400:kworker.0 00000100:00100000:3.0:1788838347.647881:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135207936 00000100:00100000:2.0:1788838347.647905:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.647925:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504c05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135208960:0@lo:400:kworker.0 00000100:00100000:3.0:1788838347.647935:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788838347.647947:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135207936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.647951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.647974:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135209472:0@lo:400:kworker.0 00000100:00100000:3.0:1788838347.648007:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135207936:12345-0@lo:400:kworker.0 Request processed in 63us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838347.648016:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788838347.648192:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.648226:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135207936:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.648256:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135208064 00000100:00100000:2.0:1788838347.648259:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135208064 00000100:00100000:2.0:1788838347.648295:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135208448 00000100:00100000:2.0:1788838347.648299:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135208448 00000100:00100000:2.0:1788838347.648315:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135208960 00000100:00100000:2.0:1788838347.648318:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135208960 00000100:00100000:2.0:1788838347.648329:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135209472 00000100:00100000:2.0:1788838347.648331:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135209472 00000100:00100000:2.0:1788838347.648341:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1788838347.648346:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135208064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.648414:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135208064:12345-0@lo:400:kworker.0 Request processed in 68us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838347.648421:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1788838347.648435:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1788838347.648441:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135208448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.648468:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135208448:12345-0@lo:400:kworker.0 Request processed in 27us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838347.648473:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1788838347.648484:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1788838347.648490:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135208960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.648519:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135208960:12345-0@lo:400:kworker.0 Request processed in 29us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838347.648525:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1788838347.648972:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1788838347.648981:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135209472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.649648:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135209472:12345-0@lo:400:kworker.0 Request processed in 668us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838347.649655:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1788838347.649690:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135208576 00000100:00100000:2.0:1788838347.649697:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135208576 00000100:00100000:2.0:1788838347.649730:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135209088 00000100:00100000:2.0:1788838347.649733:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135209088 00000100:00100000:2.0:1788838347.649756:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4279 00000100:00100000:0.0:1788838347.649758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.649766:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135208576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838347.649814:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135208704:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.649825:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135208576:12345-0@lo:400:kworker.0 Request processed in 62us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838347.649844:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4279 00000100:00100000:0.0:1788838347.649851:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.649859:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4280 00000100:00100000:2.0:1788838347.649868:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135209088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838347.649877:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135209216:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.649925:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135209088:12345-0@lo:400:kworker.0 Request processed in 55us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838347.649931:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4280 00000100:00100000:2.0:1788838347.649953:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135208192 00000100:00100000:2.0:1788838347.649958:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135208192 00000100:00100000:2.0:1788838347.650031:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1788838347.650040:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135208192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838347.650072:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838347.650082:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135209600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838347.650113:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.650140:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135208192:12345-0@lo:400:kworker.0 Request processed in 101us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838347.650148:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00080000:2.0:1788838347.650173:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838347.650176:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838347.650261:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135208448:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.652296:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504c05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135208960:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.652314:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135209472:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.652327:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135208064:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.652340:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135208576:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.652353:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135209088:0@lo:400:kworker.0 00000100:00100000:0.0:1788838347.652364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.652403:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135209600 00000100:00100000:2.0:1788838347.652410:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135209600 00000100:00100000:0.0:1788838347.652430:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135208192:0@lo:400:kworker.0 00000100:00100000:0.0:1788838347.652443:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788838347.652453:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135208320:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.652466:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4281 00000100:00100000:0.0:1788838347.652499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838347.652522:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135208832:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.652533:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135209600:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838347.652547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838347.652566:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135209344:0@lo:400:kworker.0 00000004:00000024:2.0:1788838347.652569:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:0.0:1788838347.652592:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838347.652633:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135209600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838347.652635:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135208704 00000100:00100000:0.0:1788838347.652640:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135208704 00000100:00100000:2.0:1788838347.652645:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4281 00000100:00100000:2.0:1788838347.652688:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135208320 00000100:00100000:2.0:1788838347.652693:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135208320 00000100:00100000:2.0:1788838347.652723:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1788838347.652730:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135208320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.652767:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135208320:12345-0@lo:400:kworker.0 Request processed in 38us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838347.652773:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1788838347.652980:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135209216 00000100:00100000:0.0:1788838347.652985:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135209216 00000100:00100000:0.0:1788838347.653008:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135208832 00000100:00100000:0.0:1788838347.653011:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135208832 00000100:00100000:0.0:1788838347.653027:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135209344 00000100:00100000:0.0:1788838347.653029:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135209344 00000100:00100000:0.0:1788838347.653046:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:0.0:1788838347.653052:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135208704:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838347.653069:0:26209:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61fc29f80 x1875729135208704/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1788838358 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838347.653115:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135208704:12345-0@lo:400:kworker.0 Request processed in 64us (3265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838347.653123:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742 00000100:00100000:0.0:1788838347.653137:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:0.0:1788838347.653143:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135209216:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838347.653153:0:26209:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61fc29c00 x1875729135209216/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:248/0 lens 224/224 e 0 to 0 dl 1788838358 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838347.653179:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135209216:12345-0@lo:400:kworker.0 Request processed in 37us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838347.653186:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00100000:0.0:1788838347.653197:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:0.0:1788838347.653203:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135208832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838347.653230:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135208832:12345-0@lo:400:kworker.0 Request processed in 27us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838347.653235:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00100000:0.0:1788838347.653247:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745 00000100:00100000:0.0:1788838347.653252:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135209344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838347.653277:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135209344:12345-0@lo:400:kworker.0 Request processed in 25us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838347.653283:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745 00000100:00100000:0.0:1788838347.654717:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838347.654737:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135209728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838347.654794:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788838347.654795:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838347.654821:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788838347.654824:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838347.654869:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135208320:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.654883:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135208832:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.654894:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f745180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135209344:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.654905:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135208704:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.654917:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135209216:0@lo:400:kworker.0 00000100:00100000:2.0:1788838347.654961:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135209728 00000100:00100000:2.0:1788838347.654967:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135209728 00000100:00100000:2.0:1788838347.655017:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4282 00000100:00100000:2.0:1788838347.655025:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135209728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838347.655063:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00000100:00100000:2.0:1788838347.655126:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135209728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838347.655135:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4282 00000100:00100000:0.0:1788838347.655152:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135209728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838347.655182:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135209600:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788838347.845252:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838347.851608:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838347.851658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838347.851692:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116506880 00000100:00100000:3.0:1788838347.851700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838347.851703:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116506880 00000100:00100000:3.0:1788838347.851730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838347.851765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838347.851777:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116507008 00000100:00100000:1.0:1788838347.851782:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116507008 00000100:00100000:3.0:1788838347.851794:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116507136 00000100:00100000:3.0:1788838347.851824:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116507136 00000100:00100000:1.0:1788838347.851835:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1466 00000100:00100000:1.0:1788838347.851848:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+34:2404:x1875729116506880:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838347.851863:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116507264 00000100:00100000:3.0:1788838347.851875:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116507264 00000100:00100000:3.0:1788838347.851920:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2746 00000100:00100000:3.0:1788838347.851928:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2404:x1875729116507136:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838347.851944:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+34:2404:x1875729116506880:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 98us (352us total) trans 0 rc 0/0 00010000:00000080:3.0:1788838347.851948:0:26208:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505932680 x1875729116507136/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:248/0 lens 224/224 e 0 to 0 dl 1788838358 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838347.851956:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1466 00000100:00100000:3.0:1788838347.851985:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2404:x1875729116507136:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 58us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838347.851992:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1467 00000100:00100000:3.0:1788838347.851997:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2746 00000100:00100000:1.0:1788838347.852003:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116507008:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838347.852017:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2747 00000100:00100000:3.0:1788838347.852026:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116507264:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838347.852046:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116507008:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 45us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838347.852061:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116507264:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838347.852069:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1467 00000100:00100000:3.0:1788838347.852075:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2747 00000100:00100000:1.0:1788838347.853300:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116506752 00000100:00100000:1.0:1788838347.853310:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116506752 00000100:00100000:1.0:1788838347.853356:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:1.0:1788838347.853366:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116506752:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838347.853428:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116506752:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 64us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838347.853435:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00080000:1.0:1788838347.853462:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838347.853467:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788838347.853470:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838347.853472:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838348.164291:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135209856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788838348.164364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838348.165518:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135209984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838348.165567:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838348.165616:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135209856 00000100:00100000:3.0:1788838348.165622:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135209856 00000100:00100000:3.0:1788838348.166058:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135209984 00000100:00100000:3.0:1788838348.166063:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135209984 00000100:00100000:3.0:1788838348.166086:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:3.0:1788838348.166096:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135209856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788838348.166124:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000080:3.0:1788838348.166138:0:8464:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640735f80 x1875729135209856/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:249/0 lens 224/368 e 0 to 0 dl 1788838359 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838348.166188:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135209856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838348.166202:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:1.0:1788838348.166210:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:1.0:1788838348.166222:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135209984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838348.166240:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838348.166281:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135209984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838348.166287:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:3.0:1788838348.166590:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135209856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838348.167014:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff639c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135209984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788838348.862736:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838349.181000:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135210112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788838349.181073:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838349.181238:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838349.181249:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff504ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135210240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838349.181279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838349.181307:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135210112 00000100:00100000:3.0:1788838349.181314:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135210112 00000100:00100000:3.0:1788838349.181363:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135210240 00000100:00100000:3.0:1788838349.181366:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135210240 00000100:00100000:3.0:1788838349.181383:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:3.0:1788838349.181393:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135210112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788838349.181416:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000080:3.0:1788838349.181430:0:12691:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61fcd2300 x1875729135210112/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:250/0 lens 224/368 e 0 to 0 dl 1788838360 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838349.181473:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135210112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838349.181481:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00100000:3.0:1788838349.181499:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:3.0:1788838349.181506:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135210240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838349.181517:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838349.181547:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135210240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838349.181553:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:3.0:1788838349.181602:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff504ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135210240:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788838349.181715:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838349.181720:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788838349.181743:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135210112:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1788838349.697650:0:94387:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051650 is committed 00010000:00010000:3.0:1788838349.697908:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.697922:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.697929:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.697936:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504627200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838349.697941:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.697948:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.697966:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50d5e2400) 00010000:00010000:3.0:1788838349.697970:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838349.697975:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.697981:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca806 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.698000:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.698006:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.698011:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.698024:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838349.698027:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.698033:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.698042:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x22c88bba (ffff8ff50d5e2400) 00010000:00010000:3.0:1788838349.698045:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838349.698048:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.698054:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396ccca83e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x22c88bba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838349.887103:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788838350.549965:0:95925:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:3.0:1788838350.812069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838350.812194:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116507392 00000100:00100000:2.0:1788838350.812205:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116507392 00000100:00100000:2.0:1788838350.812293:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1525 00000100:00100000:2.0:1788838350.812314:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+30:73655:x1875729116507392:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838350.812335:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838350.812360:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396ccca853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d153 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.812433:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca85a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.812446:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.812462:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838350.812506:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788838350.812510:0:66254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:1.0:1788838350.812560:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1788838350.813332:0:66254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.813368:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396ccca853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d153 expref: 32 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.813405:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10000/0x88da08396ccca85a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d153 expref: 31 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.813414:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:2.0:1788838350.813417:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788838350.813420:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f10000, rc 0) 00000100:00100000:2.0:1788838350.813493:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+31:73655:x1875729116507392:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1190us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838350.813501:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1525 00000100:00100000:1.0:1788838350.816842:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.817037:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116507520 00000100:00100000:3.0:1788838350.817049:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116507520 00000100:00100000:3.0:1788838350.817117:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1526 00000100:00100000:3.0:1788838350.817128:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+31:73656:x1875729116507520:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.817149:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.817172:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca861 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d15a expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.817242:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca868 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.817274:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca868 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.817286:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca868 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838350.817336:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788838350.817340:0:66255:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788838350.817362:0:66255:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca868 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.818296:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca861 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d15a expref: 33 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.818319:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca868 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d15a expref: 32 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.818328:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:3.0:1788838350.818331:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788838350.818334:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ef200, rc 0) 00000100:00100000:3.0:1788838350.818523:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+32:73656:x1875729116507520:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1395us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838350.818531:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1526 00000100:00100000:3.0:1788838350.825862:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838350.828013:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116507776 00000100:00100000:2.0:1788838350.828028:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116507776 00000100:00100000:2.0:1788838350.828175:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1527 00000100:00100000:2.0:1788838350.828187:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+32:73655:x1875729116507776:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838350.828209:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838350.828234:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396ccca86f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d161 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.829543:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.829838:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.829850:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.829868:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca87d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.829888:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca87d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.829894:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca87d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.829959:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca884 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.829968:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca884 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.829975:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca884 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838350.829986:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x6:0x0]: returning size 0 00010000:00010000:0.0:1788838350.830242:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838350.830253:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1788838350.830257:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.830267:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.830273:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.830278:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838350.830283:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838350.830370:0:26219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116507904 00000100:00100000:2.0:1788838350.830377:0:26219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116507904 00000100:00100000:2.0:1788838350.830434:0:26219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 743 00000100:00100000:2.0:1788838350.830443:0:26219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+35:2407:x1875729116507904:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788838350.830737:0:26219:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838350.830756:0:26219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca868 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d15a expref: 35 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.830771:0:26219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ff605587d00) 00010000:00010000:2.0:1788838350.830776:0:26219:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838350.830868:0:26219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+34:2407:x1875729116507904:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 425us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838350.830876:0:26219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 743 00010000:00010000:0.0:1788838350.831116:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831127:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838350.831129:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838350.831133:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831140:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396ccca876 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831151:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca87d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831163:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca87d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831169:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca87d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831174:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838350.831177:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca87d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831183:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca87d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831191:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff8ff504d9f700) 00010000:00010000:0.0:1788838350.831193:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838350.831196:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca87d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831202:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396ccca87d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831252:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396ccca86f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d161 expref: 34 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831265:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca884 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d161 expref: 33 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.831272:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8ff508af1800) 00010000:00010000:0.0:1788838350.831275:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838350.831283:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f11e00, rc 0) 00000100:00100000:0.0:1788838350.831675:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+33:73655:x1875729116507776:12345-192.168.203.30@tcp:101:dd.0 Request processed in 3489us (5823us total) trans 124554051651 rc 0/0 00000100:00100000:0.0:1788838350.831683:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1527 00000100:00100000:1.0:1788838350.841247:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.841340:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116508160 00000100:00100000:3.0:1788838350.841349:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116508160 00000100:00100000:3.0:1788838350.841425:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1528 00000100:00100000:3.0:1788838350.841436:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+33:73656:x1875729116508160:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.841478:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.841501:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca892 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d168 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841642:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841666:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841678:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841693:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca8a0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841700:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca8a0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841706:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca8a0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841772:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca8a7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841781:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca8a7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841788:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca8a7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838350.841840:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788838350.841928:0:75504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841937:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841943:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841949:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841955:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3ee800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838350.841960:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841968:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841981:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:3.0:1788838350.841984:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838350.841989:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.841995:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca899 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.842009:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca8a0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.842016:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca8a0 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.842021:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca8a0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.842031:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3eee00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838350.842034:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca8a0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.842040:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca8a0 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.842048:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff8ff5037c5300) 00010000:00010000:3.0:1788838350.842051:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838350.842054:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca8a0 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.842059:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca8a0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.842100:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efa00/0x88da08396ccca892 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d168 expref: 36 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.842115:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca8a7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d168 expref: 35 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.842122:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8ff60b5cf500) 00010000:00010000:3.0:1788838350.842124:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838350.842126:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3ef200, rc 0) 00000100:00100000:3.0:1788838350.842198:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+35:73656:x1875729116508160:12345-192.168.203.30@tcp:101:dd.0 Request processed in 765us (962us total) trans 124554051652 rc 0/0 00000100:00100000:3.0:1788838350.842207:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1528 00000100:00100000:3.0:1788838350.842911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838350.845059:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116508288 00000100:00100000:2.0:1788838350.845084:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116508288 00000100:00100000:2.0:1788838350.845164:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1529 00000100:00100000:2.0:1788838350.845175:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+35:73655:x1875729116508288:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838350.845196:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838350.845216:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca8b5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d16f expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.845252:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca8bc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.845266:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca8bc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.845277:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca8bc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.845413:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca8b5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d16f expref: 37 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.845432:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11200/0x88da08396ccca8bc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d16f expref: 36 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.845441:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8ff508af1800) 00010000:00010000:2.0:1788838350.845444:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788838350.845448:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f11200, rc 0) 00000100:00100000:2.0:1788838350.845527:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+36:73655:x1875729116508288:12345-192.168.203.30@tcp:101:dd.0 Request processed in 355us (2619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838350.845535:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1529 00000100:00100000:1.0:1788838350.854858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.854902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838350.855029:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116508544 00000100:00100000:2.0:1788838350.855040:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116508544 00000100:00100000:2.0:1788838350.855101:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116508672 00000100:00100000:2.0:1788838350.855106:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116508672 00000100:00100000:2.0:1788838350.855135:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1530 00000100:00100000:2.0:1788838350.855146:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+37:73655:x1875729116508544:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:2.0:1788838350.855202:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838350.855233:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca884 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d161 expref: 37 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838350.855243:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1531 00010000:00010000:2.0:1788838350.855256:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8ff508af1800) 00000100:00100000:0.0:1788838350.855257:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+36:73656:x1875729116508672:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838350.855265:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838350.855279:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838350.855368:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca8c3 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d176 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.855400:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca8ca lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.855457:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.855472:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.855480:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca8ca lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.855483:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.855494:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca8ca lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788838350.855532:0:66253:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051653 00000004:00010000:2.0:1788838350.855556:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004ccc3f8 reply state 000000004a24d081 transno 124554051654 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.855569:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.855575:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8ff508af1800) 00010000:00010000:2.0:1788838350.855578:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838350.855594:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838350.855662:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca8c3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d176 expref: 41 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.855678:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504627200/0x88da08396ccca8ca lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d176 expref: 40 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.855685:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8ff60b5cf500) 00010000:00010000:0.0:1788838350.855688:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788838350.855691:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627200, rc 0) 00000100:00100000:2.0:1788838350.855702:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+40:73655:x1875729116508544:12345-192.168.203.30@tcp:36:dd.0 Request processed in 556us (852us total) trans 124554051654 rc 0/0 00000100:00100000:2.0:1788838350.855710:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1530 00000020:00080000:2.0:1788838350.855716:0:66253:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788838350.855727:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6244b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+39:73656:x1875729116508672:12345-192.168.203.30@tcp:101:dd.0 Request processed in 473us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838350.855741:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1531 00000100:00100000:1.0:1788838350.857315:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838350.858638:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116508928 00000100:00100000:2.0:1788838350.858650:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116508928 00000100:00100000:2.0:1788838350.858780:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1532 00000100:00100000:2.0:1788838350.858793:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+39:73661:x1875729116508928:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838350.858832:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838350.858851:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca8d8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d17d expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.858975:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.858990:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.859002:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.859017:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca8e6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.859025:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca8e6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.859031:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca8e6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.859099:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396ccca8ed lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.859120:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396ccca8ed lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860081:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396ccca8ed lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838350.860100:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xc:0x0]: returning size 0 00010000:00010000:2.0:1788838350.860260:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860269:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860276:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860283:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860289:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838350.860293:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860301:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860317:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838350.860320:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838350.860325:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860330:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca8df lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860369:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca8e6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860375:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca8e6 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860542:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca8e6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860548:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838350.860551:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca8e6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860557:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca8e6 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860565:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff8ff504d9ff00) 00010000:00010000:2.0:1788838350.860567:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838350.860571:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca8e6 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860576:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca8e6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860632:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11800/0x88da08396ccca8d8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d17d expref: 42 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860646:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396ccca8ed lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d17d expref: 41 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.860676:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8ff60b5cf700) 00010000:00010000:2.0:1788838350.860679:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838350.860681:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f10600, rc 0) 00000100:00100000:2.0:1788838350.860830:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+41:73661:x1875729116508928:12345-192.168.203.30@tcp:101:dd.0 Request processed in 2038us (3520us total) trans 124554051655 rc 0/0 00000100:00100000:2.0:1788838350.860840:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1532 00000100:00100000:1.0:1788838350.862837:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.862885:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.862957:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116509056 00000100:00100000:3.0:1788838350.862967:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116509056 00000100:00100000:3.0:1788838350.863037:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6015 00000100:00100000:3.0:1788838350.863047:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+5:73655:x1875729116509056:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.863064:0:26220:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.863095:0:26220:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d8e0cd5/0x88da08396ccca8fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d184 expref: -99 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838350.863120:0:26220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x382:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:3.0:1788838350.863152:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x382:0x0].0x0 since=3744s v=(0 0) 00010000:00010000:3.0:1788838350.863158:0:26220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x382:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838350.863166:0:26220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d8e0cd5/0x88da08396ccca8fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d184 expref: 6 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.863186:0:26220:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d8e0cd5/0x88da08396ccca8fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d184 expref: 6 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.863198:0:26220:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3efa00, rc 0) 00010000:00000080:3.0:1788838350.863206:0:26220:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff639540380 x1875729116509056/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 328/400 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838350.863254:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+6:73655:x1875729116509056:12345-192.168.203.30@tcp:101:dd.0 Request processed in 209us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838350.863260:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6015 00000100:00080000:1.0:1788838350.863468:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788838350.863646:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116509312 00000100:00100000:3.0:1788838350.863662:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116509312 00000100:00100000:3.0:1788838350.863744:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1533 00000100:00100000:3.0:1788838350.863764:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+41:73656:x1875729116509312:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:3.0:1788838350.863841:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838350.863864:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca8a7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d168 expref: 41 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.863880:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8ff60b5cf500) 00010000:00010000:3.0:1788838350.863884:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838350.864041:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.864053:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.864062:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788838350.864118:0:66253:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051656 00000004:00010000:3.0:1788838350.864152:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083b554b4 reply state 000000009891a3ae transno 124554051657 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.864164:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.864170:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8ff60b5cf500) 00010000:00010000:3.0:1788838350.864172:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838350.864174:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788838350.864227:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+43:73656:x1875729116509312:12345-192.168.203.30@tcp:36:dd.0 Request processed in 464us (1341us total) trans 124554051657 rc 0/0 00000100:00100000:3.0:1788838350.864233:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1533 00000020:00080000:3.0:1788838350.864237:0:66253:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788838350.876374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838350.876429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838350.876459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838350.876498:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.876558:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116509440 00000100:00100000:3.0:1788838350.876568:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116509440 00002000:00010000:3.0:1788838350.876608:0:24876:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/898 (0->18446744073709551615) 00002000:00100000:3.0:1788838350.876612:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff640737800 with x1875729116509440 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838350.876624:0:24876:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff640737800. 00000100:00100000:3.0:1788838350.876724:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1008 00000100:00100000:3.0:1788838350.876735:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2404:x1875729116509440:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:3.0:1788838350.876930:0:24876:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788838350.876934:0:24876:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:3.0:1788838350.876936:0:24876:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:3.0:1788838350.876938:0:24876:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:3.0:1788838350.876940:0:24876:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788838350.876949:0:24876:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff640737800 x1875729116509440/t4294969478(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 440/432 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838350.877014:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116509440:12345-192.168.203.30@tcp:10:dd.0 Request processed in 281us (651us total) trans 4294969478 rc 0/0 00000100:00100000:3.0:1788838350.877022:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1008 00002000:00010000:3.0:1788838350.877025:0:24876:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/898 (0->18446744073709551615) 00002000:00100000:3.0:1788838350.877027:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff640737800 with x1875729116509440 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838350.877032:0:24876:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff640737800. 00000100:00100000:3.0:1788838350.877057:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116509824 00000100:00100000:3.0:1788838350.877061:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116509824 00000100:00100000:3.0:1788838350.877087:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116509696 00000100:00100000:3.0:1788838350.877090:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116509696 00000100:00100000:3.0:1788838350.877108:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1534 00000100:00100000:3.0:1788838350.877114:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+44:73661:x1875729116509824:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.877148:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.877165:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca909 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d192 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877195:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca910 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877210:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca910 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877221:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca910 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877319:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ee800/0x88da08396ccca909 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d192 expref: 46 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877336:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3efc00/0x88da08396ccca910 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d192 expref: 45 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877345:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8ff60b5cf700) 00010000:00010000:3.0:1788838350.877347:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838350.877351:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50f3efc00, rc 0) 00000100:00100000:3.0:1788838350.877378:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+45:73661:x1875729116509824:12345-192.168.203.30@tcp:101:dd.0 Request processed in 264us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838350.877384:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1534 00000100:00100000:3.0:1788838350.877400:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1535 00000100:00100000:3.0:1788838350.877407:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+44:73657:x1875729116509696:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.877415:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.877431:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca917 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d18b expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877525:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877535:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877542:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877554:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca925 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877560:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca925 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877566:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca925 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877606:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca92c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877613:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca92c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877620:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca92c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838350.877627:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x8:0x0]: returning size 0 00010000:00010000:3.0:1788838350.877693:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877710:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877716:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877722:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877728:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab8c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838350.877732:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877740:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877750:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:3.0:1788838350.877753:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838350.877756:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877762:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8c00/0x88da08396ccca91e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877770:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca925 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877776:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca925 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877780:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca925 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877791:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838350.877820:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca925 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877828:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca925 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877837:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff8ff5037c5a00) 00010000:00010000:3.0:1788838350.877840:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838350.877842:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca925 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877849:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9a00/0x88da08396ccca925 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877885:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab9400/0x88da08396ccca917 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d18b expref: 47 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877897:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca92c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d18b expref: 46 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.877904:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8ff508af1100) 00010000:00010000:3.0:1788838350.877906:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838350.877908:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff626ab8800, rc 0) 00000100:00100000:3.0:1788838350.877931:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+46:73657:x1875729116509696:12345-192.168.203.30@tcp:101:dd.0 Request processed in 525us (1432us total) trans 124554051658 rc 0/0 00000100:00100000:3.0:1788838350.877937:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1535 00000100:00100000:2.0:1788838350.878035:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116509952 00000100:00100000:2.0:1788838350.878040:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116509952 00000100:00100000:2.0:1788838350.878081:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6016 00000100:00100000:2.0:1788838350.878089:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+7:73656:x1875729116509952:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838350.878097:0:26213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838350.878108:0:26213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008178cdca/0x88da08396ccca93a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d199 expref: -99 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838350.878126:0:26213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x383:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:2.0:1788838350.878139:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x383:0x0].0x0 since=3744s v=(0 0) 00010000:00010000:2.0:1788838350.878144:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x383:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838350.878151:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008178cdca/0x88da08396ccca93a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d199 expref: 8 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.878164:0:26213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008178cdca/0x88da08396ccca93a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d199 expref: 8 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.878173:0:26213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f11800, rc 0) 00010000:00000080:2.0:1788838350.878185:0:26213:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61d2ac000 x1875729116509952/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 328/400 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838350.878213:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+8:73656:x1875729116509952:12345-192.168.203.30@tcp:101:dd.0 Request processed in 125us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838350.878219:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6016 00000100:00100000:0.0:1788838350.881320:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838350.883094:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838350.884559:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116510336 00000100:00100000:0.0:1788838350.884573:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116510336 00000100:00100000:0.0:1788838350.884634:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1536 00000100:00100000:0.0:1788838350.884644:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+46:73661:x1875729116510336:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1788838350.884707:0:76060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838350.884734:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396ccca8ed lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d17d expref: 46 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.884752:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8ff60b5cf700) 00010000:00010000:0.0:1788838350.884757:0:76060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838350.884948:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.884963:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.884973:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838350.885018:0:76060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051659 00000004:00010000:0.0:1788838350.885041:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf175b4f reply state 00000000535f634d transno 124554051660 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.885071:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.885077:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8ff60b5cf700) 00010000:00010000:0.0:1788838350.885079:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838350.885082:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838350.885176:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+48:73661:x1875729116510336:12345-192.168.203.30@tcp:36:dd.0 Request processed in 533us (2089us total) trans 124554051660 rc 0/0 00000100:00100000:0.0:1788838350.885184:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1536 00000020:00080000:0.0:1788838350.885189:0:76060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788838350.886629:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.886707:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116510976 00000100:00100000:3.0:1788838350.886729:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116510976 00000100:00100000:3.0:1788838350.886788:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1537 00000100:00100000:3.0:1788838350.886825:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+48:73660:x1875729116510976:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.886850:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.886868:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca948 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1a7 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.886995:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887010:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887020:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887036:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca956 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887043:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca956 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887049:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca956 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887111:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccca95d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887120:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccca95d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887127:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccca95d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838350.887153:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788838350.887228:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887236:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887242:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887249:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887255:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3ef200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838350.887259:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887478:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887489:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:3.0:1788838350.887492:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838350.887572:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887581:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3ef200/0x88da08396ccca94f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887596:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca956 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887601:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca956 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887614:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca956 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887619:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838350.887622:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca956 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887628:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca956 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887636:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff8ff5037c5900) 00010000:00010000:3.0:1788838350.887638:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838350.887641:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca956 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887646:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca956 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887702:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8a00/0x88da08396ccca948 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1a7 expref: 51 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887715:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccca95d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1a7 expref: 50 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.887722:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8ff508af1400) 00010000:00010000:3.0:1788838350.887724:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838350.887727:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712dc00, rc 0) 00000100:00100000:3.0:1788838350.887785:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+50:73660:x1875729116510976:12345-192.168.203.30@tcp:101:dd.0 Request processed in 989us (1163us total) trans 124554051661 rc 0/0 00000100:00100000:3.0:1788838350.887825:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1537 00000100:00100000:1.0:1788838350.888480:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116510080 00000100:00100000:1.0:1788838350.888487:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116510080 00002000:00010000:1.0:1788838350.888514:0:24878:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/899 (0->18446744073709551615) 00002000:00100000:1.0:1788838350.888518:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff61d2ae680 with x1875729116510080 ext(0->18446744073709551615) 00002000:00010000:1.0:1788838350.888527:0:24878:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff61d2ae680. 00000100:00100000:1.0:1788838350.888561:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1009 00000100:00100000:1.0:1788838350.888570:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2406:x1875729116510080:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:1.0:1788838350.888720:0:24878:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788838350.888723:0:24878:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:1.0:1788838350.888726:0:24878:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:1.0:1788838350.888728:0:24878:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:1.0:1788838350.888730:0:24878:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788838350.888739:0:24878:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61d2ae680 x1875729116510080/t4294969479(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 440/432 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838350.888788:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2406:x1875729116510080:12345-192.168.203.30@tcp:10:dd.0 Request processed in 219us (7478us total) trans 4294969479 rc 0/0 00000100:00100000:1.0:1788838350.888819:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1009 00002000:00010000:1.0:1788838350.888823:0:24878:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/899 (0->18446744073709551615) 00002000:00100000:1.0:1788838350.888825:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff61d2ae680 with x1875729116510080 ext(0->18446744073709551615) 00002000:00010000:1.0:1788838350.888839:0:24878:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff61d2ae680. 00000100:00100000:0.0:1788838350.902979:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838350.903030:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.903128:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116510720 00000100:00100000:3.0:1788838350.903147:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116510720 00000100:00100000:3.0:1788838350.903209:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1538 00000100:00100000:3.0:1788838350.903220:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+50:73657:x1875729116510720:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.903241:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.903261:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca96b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1a0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.903295:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccca972 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.903310:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccca972 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.903332:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccca972 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.903448:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca96b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1a0 expref: 52 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.903466:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c400/0x88da08396ccca972 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1a0 expref: 51 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.903475:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8ff508af1100) 00010000:00010000:3.0:1788838350.903478:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838350.903481:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c400, rc 0) 00000100:00100000:3.0:1788838350.903551:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+51:73657:x1875729116510720:12345-192.168.203.30@tcp:101:dd.0 Request processed in 333us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838350.903853:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1538 00000100:00100000:2.0:1788838350.903936:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116510592 00000100:00100000:2.0:1788838350.903942:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116510592 00000100:00100000:2.0:1788838350.903985:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 266 00000100:00100000:2.0:1788838350.903993:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+51:73655:x1875729116510592:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:2.0:1788838350.904223:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+52:73655:x1875729116510592:12345-192.168.203.30@tcp:35:dd.0 Request processed in 230us (1253us total) trans 124554051662 rc 0/0 00000100:00100000:2.0:1788838350.904230:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 266 00000100:00100000:0.0:1788838350.905581:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.905728:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116511104 00000100:00100000:1.0:1788838350.905737:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116511104 00000100:00100000:1.0:1788838350.905791:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6017 00000100:00100000:1.0:1788838350.905833:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+9:73661:x1875729116511104:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838350.905852:0:8657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838350.905872:0:8657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bbc9797/0x88da08396ccca979 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1ae expref: -99 pid: 8657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838350.905896:0:8657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x388:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:1.0:1788838350.905919:0:8657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x388:0x0].0x0 since=3744s v=(0 0) 00010000:00010000:1.0:1788838350.905924:0:8657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838350.905932:0:8657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bbc9797/0x88da08396ccca979 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1ae expref: 10 pid: 8657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.905947:0:8657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004bbc9797/0x88da08396ccca979 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1ae expref: 10 pid: 8657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.905959:0:8657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff6421c7200, rc 0) 00010000:00000080:1.0:1788838350.905967:0:8657:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff5071cd180 x1875729116511104/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 328/400 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838350.906013:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+10:73661:x1875729116511104:12345-192.168.203.30@tcp:101:dd.0 Request processed in 215us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838350.906019:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6017 00010000:00010000:3.0:1788838350.911300:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838350.911465:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.911622:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116511616 00000100:00100000:1.0:1788838350.911634:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116511616 00002000:00100000:1.0:1788838350.911705:0:24891:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x382:0x0] (0->1023) req@ffff8ff5071ced80 x1875729116511616/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 1512/0 e 0 to 0 dl 1788838361 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838350.911715:0:24891:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff5071ced80 with x1875729116511616 ext(0->1023) 00002000:00010000:1.0:1788838350.911721:0:24891:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff5071ced80 00000100:00100000:1.0:1788838350.911757:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1010 00000100:00100000:1.0:1788838350.911766:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2405:x1875729116511616:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:1.0:1788838350.912221:0:24891:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff5071ced80 x1875729116511616/t4294969480(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 1512/448 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838350.912279:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2405:x1875729116511616:12345-192.168.203.30@tcp:4:dd.0 Request processed in 514us (820us total) trans 4294969480 rc 0/0 00000100:00100000:1.0:1788838350.912287:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1010 00002000:00100000:1.0:1788838350.912294:0:24891:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x382:0x0] (0->1023) req@ffff8ff5071ced80 x1875729116511616/t4294969480(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 1512/448 e 0 to 0 dl 1788838361 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838350.912301:0:24891:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff5071ced80 with x1875729116511616 ext(0->1023) 00002000:00010000:1.0:1788838350.912305:0:24891:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff5071ced80 00000100:00100000:0.0:1788838350.925933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838350.925995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.926274:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116511232 00000100:00100000:1.0:1788838350.926294:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116511232 00000100:00100000:0.0:1788838350.926418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838350.926463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.926487:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116511488 00000100:00100000:1.0:1788838350.926495:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116511488 00000100:00100000:0.0:1788838350.926533:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838350.926574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838350.927419:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116511744 00000100:00100000:0.0:1788838350.927432:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116511744 00000100:00100000:0.0:1788838350.927510:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6018 00000100:00100000:0.0:1788838350.927528:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2405:x1875729116511744:12345-192.168.203.30@tcp:16:kworker.0 00000100:00100000:3.0:1788838350.928099:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116512256 00000100:00100000:3.0:1788838350.928108:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116512256 00000100:00100000:2.0:1788838350.928190:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1539 00000100:00100000:2.0:1788838350.928213:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+54:73660:x1875729116511232:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838350.928239:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838350.928267:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca980 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1b5 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838350.928280:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1540 00000100:00100000:3.0:1788838350.928299:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+55:73658:x1875729116511488:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.928317:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.928340:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca98e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1bc expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.928452:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca987 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.928471:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca987 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.928485:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca987 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.928504:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.928534:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.928547:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.928566:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca99c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.928573:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca99c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.928580:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca99c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.928757:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccca9a3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.928835:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396ccca980 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1b5 expref: 57 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.928856:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11c00/0x88da08396ccca987 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1b5 expref: 56 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.928865:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8ff508af1400) 00010000:00010000:2.0:1788838350.928871:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788838350.928879:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f11c00, rc 0) 00010000:00010000:3.0:1788838350.928905:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccca9a3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.928916:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccca9a3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838350.929019:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+56:73660:x1875729116511232:12345-192.168.203.30@tcp:101:dd.0 Request processed in 816us (3103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838350.929029:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1539 00000100:00100000:2.0:1788838350.929055:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1541 00000004:00200000:3.0:1788838350.929059:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x9:0x0]: returning size 0 00000100:00100000:2.0:1788838350.929068:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+55:73657:x1875729116512256:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:2.0:1788838350.929106:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838350.929124:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff626ab8800/0x88da08396ccca92c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d18b expref: 55 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.929136:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8ff508af1100) 00010000:00010000:2.0:1788838350.929139:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788838350.929290:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.929302:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.929311:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929339:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929351:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929358:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929365:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929373:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838350.929378:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929388:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929401:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:3.0:1788838350.929405:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838350.929409:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929416:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca995 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929440:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca99c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929446:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca99c lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929451:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca99c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929457:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712da00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838350.929459:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca99c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929471:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca99c lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929480:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff8ff5037c5900) 00010000:00010000:3.0:1788838350.929483:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838350.929486:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca99c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929492:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca99c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929556:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca98e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1bc expref: 57 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929574:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccca9a3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1bc expref: 56 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.929594:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8ff605587000) 00010000:00010000:3.0:1788838350.929596:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838350.929599:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d600, rc 0) 00000100:00100000:3.0:1788838350.929682:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+56:73658:x1875729116511488:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1387us (3686us total) trans 124554051664 rc 0/0 00000100:00100000:3.0:1788838350.929850:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1540 00000001:00080000:2.0:1788838350.931120:0:66254:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051663 00000100:00100000:0.0:1788838350.931239:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116512000 00000100:00100000:0.0:1788838350.931248:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116512000 00000100:00100000:0.0:1788838350.931313:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 267 00000004:00010000:2.0:1788838350.931761:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008431c32c reply state 0000000036fea5a4 transno 124554051665 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.931781:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.931789:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8ff508af1100) 00010000:00010000:2.0:1788838350.931792:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788838350.931816:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788838350.931989:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116512384 00000100:00100000:3.0:1788838350.932004:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116512384 00002000:00010000:3.0:1788838350.932196:0:8466:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/904 (0->18446744073709551615) 00002000:00100000:3.0:1788838350.932203:0:8466:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d55f80 with x1875729116512384 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838350.932218:0:8466:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d55f80. 00000100:00100000:3.0:1788838350.932263:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1011 00000100:00100000:3.0:1788838350.932276:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+13:2406:x1875729116512384:12345-192.168.203.30@tcp:10:dd.0 00000100:00100000:0.0:1788838350.932299:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+58:73656:x1875729116512000:12345-192.168.203.30@tcp:35:dd.0 00002000:00010000:3.0:1788838350.932524:0:8466:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788838350.932530:0:8466:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:3.0:1788838350.932533:0:8466:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:3.0:1788838350.932536:0:8466:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:3.0:1788838350.932538:0:8466:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788838350.932550:0:8466:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d55f80 x1875729116512384/t4294969481(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 440/432 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838350.933106:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+58:73657:x1875729116512256:12345-192.168.203.30@tcp:36:dd.0 Request processed in 4038us (6526us total) trans 124554051665 rc 0/0 00000100:00100000:2.0:1788838350.933117:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1541 00000020:00080000:2.0:1788838350.933123:0:66254:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1788838350.934280:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969480 is committed 00000100:00100000:3.0:1788838350.934591:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2406:x1875729116512384:12345-192.168.203.30@tcp:10:dd.0 Request processed in 2305us (8046us total) trans 4294969481 rc 0/0 00000100:00100000:3.0:1788838350.934607:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1011 00002000:00010000:3.0:1788838350.934615:0:8466:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/904 (0->18446744073709551615) 00002000:00100000:3.0:1788838350.934634:0:8466:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d55f80 with x1875729116512384 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838350.934648:0:8466:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d55f80. 00000100:00100000:0.0:1788838350.934752:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+58:73656:x1875729116512000:12345-192.168.203.30@tcp:35:dd.0 Request processed in 3423us (8280us total) trans 124554051666 rc 0/0 00000100:00100000:0.0:1788838350.934765:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 267 00010000:00000080:1.0:1788838350.934891:0:20253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff632e65c00 x1875729116511744/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 440/432 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838350.934928:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2405:x1875729116511744:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 7404us (8799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838350.934936:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6018 00000100:00100000:3.0:1788838350.946020:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.946072:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.946096:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.946150:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116512640 00000100:00100000:2.0:1788838350.946158:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116513024 00000100:00100000:3.0:1788838350.946165:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116512640 00000100:00100000:2.0:1788838350.946176:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116513024 00002000:00100000:2.0:1788838350.946244:0:8468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x383:0x0] (0->1023) req@ffff8ff50f38c380 x1875729116513024/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 1512/0 e 0 to 0 dl 1788838361 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838350.946251:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116512768 00000100:00100000:3.0:1788838350.946259:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116512768 00002000:00100000:2.0:1788838350.946264:0:8468:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f38c380 with x1875729116513024 ext(0->1023) 00002000:00010000:2.0:1788838350.946273:0:8468:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f38c380 00000100:00100000:3.0:1788838350.946301:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1542 00000100:00100000:3.0:1788838350.946320:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+59:73659:x1875729116512640:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.946355:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.946380:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9b8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1c3 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838350.946560:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1543 00010000:00010000:3.0:1788838350.946566:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946589:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946608:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946625:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca9c6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946641:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca9c6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946660:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca9c6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838350.946663:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+60:73658:x1875729116512768:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838350.946684:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838350.946710:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396ccca9cd lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1ca expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.946752:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6c00/0x88da08396ccca9d4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946768:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccca9db lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.946771:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6c00/0x88da08396ccca9d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946794:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccca9db lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946843:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccca9db lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838350.946855:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xa:0x0]: returning size 0 00010000:00010000:3.0:1788838350.946970:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946979:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946986:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946992:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.946999:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712da00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838350.947006:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947016:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947032:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:3.0:1788838350.947036:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838350.947049:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947057:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396ccca9bf lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947075:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca9c6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947081:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca9c6 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947087:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca9c6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947092:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838350.947095:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca9c6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947101:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca9c6 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947109:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff8ff5037c5900) 00010000:00010000:3.0:1788838350.947111:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838350.947114:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca9c6 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947120:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396ccca9c6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947180:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9b8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1c3 expref: 63 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947210:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccca9db lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1c3 expref: 62 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.947218:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8ff5037c5200) 00010000:00010000:3.0:1788838350.947220:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838350.947223:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c000, rc 0) 00000100:00100000:3.0:1788838350.947313:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+62:73659:x1875729116512640:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1001us (1307us total) trans 124554051667 rc 0/0 00000100:00100000:3.0:1788838350.947322:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1542 00000100:00100000:3.0:1788838350.947503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.947542:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.947588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.948637:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1012 00000100:00100000:3.0:1788838350.949014:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2404:x1875729116513024:12345-192.168.203.30@tcp:4:dd.0 00000100:00100000:0.0:1788838350.949252:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116512896 00000100:00100000:0.0:1788838350.949264:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116512896 00000100:00100000:0.0:1788838350.949318:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116513152 00000100:00100000:0.0:1788838350.949322:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116513152 00000100:00100000:0.0:1788838350.949353:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6019 00000100:00100000:0.0:1788838350.949361:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+11:73657:x1875729116512896:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838350.949374:0:26212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838350.949403:0:26212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035506005/0x88da08396ccca9e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1d1 expref: -99 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838350.949428:0:26212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x384:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:0.0:1788838350.949466:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x384:0x0].0x0 since=3744s v=(0 0) 00010000:00010000:0.0:1788838350.949472:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x384:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838350.949482:0:26212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035506005/0x88da08396ccca9e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1d1 expref: 12 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.949506:0:26212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035506005/0x88da08396ccca9e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1d1 expref: 12 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.949521:0:26212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504627a00, rc 0) 00010000:00000080:0.0:1788838350.949540:0:26212:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bd2f480 x1875729116512896/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 328/400 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838350.949636:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+12:73657:x1875729116512896:12345-192.168.203.30@tcp:101:dd.0 Request processed in 275us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838350.949645:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6019 00000100:00100000:0.0:1788838350.949676:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6020 00000100:00100000:0.0:1788838350.949684:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2404:x1875729116513152:12345-192.168.203.30@tcp:16:kworker.0 00010000:00000080:0.0:1788838350.949902:0:26212:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61d27dc00 x1875729116513152/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 440/432 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838350.949935:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2404:x1875729116513152:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 252us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838350.949942:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6020 00000100:00100000:2.0:1788838350.950011:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116513408 00000100:00100000:2.0:1788838350.950027:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116513408 00010000:00010000:1.0:1788838350.950641:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6c00/0x88da08396ccca9d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.950833:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396ccca9cd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1ca expref: 63 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.950861:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6c00/0x88da08396ccca9d4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1ca expref: 62 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.950871:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8ff605587000) 00010000:00010000:1.0:1788838350.950873:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788838350.950877:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff6421c6c00, rc 0) 00000100:00100000:1.0:1788838350.950956:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+62:73658:x1875729116512768:12345-192.168.203.30@tcp:101:dd.0 Request processed in 4311us (4856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838350.950965:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1543 00000100:00100000:1.0:1788838350.950995:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1544 00000100:00100000:1.0:1788838350.951010:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+61:73660:x1875729116513408:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:1.0:1788838350.951056:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838350.951077:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712dc00/0x88da08396ccca95d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1a7 expref: 61 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.951092:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8ff508af1400) 00010000:00010000:1.0:1788838350.951096:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838350.951255:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.951267:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.951276:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788838350.951340:0:75504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051668 00000004:00010000:1.0:1788838350.951369:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a642eb13 reply state 000000009df4d5fd transno 124554051669 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.951390:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.951397:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8ff508af1400) 00010000:00010000:1.0:1788838350.951398:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838350.951401:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838350.951456:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+63:73660:x1875729116513408:12345-192.168.203.30@tcp:36:dd.0 Request processed in 453us (3868us total) trans 124554051669 rc 0/0 00000100:00100000:1.0:1788838350.951463:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1544 00000020:00080000:1.0:1788838350.951467:0:75504:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00000080:3.0:1788838350.953062:0:24890:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f38c380 x1875729116513024/t4294969482(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 1512/448 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838350.953218:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2404:x1875729116513024:12345-192.168.203.30@tcp:4:dd.0 Request processed in 4566us (7143us total) trans 4294969482 rc 0/0 00000100:00100000:3.0:1788838350.953229:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1012 00002000:00100000:3.0:1788838350.953242:0:24890:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x383:0x0] (0->1023) req@ffff8ff50f38c380 x1875729116513024/t4294969482(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 1512/448 e 0 to 0 dl 1788838361 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838350.953251:0:24890:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f38c380 with x1875729116513024 ext(0->1023) 00002000:00010000:3.0:1788838350.953259:0:24890:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f38c380 00000100:00100000:0.0:1788838350.958918:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.958998:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116513664 00000100:00100000:3.0:1788838350.959016:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116513664 00000100:00100000:3.0:1788838350.959108:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 268 00000100:00100000:3.0:1788838350.959121:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+63:73661:x1875729116513664:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:3.0:1788838350.959579:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+64:73661:x1875729116513664:12345-192.168.203.30@tcp:35:dd.0 Request processed in 459us (667us total) trans 124554051670 rc 0/0 00000100:00100000:3.0:1788838350.959590:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 268 00000100:00100000:1.0:1788838350.964074:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.964184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838350.964285:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116513792 00000100:00100000:2.0:1788838350.964296:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116513792 00000100:00100000:2.0:1788838350.964361:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6021 00000100:00100000:2.0:1788838350.964372:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2404:x1875729116513792:12345-192.168.203.30@tcp:16:kworker.0 00010000:00000080:2.0:1788838350.964438:0:26218:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc73100 x1875729116513792/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 440/432 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838350.964511:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2404:x1875729116513792:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 141us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838350.964518:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6021 00000100:00100000:3.0:1788838350.965556:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116514048 00000100:00100000:3.0:1788838350.965566:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116514048 00000100:00100000:3.0:1788838350.965623:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1545 00000100:00100000:3.0:1788838350.965632:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+64:73658:x1875729116514048:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:3.0:1788838350.965695:0:67312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838350.965722:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d600/0x88da08396ccca9a3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1bc expref: 64 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.965742:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8ff605587000) 00010000:00010000:3.0:1788838350.965746:0:67312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838350.965964:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.965977:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.965989:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788838350.966036:0:67312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051671 00000004:00010000:3.0:1788838350.966062:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bb9f25c reply state 0000000029babb2f transno 124554051672 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.966090:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.966097:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8ff605587000) 00010000:00010000:3.0:1788838350.966100:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838350.966103:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788838350.966188:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+66:73658:x1875729116514048:12345-192.168.203.30@tcp:36:dd.0 Request processed in 557us (2003us total) trans 124554051672 rc 0/0 00000100:00100000:3.0:1788838350.966196:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1545 00000020:00080000:3.0:1788838350.966201:0:67312:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788838350.966270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.966374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.966573:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116514176 00000100:00100000:1.0:1788838350.966579:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116514176 00000100:00100000:1.0:1788838350.966622:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6022 00000100:00100000:1.0:1788838350.966630:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+12:73660:x1875729116514176:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838350.966644:0:26215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838350.966671:0:26215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004733fc58/0x88da08396ccca9fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1d8 expref: -99 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838350.966693:0:26215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x387:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:1.0:1788838350.966710:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x387:0x0].0x0 since=3744s v=(0 0) 00010000:00010000:1.0:1788838350.966714:0:26215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x387:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838350.966722:0:26215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004733fc58/0x88da08396ccca9fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1d8 expref: 13 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.966736:0:26215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004733fc58/0x88da08396ccca9fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1d8 expref: 13 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.966746:0:26215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff6421c6a00, rc 0) 00010000:00000080:1.0:1788838350.966753:0:26215:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e1f80 x1875729116514176/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 328/400 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838350.966817:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+13:73660:x1875729116514176:12345-192.168.203.30@tcp:101:dd.0 Request processed in 166us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838350.966824:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6022 00000100:00100000:1.0:1788838350.966844:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116514304 00000100:00100000:1.0:1788838350.966848:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116514304 00000100:00100000:1.0:1788838350.966881:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1546 00000100:00100000:1.0:1788838350.966887:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+66:73659:x1875729116514304:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838350.966898:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838350.966909:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7400/0x88da08396cccaa05 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1df expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.966933:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396cccaa0c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.966943:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396cccaa0c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.966952:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396cccaa0c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.967032:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7400/0x88da08396cccaa05 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1df expref: 68 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.967049:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7600/0x88da08396cccaa0c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1df expref: 67 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.967056:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8ff5037c5200) 00010000:00010000:1.0:1788838350.967059:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788838350.967061:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff6421c7600, rc 0) 00000100:00100000:1.0:1788838350.967087:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+67:73659:x1875729116514304:12345-192.168.203.30@tcp:101:dd.0 Request processed in 199us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838350.967094:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1546 00000100:00100000:3.0:1788838350.971350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.972714:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.972836:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116514432 00000100:00100000:1.0:1788838350.972846:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116514432 00002000:00010000:1.0:1788838350.972895:0:26090:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/900 (0->18446744073709551615) 00002000:00100000:1.0:1788838350.972900:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f3e2300 with x1875729116514432 ext(0->18446744073709551615) 00002000:00010000:1.0:1788838350.972912:0:26090:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f3e2300. 00000100:00100000:1.0:1788838350.972942:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1013 00000100:00100000:1.0:1788838350.972951:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+13:2405:x1875729116514432:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:1.0:1788838350.973109:0:26090:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788838350.973113:0:26090:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:1.0:1788838350.973116:0:26090:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:1.0:1788838350.973118:0:26090:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:1.0:1788838350.973120:0:26090:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788838350.973128:0:26090:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e2300 x1875729116514432/t4294969483(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 440/432 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838350.973187:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+14:2405:x1875729116514432:12345-192.168.203.30@tcp:10:dd.0 Request processed in 237us (479us total) trans 4294969483 rc 0/0 00000100:00100000:1.0:1788838350.973196:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1013 00002000:00010000:1.0:1788838350.973199:0:26090:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/900 (0->18446744073709551615) 00002000:00100000:1.0:1788838350.973202:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f3e2300 with x1875729116514432 ext(0->18446744073709551615) 00002000:00010000:1.0:1788838350.973207:0:26090:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f3e2300. 00000100:00100000:2.0:1788838350.973528:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116514688 00000100:00100000:2.0:1788838350.973533:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116514688 00000100:00100000:2.0:1788838350.973573:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1547 00000100:00100000:2.0:1788838350.973581:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+67:73673:x1875729116514688:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838350.973594:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838350.973613:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396cccaa13 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1e6 expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973737:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973752:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973763:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973778:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396cccaa21 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973785:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396cccaa21 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973791:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396cccaa21 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973884:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396cccaa28 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973893:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396cccaa28 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973901:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396cccaa28 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788838350.973911:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x18:0x0]: returning size 0 00010000:00010000:2.0:1788838350.973972:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973980:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973986:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973992:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.973998:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838350.974002:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974009:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974020:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:2.0:1788838350.974023:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838350.974035:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974042:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccaa1a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974057:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396cccaa21 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974063:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396cccaa21 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974070:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396cccaa21 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974075:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:2.0:1788838350.974078:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396cccaa21 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974085:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396cccaa21 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974092:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff8ff504d9f500) 00010000:00010000:2.0:1788838350.974095:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788838350.974097:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396cccaa21 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974103:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10e00/0x88da08396cccaa21 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974140:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11e00/0x88da08396cccaa13 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1e6 expref: 70 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974165:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396cccaa28 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1e6 expref: 69 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838350.974173:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8ff61d841800) 00010000:00010000:2.0:1788838350.974175:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788838350.974178:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f10c00, rc 0) 00000100:00100000:2.0:1788838350.974210:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+69:73673:x1875729116514688:12345-192.168.203.30@tcp:101:dd.0 Request processed in 630us (2872us total) trans 124554051673 rc 0/0 00000100:00100000:2.0:1788838350.974218:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1547 00000100:00100000:1.0:1788838350.985030:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.985100:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.985150:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.985271:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.985353:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116514816 00000100:00100000:3.0:1788838350.985367:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116514816 00000100:00100000:3.0:1788838350.985444:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116515200 00000100:00100000:3.0:1788838350.985448:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116515200 00000100:00100000:3.0:1788838350.985476:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6023 00000100:00100000:3.0:1788838350.985486:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+15:2404:x1875729116514816:12345-192.168.203.30@tcp:16:kworker.0 00010000:00000080:3.0:1788838350.985574:0:26210:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc73800 x1875729116514816/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 440/432 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838350.985648:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+15:2404:x1875729116514816:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 163us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838350.985672:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6023 00000100:00100000:3.0:1788838350.985695:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6024 00000100:00100000:3.0:1788838350.985702:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+14:73658:x1875729116515200:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.985722:0:26210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.985762:0:26210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396cccaa36 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1ed expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838350.985790:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x385:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:3.0:1788838350.985853:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x385:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:3.0:1788838350.985860:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x385:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838350.985870:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396cccaa36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1ed expref: 15 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.985896:0:26210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396cccaa36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1ed expref: 15 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.985914:0:26210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d600, rc 0) 00000100:00100000:2.0:1788838350.985919:0:24888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116515328 00010000:00000080:3.0:1788838350.985921:0:26210:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bd6e680 x1875729116515200/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 328/400 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838350.985933:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116515072 00000100:00100000:2.0:1788838350.985938:0:24888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116515328 00000100:00100000:0.0:1788838350.985940:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116515072 00000100:00100000:3.0:1788838350.985961:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+16:73658:x1875729116515200:12345-192.168.203.30@tcp:101:dd.0 Request processed in 257us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838350.985969:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6024 00002000:00010000:2.0:1788838350.985996:0:24888:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/903 (0->18446744073709551615) 00002000:00100000:2.0:1788838350.986004:0:24888:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505766d80 with x1875729116515328 ext(0->18446744073709551615) 00002000:00010000:2.0:1788838350.986016:0:24888:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505766d80. 00000100:00100000:2.0:1788838350.986060:0:24888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1014 00000100:00100000:0.0:1788838350.986060:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1548 00000100:00100000:2.0:1788838350.986069:0:24888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+15:2406:x1875729116515328:12345-192.168.203.30@tcp:10:dd.0 00000100:00100000:0.0:1788838350.986069:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+69:73659:x1875729116515072:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1788838350.986129:0:67312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838350.986162:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c000/0x88da08396ccca9db lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1c3 expref: 69 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.986184:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8ff5037c5200) 00010000:00010000:0.0:1788838350.986189:0:67312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1788838350.986229:0:24888:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788838350.986232:0:24888:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:2.0:1788838350.986234:0:24888:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:2.0:1788838350.986237:0:24888:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:2.0:1788838350.986239:0:24888:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788838350.986247:0:24888:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505766d80 x1875729116515328/t4294969484(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 440/432 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838350.986305:0:24888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+16:2406:x1875729116515328:12345-192.168.203.30@tcp:10:dd.0 Request processed in 236us (1033us total) trans 4294969484 rc 0/0 00010000:00010000:0.0:1788838350.986305:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.986319:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838350.986325:0:24888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1014 00002000:00010000:2.0:1788838350.986329:0:24888:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/903 (0->18446744073709551615) 00002000:00100000:2.0:1788838350.986331:0:24888:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505766d80 with x1875729116515328 ext(0->18446744073709551615) 00010000:00010000:0.0:1788838350.986333:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838350.986336:0:24888:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505766d80. 00000001:00080000:0.0:1788838350.986372:0:67312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051674 00000004:00010000:0.0:1788838350.988595:0:67312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026816c0c reply state 000000009d5c7a15 transno 124554051675 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.988616:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838350.988625:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8ff5037c5200) 00010000:00010000:0.0:1788838350.988628:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838350.988632:0:67312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838350.988759:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+71:73659:x1875729116515072:12345-192.168.203.30@tcp:36:dd.0 Request processed in 2687us (3654us total) trans 124554051675 rc 0/0 00000100:00100000:0.0:1788838350.988768:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1548 00000020:00080000:0.0:1788838350.988773:0:67312:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788838350.992624:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.992702:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116515584 00000100:00100000:1.0:1788838350.992713:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116515584 00000100:00100000:1.0:1788838350.992779:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 269 00000100:00100000:1.0:1788838350.992790:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+71:73657:x1875729116515584:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:1.0:1788838350.993213:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+72:73657:x1875729116515584:12345-192.168.203.30@tcp:35:dd.0 Request processed in 423us (599us total) trans 124554051676 rc 0/0 00000100:00100000:1.0:1788838350.993222:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 269 00000100:00100000:0.0:1788838350.994900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.995022:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116515840 00000100:00100000:3.0:1788838350.995033:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116515840 00000100:00100000:1.0:1788838350.995194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838350.995988:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116515968 00000100:00100000:3.0:1788838350.995997:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116515968 00000100:00100000:1.0:1788838350.996063:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1549 00000100:00100000:1.0:1788838350.996077:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+73:73662:x1875729116515840:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838350.996098:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838350.996117:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7400/0x88da08396cccaa44 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1f4 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.996246:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.996260:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.996272:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.996287:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396cccaa52 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.996293:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396cccaa52 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.996300:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396cccaa52 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.996358:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccaa59 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838350.996564:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1550 00000100:00100000:3.0:1788838350.996578:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+74:73673:x1875729116515968:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838350.996588:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838350.996606:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccaa60 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d1fb expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.996627:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396cccaa67 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.996637:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396cccaa67 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.996646:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396cccaa67 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.996854:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccaa60 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1fb expref: 76 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.996875:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712da00/0x88da08396cccaa67 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1fb expref: 75 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838350.997173:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8ff61d841800) 00010000:00010000:3.0:1788838350.997176:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838350.997179:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712da00, rc 0) 00000100:00100000:3.0:1788838350.997246:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+75:73673:x1875729116515968:12345-192.168.203.30@tcp:101:dd.0 Request processed in 669us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838350.997253:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1550 00010000:00010000:1.0:1788838350.997575:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccaa59 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997586:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccaa59 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838350.997597:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xd:0x0]: returning size 0 00010000:00010000:1.0:1788838350.997690:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997697:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997703:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997710:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997715:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c6600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838350.997719:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997726:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997737:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:1.0:1788838350.997740:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838350.997743:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997749:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6600/0x88da08396cccaa4b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997770:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396cccaa52 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997776:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396cccaa52 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997782:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396cccaa52 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997786:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c7a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838350.997789:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396cccaa52 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997829:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396cccaa52 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997838:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff8ff627601e00) 00010000:00010000:1.0:1788838350.997840:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838350.997843:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396cccaa52 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997848:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7a00/0x88da08396cccaa52 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997887:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c7400/0x88da08396cccaa44 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1f4 expref: 76 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997898:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccaa59 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1f4 expref: 75 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838350.997916:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8ff61d841300) 00010000:00010000:1.0:1788838350.997918:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838350.997921:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff6421c6400, rc 0) 00000100:00100000:1.0:1788838350.997966:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+75:73662:x1875729116515840:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1893us (3074us total) trans 124554051677 rc 0/0 00000100:00100000:1.0:1788838350.997973:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1549 00000100:00100000:1.0:1788838350.999206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838350.999281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838350.999329:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116516096 00000100:00100000:0.0:1788838350.999338:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116516096 00002000:00010000:0.0:1788838350.999370:0:8467:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/901 (0->18446744073709551615) 00002000:00100000:0.0:1788838350.999375:0:8467:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505767100 with x1875729116516096 ext(0->18446744073709551615) 00002000:00010000:0.0:1788838350.999386:0:8467:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505767100. 00000100:00100000:0.0:1788838350.999419:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1015 00000100:00100000:0.0:1788838350.999429:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+16:2407:x1875729116516096:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:0.0:1788838350.999569:0:8467:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788838350.999573:0:8467:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:0.0:1788838350.999585:0:8467:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:0.0:1788838350.999587:0:8467:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:0.0:1788838350.999589:0:8467:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788838350.999598:0:8467:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505767100 x1875729116516096/t4294969485(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 440/432 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838350.999677:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+17:2407:x1875729116516096:12345-192.168.203.30@tcp:10:dd.0 Request processed in 248us (474us total) trans 4294969485 rc 0/0 00000100:00100000:0.0:1788838350.999686:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1015 00002000:00010000:0.0:1788838350.999689:0:8467:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/901 (0->18446744073709551615) 00002000:00100000:0.0:1788838350.999692:0:8467:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505767100 with x1875729116516096 ext(0->18446744073709551615) 00002000:00010000:0.0:1788838350.999697:0:8467:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505767100. 00000100:00100000:2.0:1788838351.000036:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116516480 00000100:00100000:2.0:1788838351.000041:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116516480 00000100:00100000:2.0:1788838351.000082:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6025 00000100:00100000:2.0:1788838351.000091:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+17:73659:x1875729116516480:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838351.000101:0:26206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838351.000117:0:26206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c5525c/0x88da08396cccaa75 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d202 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838351.000135:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x386:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:2.0:1788838351.000151:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x386:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:2.0:1788838351.000155:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x386:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838351.000161:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c5525c/0x88da08396cccaa75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d202 expref: 18 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.000176:0:26206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5c5525c/0x88da08396cccaa75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d202 expref: 18 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.000188:0:26206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f11e00, rc 0) 00010000:00000080:2.0:1788838351.000193:0:26206:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505766a00 x1875729116516480/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:251/0 lens 328/400 e 0 to 0 dl 1788838361 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.000251:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+18:73659:x1875729116516480:12345-192.168.203.30@tcp:101:dd.0 Request processed in 162us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.000265:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6025 00000100:00100000:1.0:1788838351.001006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.001219:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116516352 00000100:00100000:2.0:1788838351.001226:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116516352 00000100:00100000:2.0:1788838351.001269:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 270 00000100:00100000:2.0:1788838351.001277:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50358e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+75:73660:x1875729116516352:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:2.0:1788838351.002269:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50358e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+76:73660:x1875729116516352:12345-192.168.203.30@tcp:35:dd.0 Request processed in 988us (1262us total) trans 124554051678 rc 0/0 00000100:00100000:2.0:1788838351.002279:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 270 00000100:00100000:1.0:1788838351.005094:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.005148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.005179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.005204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.005231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.005436:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116516864 00000100:00100000:2.0:1788838351.005487:0:24889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116517504 00000100:00100000:2.0:1788838351.005496:0:24889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116517504 00000100:00100000:0.0:1788838351.005512:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116516864 00002000:00010000:2.0:1788838351.005535:0:24889:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/902 (0->18446744073709551615) 00002000:00100000:2.0:1788838351.005541:0:24889:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505764a80 with x1875729116517504 ext(0->18446744073709551615) 00002000:00010000:2.0:1788838351.005553:0:24889:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505764a80. 00000100:00100000:0.0:1788838351.005563:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116517248 00000100:00100000:0.0:1788838351.005567:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116517248 00000100:00100000:2.0:1788838351.005583:0:24889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1016 00000100:00100000:0.0:1788838351.005596:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1551 00000100:00100000:2.0:1788838351.005598:0:24889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2404:x1875729116517504:12345-192.168.203.30@tcp:10:dd.0 00000100:00100000:0.0:1788838351.005615:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+77:73662:x1875729116516864:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.005633:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.005663:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396cccaa7c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d209 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.005697:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396cccaa83 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.005710:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396cccaa83 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.005721:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396cccaa83 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838351.005750:0:24889:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788838351.005755:0:24889:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:2.0:1788838351.005758:0:24889:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:2.0:1788838351.005760:0:24889:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:2.0:1788838351.005763:0:24889:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788838351.005772:0:24889:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505764a80 x1875729116517504/t4294969486(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788838351.005858:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626400/0x88da08396cccaa7c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d209 expref: 79 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838351.005864:0:24889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+19:2404:x1875729116517504:12345-192.168.203.30@tcp:10:dd.0 Request processed in 269us (628us total) trans 4294969486 rc 0/0 00010000:00010000:0.0:1788838351.005885:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626e00/0x88da08396cccaa83 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d209 expref: 78 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838351.005890:0:24889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1016 00002000:00010000:2.0:1788838351.005897:0:24889:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/902 (0->18446744073709551615) 00002000:00100000:2.0:1788838351.005902:0:24889:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505764a80 with x1875729116517504 ext(0->18446744073709551615) 00010000:00010000:0.0:1788838351.005902:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8ff61d841300) 00010000:00010000:0.0:1788838351.005909:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00002000:00010000:2.0:1788838351.005910:0:24889:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505764a80. 00010000:00010000:0.0:1788838351.005913:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff504626e00, rc 0) 00000100:00100000:0.0:1788838351.005947:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+78:73662:x1875729116516864:12345-192.168.203.30@tcp:101:dd.0 Request processed in 341us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.005953:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1551 00000100:00100000:0.0:1788838351.005970:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1552 00000100:00100000:0.0:1788838351.005977:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+77:73663:x1875729116517248:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.005985:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.005994:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396cccaa8a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d210 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838351.006611:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116517376 00000100:00100000:3.0:1788838351.006618:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116517376 00000100:00100000:3.0:1788838351.006669:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6026 00000100:00100000:3.0:1788838351.006678:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+19:2404:x1875729116517376:12345-192.168.203.30@tcp:16:kworker.0 00000001:00080000:3.0:1788838351.007627:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969486 is committed 00010000:00000080:3.0:1788838351.007700:0:26207:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505765880 x1875729116517376/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.007749:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2404:x1875729116517376:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 1073us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838351.007758:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6026 00010000:00010000:0.0:1788838351.007827:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.007843:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.007854:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.007881:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccaa98 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.007889:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccaa98 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.007897:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccaa98 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.007960:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396cccaa9f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.007968:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396cccaa9f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.007975:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396cccaa9f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838351.007985:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788838351.008714:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008723:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008729:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008736:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008741:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601528e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.008754:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008762:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008775:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838351.008778:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.008782:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008788:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaa91 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008826:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccaa98 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008832:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccaa98 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008837:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccaa98 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008842:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.008844:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccaa98 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008849:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccaa98 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008857:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff8ff60b5cfb00) 00010000:00010000:0.0:1788838351.008860:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.008870:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccaa98 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838351.008874:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116516736 00010000:00010000:0.0:1788838351.008877:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccaa98 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838351.008885:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116516736 00010000:00010000:0.0:1788838351.008935:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626a00/0x88da08396cccaa8a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d210 expref: 81 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008950:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396cccaa9f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d210 expref: 80 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.008957:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8ff61d841700) 00010000:00010000:0.0:1788838351.008959:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838351.008961:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cb600, rc 0) 00000100:00100000:0.0:1788838351.009006:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+80:73663:x1875729116517248:12345-192.168.203.30@tcp:101:dd.0 Request processed in 3029us (3825us total) trans 124554051679 rc 0/0 00000100:00100000:0.0:1788838351.009017:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1552 00000100:00100000:2.0:1788838351.009018:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 271 00000100:00100000:2.0:1788838351.009033:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+80:73658:x1875729116516736:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:2.0:1788838351.009236:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+81:73658:x1875729116516736:12345-192.168.203.30@tcp:35:dd.0 Request processed in 207us (4151us total) trans 124554051680 rc 0/0 00000100:00100000:2.0:1788838351.009244:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 271 00000100:00100000:0.0:1788838351.010294:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.010347:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.010350:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116517120 00000100:00100000:3.0:1788838351.010359:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116517120 00000100:00100000:0.0:1788838351.010388:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.010410:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116517760 00000100:00100000:0.0:1788838351.010414:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116517760 00000100:00100000:0.0:1788838351.010439:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116518016 00000100:00100000:1.0:1788838351.010475:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1553 00000100:00100000:1.0:1788838351.010489:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+80:73662:x1875729116517760:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:1.0:1788838351.010532:0:66254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838351.010556:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccaa59 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1f4 expref: 80 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.010573:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8ff61d841300) 00010000:00010000:1.0:1788838351.010578:0:66254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838351.010667:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116518016 00000100:00100000:0.0:1788838351.010702:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1554 00000100:00100000:0.0:1788838351.010710:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+81:73673:x1875729116518016:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:1.0:1788838351.010732:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.010732:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838351.010748:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.010750:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10c00/0x88da08396cccaa28 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1e6 expref: 81 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.010784:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.010785:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8ff61d841800) 00010000:00010000:0.0:1788838351.010792:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:1.0:1788838351.010860:0:66254:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051681 00000004:00010000:1.0:1788838351.010885:0:66254:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e464b4fc reply state 00000000fa94cf00 transno 124554051682 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.010898:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.010904:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8ff61d841300) 00010000:00010000:1.0:1788838351.010907:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838351.010910:0:66254:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788838351.010914:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.010925:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.010934:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838351.010963:0:66255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051683 00000004:00010000:0.0:1788838351.010981:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b997825d reply state 0000000040dcd600 transno 124554051684 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.010989:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.010996:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8ff61d841800) 00010000:00010000:0.0:1788838351.010998:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838351.011000:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00002000:00100000:3.0:1788838351.011498:0:25108:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x388:0x0] (0->1023) req@ffff8ff637d56680 x1875729116517120/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838351.011509:0:25108:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d56680 with x1875729116517120 ext(0->1023) 00002000:00010000:3.0:1788838351.011514:0:25108:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d56680 00000100:00100000:3.0:1788838351.011544:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1017 00000100:00100000:3.0:1788838351.011554:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2404:x1875729116517120:12345-192.168.203.30@tcp:4:dd.0 00000100:00100000:0.0:1788838351.012419:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+84:73673:x1875729116518016:12345-192.168.203.30@tcp:36:dd.0 Request processed in 1705us (2025us total) trans 124554051684 rc 0/0 00000100:00100000:0.0:1788838351.012428:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1554 00000020:00080000:0.0:1788838351.012434:0:66255:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788838351.012527:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+85:73662:x1875729116517760:12345-192.168.203.30@tcp:36:dd.0 Request processed in 2040us (2177us total) trans 124554051682 rc 0/0 00000100:00100000:1.0:1788838351.012536:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1553 00000020:00080000:1.0:1788838351.012540:0:66254:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00000080:3.0:1788838351.013601:0:25108:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d56680 x1875729116517120/t4294969487(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.014952:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+14:2404:x1875729116517120:12345-192.168.203.30@tcp:4:dd.0 Request processed in 3385us (4648us total) trans 4294969487 rc 0/0 00000100:00100000:3.0:1788838351.014967:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1017 00002000:00100000:3.0:1788838351.014981:0:25108:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x388:0x0] (0->1023) req@ffff8ff637d56680 x1875729116517120/t4294969487(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838351.014991:0:25108:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d56680 with x1875729116517120 ext(0->1023) 00002000:00010000:3.0:1788838351.014997:0:25108:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d56680 00000100:00100000:2.0:1788838351.015985:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.016238:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116518144 00000100:00100000:1.0:1788838351.016247:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116518144 00000100:00100000:1.0:1788838351.016307:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1555 00000100:00100000:1.0:1788838351.016318:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+84:73663:x1875729116518144:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838351.016340:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838351.016362:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccaabb lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d217 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.016410:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9e00/0x88da08396cccaac2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.016424:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9e00/0x88da08396cccaac2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.016452:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9e00/0x88da08396cccaac2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.016563:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccaabb lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d217 expref: 86 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.016580:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9e00/0x88da08396cccaac2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d217 expref: 85 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.016588:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8ff61d841700) 00010000:00010000:1.0:1788838351.016591:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788838351.016599:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e9e00, rc 0) 00000100:00100000:1.0:1788838351.016648:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+85:73663:x1875729116518144:12345-192.168.203.30@tcp:101:dd.0 Request processed in 333us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.016665:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1555 00000100:00100000:3.0:1788838351.017477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.017509:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.017540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.017605:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116518400 00000100:00100000:0.0:1788838351.017611:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116518400 00000100:00100000:0.0:1788838351.017646:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1556 00000100:00100000:0.0:1788838351.017667:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+85:73664:x1875729116518400:12345-192.168.203.30@tcp:101:dd.0 00000100:00100000:1.0:1788838351.017687:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116518528 00010000:00010000:0.0:1788838351.017689:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788838351.017691:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116518528 00010000:00010000:0.0:1788838351.017704:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccaac9 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d21e expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838351.017758:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116518656 00000100:00100000:1.0:1788838351.017762:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116518656 00000100:00100000:1.0:1788838351.017782:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6027 00000100:00100000:1.0:1788838351.017789:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+15:73673:x1875729116518528:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838351.017797:0:26209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838351.017827:0:26209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da54206c/0x88da08396cccaad0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d225 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.017828:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.017840:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838351.017848:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x394:0x0] initial LVB size: 0, mtime: 0x6a9f81c6, atime: 0x6a9f81c6, ctime: 0x6a9f81c6, blocks: 0x0 00010000:00010000:0.0:1788838351.017850:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.017861:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x394:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:0.0:1788838351.017862:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccaade lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.017868:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccaade lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.017870:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838351.017875:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccaade lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.017878:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da54206c/0x88da08396cccaad0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d225 expref: 16 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.017891:0:26209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da54206c/0x88da08396cccaad0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d225 expref: 16 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.017901:0:26209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e8400, rc 0) 00010000:00000080:1.0:1788838351.017908:0:26209:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e2680 x1875729116518528/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788838351.017925:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396cccaae5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.017932:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396cccaae5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.017938:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396cccaae5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838351.017947:0:66255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xf:0x0]: returning size 0 00000100:00100000:1.0:1788838351.018028:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+16:73673:x1875729116518528:12345-192.168.203.30@tcp:101:dd.0 Request processed in 239us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.018035:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6027 00000100:00100000:1.0:1788838351.018052:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6028 00000100:00100000:1.0:1788838351.018058:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+15:2404:x1875729116518656:12345-192.168.203.30@tcp:16:kworker.0 00010000:00010000:0.0:1788838351.018105:0:66255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018113:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018120:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018127:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018132:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.018136:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018143:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018155:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838351.018157:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.018161:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018167:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccaad7 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018178:0:66255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccaade lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018184:0:66255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccaade lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018190:0:66255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccaade lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018202:0:66255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cbe00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.018206:0:66255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccaade lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018212:0:66255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccaade lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018220:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff8ff60b5cfa00) 00010000:00010000:0.0:1788838351.018222:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.018225:0:66255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccaade lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018231:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccaade lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1788838351.018257:0:26209:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e3b80 x1875729116518656/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788838351.018268:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccaac9 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d21e expref: 88 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.018279:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396cccaae5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d21e expref: 87 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838351.018283:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+15:2404:x1875729116518656:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 226us (742us total) trans 0 rc 0/0 00010000:00010000:0.0:1788838351.018287:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8ff61d841600) 00010000:00010000:0.0:1788838351.018289:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1788838351.018290:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6028 00010000:00010000:0.0:1788838351.018292:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3caa00, rc 0) 00000100:00100000:0.0:1788838351.018311:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+87:73664:x1875729116518400:12345-192.168.203.30@tcp:101:dd.0 Request processed in 647us (838us total) trans 124554051685 rc 0/0 00000100:00100000:0.0:1788838351.018318:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1556 00000100:00100000:0.0:1788838351.022433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.022685:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116518912 00000100:00100000:2.0:1788838351.022695:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116518912 00000100:00100000:3.0:1788838351.023890:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.024177:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116519040 00000100:00100000:0.0:1788838351.024185:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116519040 00000100:00100000:0.0:1788838351.024236:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6029 00000100:00100000:0.0:1788838351.024245:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+15:73662:x1875729116519040:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.024264:0:8462:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.024286:0:8462:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396cccaaf3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d22c expref: -99 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838351.024310:0:8462:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x389:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:0.0:1788838351.024332:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x389:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:0.0:1788838351.024337:0:8462:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x389:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838351.024346:0:8462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396cccaaf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d22c expref: 16 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.024362:0:8462:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396cccaaf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d22c expref: 16 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.024385:0:8462:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cba00, rc 0) 00010000:00000080:0.0:1788838351.024393:0:8462:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e3800 x1875729116519040/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.024467:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+16:73662:x1875729116519040:12345-192.168.203.30@tcp:101:dd.0 Request processed in 223us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.024474:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6029 00000100:00100000:0.0:1788838351.026023:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.026351:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116519168 00000100:00100000:1.0:1788838351.026361:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116519168 00000100:00100000:1.0:1788838351.026425:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1557 00000100:00100000:1.0:1788838351.026435:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+88:73664:x1875729116519168:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838351.026467:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838351.026503:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccaafa lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d233 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.026535:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396cccab01 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.026547:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396cccab01 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.026558:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396cccab01 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.026685:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccaafa lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d233 expref: 90 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.026705:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8800/0x88da08396cccab01 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d233 expref: 89 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.026725:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8ff61d841600) 00010000:00010000:1.0:1788838351.026728:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788838351.026731:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e8800, rc 0) 00000100:00100000:1.0:1788838351.026787:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+89:73664:x1875729116519168:12345-192.168.203.30@tcp:101:dd.0 Request processed in 353us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.026794:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1557 00000100:00100000:2.0:1788838351.028346:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 272 00000100:00100000:2.0:1788838351.028365:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+88:73659:x1875729116518912:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:1.0:1788838351.028674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.029135:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116519552 00000100:00100000:3.0:1788838351.029143:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116519552 00002000:00010000:3.0:1788838351.029172:0:8466:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/916 (0->18446744073709551615) 00002000:00100000:3.0:1788838351.029176:0:8466:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505766300 with x1875729116519552 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838351.029189:0:8466:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505766300. 00000100:00100000:3.0:1788838351.029219:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1018 00000100:00100000:3.0:1788838351.029227:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+16:2407:x1875729116519552:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:3.0:1788838351.029358:0:8466:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788838351.029362:0:8466:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb mtime from disk: 1788838342 -> 1788838351 00002000:00010000:3.0:1788838351.029365:0:8466:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb atime from disk: 1788838342 -> 1788838342 00002000:00010000:3.0:1788838351.029367:0:8466:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb ctime from disk: 1788838342 -> 1788838351 00002000:00010000:3.0:1788838351.029370:0:8466:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788838351.029687:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+89:73659:x1875729116518912:12345-192.168.203.30@tcp:35:dd.0 Request processed in 1329us (7260us total) trans 124554051686 rc 0/0 00000100:00100000:2.0:1788838351.029696:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 272 00010000:00000080:3.0:1788838351.029753:0:8466:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505766300 x1875729116519552/t4294969488(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.029783:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+17:2407:x1875729116519552:12345-192.168.203.30@tcp:10:dd.0 Request processed in 558us (1110us total) trans 4294969488 rc 0/0 00000100:00100000:3.0:1788838351.029790:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1018 00002000:00010000:3.0:1788838351.029793:0:8466:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/916 (0->18446744073709551615) 00002000:00100000:3.0:1788838351.029866:0:8466:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505766300 with x1875729116519552 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838351.029872:0:8466:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505766300. 00000100:00100000:1.0:1788838351.033746:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.033850:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116519424 00000100:00100000:0.0:1788838351.033860:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116519424 00000100:00100000:0.0:1788838351.033930:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1558 00000100:00100000:0.0:1788838351.033950:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+89:73665:x1875729116519424:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.033973:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.033993:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccab08 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d23a expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034129:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034144:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034155:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034170:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396cccab16 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034177:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396cccab16 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034183:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396cccab16 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034239:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396cccab1d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034247:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396cccab1d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034255:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396cccab1d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838351.034275:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x10:0x0]: returning size 0 00010000:00010000:0.0:1788838351.034353:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034362:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034369:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034512:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034521:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff601529a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.034526:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034533:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034546:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838351.034549:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.034553:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034559:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccab0f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034574:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396cccab16 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034592:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396cccab16 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034598:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396cccab16 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034602:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.034605:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396cccab16 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034612:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396cccab16 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034620:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff8ff604d0d600) 00010000:00010000:0.0:1788838351.034622:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.034625:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396cccab16 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034630:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca000/0x88da08396cccab16 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034685:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccab08 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d23a expref: 92 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034701:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396cccab1d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d23a expref: 91 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.034708:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8ff61d841500) 00010000:00010000:0.0:1788838351.034710:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838351.034719:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cb000, rc 0) 00000100:00100000:0.0:1788838351.034781:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+91:73665:x1875729116519424:12345-192.168.203.30@tcp:101:dd.0 Request processed in 841us (1045us total) trans 124554051687 rc 0/0 00000100:00100000:0.0:1788838351.034788:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1558 00000100:00100000:0.0:1788838351.036589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.036629:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.036663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.036690:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116519808 00000100:00100000:0.0:1788838351.036697:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116519808 00000100:00100000:0.0:1788838351.036745:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116520192 00000100:00100000:0.0:1788838351.036748:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116520192 00000100:00100000:0.0:1788838351.036768:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1559 00000100:00100000:0.0:1788838351.036775:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+92:73663:x1875729116519808:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1788838351.036847:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838351.036873:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb600/0x88da08396cccaa9f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d210 expref: 92 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.036890:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8ff61d841700) 00010000:00010000:0.0:1788838351.036894:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788838351.037154:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1560 00000100:00100000:1.0:1788838351.037166:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+92:73664:x1875729116520192:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:1.0:1788838351.037188:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838351.037214:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3caa00/0x88da08396cccaae5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d21e expref: 92 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.037227:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8ff61d841600) 00010000:00010000:1.0:1788838351.037230:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838351.037321:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.037334:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.037344:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838351.037495:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116519936 00000100:00100000:3.0:1788838351.037501:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116519936 00002000:00010000:3.0:1788838351.037528:0:24890:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/905 (0->18446744073709551615) 00002000:00100000:3.0:1788838351.037532:0:24890:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d54000 with x1875729116519936 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838351.037542:0:24890:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d54000. 00000100:00100000:3.0:1788838351.037574:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1019 00000100:00100000:3.0:1788838351.037582:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+17:2405:x1875729116519936:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:3.0:1788838351.037715:0:24890:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788838351.037719:0:24890:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:3.0:1788838351.037722:0:24890:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:3.0:1788838351.037724:0:24890:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:3.0:1788838351.037727:0:24890:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788838351.037736:0:24890:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d54000 x1875729116519936/t4294969489(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.037826:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2405:x1875729116519936:12345-192.168.203.30@tcp:10:dd.0 Request processed in 244us (1196us total) trans 4294969489 rc 0/0 00000100:00100000:3.0:1788838351.037835:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1019 00002000:00010000:3.0:1788838351.037838:0:24890:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/905 (0->18446744073709551615) 00002000:00100000:3.0:1788838351.037840:0:24890:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d54000 with x1875729116519936 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838351.037846:0:24890:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d54000. 00000001:00080000:1.0:1788838351.038341:0:75504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051689 00000004:00010000:1.0:1788838351.038744:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000690e547e reply state 00000000fccee734 transno 124554051690 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.038763:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.038771:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8ff61d841600) 00010000:00010000:1.0:1788838351.038774:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838351.038778:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838351.038896:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+94:73664:x1875729116520192:12345-192.168.203.30@tcp:36:dd.0 Request processed in 1731us (2229us total) trans 124554051690 rc 0/0 00000100:00100000:1.0:1788838351.038904:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1560 00000020:00080000:1.0:1788838351.038908:0:75504:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788838351.039593:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.039608:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.039619:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838351.039690:0:66255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051688 00000004:00010000:0.0:1788838351.039720:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000269c4e4d reply state 00000000d7d55c01 transno 124554051691 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.039744:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.039751:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8ff61d841700) 00010000:00010000:0.0:1788838351.039754:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838351.039757:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838351.039838:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+95:73663:x1875729116519808:12345-192.168.203.30@tcp:36:dd.0 Request processed in 3061us (3254us total) trans 124554051691 rc 0/0 00000100:00100000:0.0:1788838351.039846:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1559 00000020:00080000:0.0:1788838351.039850:0:66255:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788838351.040639:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.040701:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.040750:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.040885:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116520832 00000100:00100000:1.0:1788838351.040892:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116520832 00000100:00100000:1.0:1788838351.040931:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 273 00000100:00100000:1.0:1788838351.041000:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+95:73673:x1875729116520832:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:0.0:1788838351.041537:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116520320 00000100:00100000:0.0:1788838351.041543:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116520320 00000100:00100000:0.0:1788838351.041580:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116520576 00000100:00100000:0.0:1788838351.041583:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116520576 00000100:00100000:0.0:1788838351.041612:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1561 00000100:00100000:0.0:1788838351.041620:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+98:73665:x1875729116520320:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.041631:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.041646:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccab39 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d241 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.041688:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccab40 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.041700:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccab40 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.041709:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccab40 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.041790:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccab39 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d241 expref: 100 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.041825:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca800/0x88da08396cccab40 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d241 expref: 99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.041832:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8ff61d841500) 00010000:00010000:0.0:1788838351.041835:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788838351.041838:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3ca800, rc 0) 00000100:00100000:3.0:1788838351.041906:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1562 00000100:00100000:3.0:1788838351.041916:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+99:73667:x1875729116520576:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838351.041926:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838351.041937:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab47 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d248 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.042039:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838351.042277:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+100:73673:x1875729116520832:12345-192.168.203.30@tcp:35:dd.0 Request processed in 1335us (1524us total) trans 124554051692 rc 0/0 00000100:00100000:1.0:1788838351.042285:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 273 00000100:00100000:0.0:1788838351.042612:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+99:73665:x1875729116520320:12345-192.168.203.30@tcp:101:dd.0 Request processed in 991us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.042619:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1561 00010000:00010000:3.0:1788838351.042824:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.042847:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.042863:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab55 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.042870:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab55 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.042876:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab55 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.042926:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396cccab5c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.042934:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396cccab5c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.042952:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396cccab5c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838351.042963:0:66253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x12:0x0]: returning size 0 00010000:00010000:3.0:1788838351.043029:0:66253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043037:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043052:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043059:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043071:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712d400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838351.043076:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043084:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043096:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:3.0:1788838351.043099:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838351.043102:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043108:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab4e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043119:0:66253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab55 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043124:0:66253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab55 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043130:0:66253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab55 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043140:0:66253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712de00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838351.043142:0:66253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab55 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043147:0:66253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab55 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043165:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff8ff5037c5400) 00010000:00010000:3.0:1788838351.043168:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838351.043170:0:66253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab55 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043176:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab55 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043214:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab47 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d248 expref: 100 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043226:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396cccab5c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d248 expref: 99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.043232:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8ff61d841a00) 00010000:00010000:3.0:1788838351.043235:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838351.043237:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712ca00, rc 0) 00000100:00100000:3.0:1788838351.043271:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+99:73667:x1875729116520576:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1358us (2569us total) trans 124554051693 rc 0/0 00000100:00100000:3.0:1788838351.043278:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1562 00000100:00100000:0.0:1788838351.043578:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.043642:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.043677:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116521088 00000100:00100000:0.0:1788838351.043683:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116521088 00000100:00100000:0.0:1788838351.043719:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6030 00000100:00100000:0.0:1788838351.043727:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2406:x1875729116521088:12345-192.168.203.30@tcp:16:kworker.0 00010000:00000080:0.0:1788838351.043767:0:8463:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d57100 x1875729116521088/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.043816:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2406:x1875729116521088:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 69us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.043824:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6030 00000100:00100000:3.0:1788838351.044139:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116520960 00000100:00100000:3.0:1788838351.044144:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116520960 00002000:00100000:3.0:1788838351.044170:0:24879:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x385:0x0] (0->1023) req@ffff8ff637d55180 x1875729116520960/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838351.044180:0:24879:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d55180 with x1875729116520960 ext(0->1023) 00002000:00010000:3.0:1788838351.044184:0:24879:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d55180 00000100:00100000:3.0:1788838351.044253:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1020 00000100:00100000:3.0:1788838351.044271:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2407:x1875729116520960:12345-192.168.203.30@tcp:4:dd.0 00000100:00100000:1.0:1788838351.044590:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00000080:3.0:1788838351.045329:0:24879:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d55180 x1875729116520960/t4294969490(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.045402:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+20:2407:x1875729116520960:12345-192.168.203.30@tcp:4:dd.0 Request processed in 1132us (1824us total) trans 4294969490 rc 0/0 00000100:00100000:3.0:1788838351.045411:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1020 00002000:00100000:3.0:1788838351.045418:0:24879:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x385:0x0] (0->1023) req@ffff8ff637d55180 x1875729116520960/t4294969490(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838351.045426:0:24879:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d55180 with x1875729116520960 ext(0->1023) 00002000:00010000:3.0:1788838351.045430:0:24879:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d55180 00000100:00100000:0.0:1788838351.045583:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116521216 00000100:00100000:0.0:1788838351.045590:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116521216 00000100:00100000:0.0:1788838351.045639:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6031 00000100:00100000:0.0:1788838351.045647:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+20:73664:x1875729116521216:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.045691:0:26214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.045714:0:26214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396cccab6a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d24f expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838351.045736:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38b:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:0.0:1788838351.045755:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38b:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:0.0:1788838351.045761:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838351.045770:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396cccab6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d24f expref: 21 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.045787:0:26214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396cccab6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d24f expref: 21 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.045820:0:26214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3ca000, rc 0) 00010000:00000080:0.0:1788838351.045826:0:26214:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505766680 x1875729116521216/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.045856:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+21:73664:x1875729116521216:12345-192.168.203.30@tcp:101:dd.0 Request processed in 210us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.045863:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6031 00000100:00100000:0.0:1788838351.047011:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.047286:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116521600 00000100:00100000:3.0:1788838351.047293:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116521600 00000100:00100000:2.0:1788838351.047496:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 274 00000100:00100000:2.0:1788838351.047511:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+99:73662:x1875729116521600:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:2.0:1788838351.048213:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+100:73662:x1875729116521600:12345-192.168.203.30@tcp:35:dd.0 Request processed in 706us (1203us total) trans 124554051694 rc 0/0 00000100:00100000:2.0:1788838351.048223:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 274 00000100:00100000:3.0:1788838351.049078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.049221:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116521344 00000100:00100000:2.0:1788838351.049229:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116521344 00000100:00100000:2.0:1788838351.049280:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6032 00000100:00100000:2.0:1788838351.049289:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+21:73663:x1875729116521344:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838351.049303:0:26208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838351.049334:0:26208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086fcecf0/0x88da08396cccab71 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d256 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838351.049361:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38a:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:2.0:1788838351.049381:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38a:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:2.0:1788838351.049386:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838351.049394:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086fcecf0/0x88da08396cccab71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d256 expref: 22 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.049411:0:26208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086fcecf0/0x88da08396cccab71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d256 expref: 22 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.049424:0:26208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f10e00, rc 0) 00010000:00000080:2.0:1788838351.049431:0:26208:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e1500 x1875729116521344/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.049475:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+22:73663:x1875729116521344:12345-192.168.203.30@tcp:101:dd.0 Request processed in 187us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.049497:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6032 00000100:00100000:2.0:1788838351.055689:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.055732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.055762:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.056180:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116521984 00000100:00100000:0.0:1788838351.056202:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116521984 00002000:00100000:0.0:1788838351.056251:0:24876:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x384:0x0] (0->1023) req@ffff8ff632e67480 x1875729116521984/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838351.056282:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff632e67480 with x1875729116521984 ext(0->1023) 00002000:00010000:0.0:1788838351.056289:0:24876:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff632e67480 00000100:00100000:0.0:1788838351.056328:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1021 00000100:00100000:0.0:1788838351.056338:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2407:x1875729116521984:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:0.0:1788838351.056735:0:24876:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff632e67480 x1875729116521984/t4294969491(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.056911:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116521856 00000100:00100000:1.0:1788838351.056917:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116521856 00000100:00100000:0.0:1788838351.057064:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2407:x1875729116521984:12345-192.168.203.30@tcp:4:dd.0 Request processed in 727us (1381us total) trans 4294969491 rc 0/0 00000100:00100000:0.0:1788838351.057080:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1021 00002000:00100000:0.0:1788838351.057088:0:24876:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x384:0x0] (0->1023) req@ffff8ff632e67480 x1875729116521984/t4294969491(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838351.057096:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff632e67480 with x1875729116521984 ext(0->1023) 00002000:00010000:0.0:1788838351.057100:0:24876:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff632e67480 00000100:00100000:1.0:1788838351.057260:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1563 00000100:00100000:1.0:1788838351.057269:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+100:73665:x1875729116521856:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:1.0:1788838351.057310:0:76060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838351.057345:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396cccab1d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d23a expref: 100 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.057363:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8ff61d841500) 00010000:00010000:1.0:1788838351.057369:0:76060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838351.057495:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.057509:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.057520:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788838351.057557:0:76060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051695 00000004:00010000:1.0:1788838351.057580:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d7d5d04 reply state 00000000f6b32bd5 transno 124554051696 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.057593:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.057609:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8ff61d841500) 00010000:00010000:1.0:1788838351.057611:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838351.057614:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838351.057696:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+102:73665:x1875729116521856:12345-192.168.203.30@tcp:36:dd.0 Request processed in 427us (1962us total) trans 124554051696 rc 0/0 00000100:00100000:1.0:1788838351.057703:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1563 00000020:00080000:1.0:1788838351.057707:0:76060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788838351.057887:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116522112 00000100:00100000:3.0:1788838351.057893:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116522112 00000100:00100000:3.0:1788838351.057946:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6033 00000100:00100000:3.0:1788838351.058350:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2406:x1875729116522112:12345-192.168.203.30@tcp:16:kworker.0 00000001:00080000:1.0:1788838351.058692:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969491 is committed 00010000:00000080:2.0:1788838351.058868:0:26210:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff63f745180 x1875729116522112/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.058907:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+16:2406:x1875729116522112:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 953us (3144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.058915:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6033 00000100:00100000:1.0:1788838351.062364:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.062405:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.062599:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116522624 00000100:00100000:2.0:1788838351.062611:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116522624 00002000:00010000:2.0:1788838351.062670:0:24878:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/907 (0->18446744073709551615) 00002000:00100000:2.0:1788838351.062675:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505767800 with x1875729116522624 ext(0->18446744073709551615) 00002000:00010000:2.0:1788838351.062688:0:24878:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505767800. 00000100:00100000:2.0:1788838351.062717:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1022 00000100:00100000:2.0:1788838351.062727:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+16:2405:x1875729116522624:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:2.0:1788838351.062901:0:24878:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788838351.062905:0:24878:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:2.0:1788838351.062908:0:24878:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:2.0:1788838351.062910:0:24878:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:2.0:1788838351.062912:0:24878:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788838351.062920:0:24878:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505767800 x1875729116522624/t4294969492(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.063410:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116522496 00000100:00100000:3.0:1788838351.063416:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116522496 00000100:00100000:3.0:1788838351.063468:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1564 00000100:00100000:3.0:1788838351.063479:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+102:73668:x1875729116522496:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838351.063500:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838351.063519:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396cccab7f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d264 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.063765:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.063781:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.063794:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.063843:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab8d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.063851:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab8d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.063858:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab8d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.063914:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab94 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.063923:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab94 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.063930:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab94 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788838351.063939:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x13:0x0]: returning size 0 00010000:00010000:3.0:1788838351.064000:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064008:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064021:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064027:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064033:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838351.064037:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064045:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064057:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:3.0:1788838351.064059:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838351.064063:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064069:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccab86 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064084:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab8d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064090:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab8d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064095:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab8d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064099:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712de00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:3.0:1788838351.064108:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab8d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064114:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab8d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064121:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff8ff5037c5400) 00010000:00010000:3.0:1788838351.064124:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788838351.064126:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab8d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064131:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccab8d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064170:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396cccab7f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d264 expref: 105 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064184:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab94 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d264 expref: 104 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.064191:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8ff5037c5700) 00010000:00010000:3.0:1788838351.064193:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788838351.064196:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d400, rc 0) 00000100:00100000:2.0:1788838351.064700:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+17:2405:x1875729116522624:12345-192.168.203.30@tcp:10:dd.0 Request processed in 1971us (2290us total) trans 4294969492 rc 0/0 00000100:00100000:3.0:1788838351.065120:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+104:73668:x1875729116522496:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1642us (2766us total) trans 124554051697 rc 0/0 00000100:00100000:0.0:1788838351.065259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.065398:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.065431:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116522240 00000100:00100000:0.0:1788838351.065437:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116522240 00000100:00100000:2.0:1788838351.065476:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1022 00002000:00010000:2.0:1788838351.065482:0:24878:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/907 (0->18446744073709551615) 00000100:00100000:0.0:1788838351.065483:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1565 00002000:00100000:2.0:1788838351.065488:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505767800 with x1875729116522624 ext(0->18446744073709551615) 00000100:00100000:0.0:1788838351.065496:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+105:73667:x1875729116522240:12345-192.168.203.30@tcp:101:dd.0 00002000:00010000:2.0:1788838351.065500:0:24878:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505767800. 00010000:00010000:0.0:1788838351.065512:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788838351.065521:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116522752 00000100:00100000:2.0:1788838351.065526:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116522752 00010000:00010000:0.0:1788838351.065528:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaba2 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d25d expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838351.065547:0:24878:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/906 (0->18446744073709551615) 00002000:00100000:2.0:1788838351.065552:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d54700 with x1875729116522752 ext(0->18446744073709551615) 00002000:00010000:2.0:1788838351.065557:0:24878:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d54700. 00010000:00010000:0.0:1788838351.065560:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396cccaba9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838351.065577:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1023 00010000:00010000:0.0:1788838351.065580:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396cccaba9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838351.065589:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+17:2405:x1875729116522752:12345-192.168.203.30@tcp:10:dd.0 00010000:00010000:0.0:1788838351.065594:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396cccaba9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.065700:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccaba2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d25d expref: 107 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.065718:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb000/0x88da08396cccaba9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d25d expref: 106 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838351.065720:0:24878:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788838351.065727:0:24878:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:2.0:1788838351.065733:0:24878:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00010000:00010000:0.0:1788838351.065736:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8ff61d841a00) 00002000:00010000:2.0:1788838351.065737:0:24878:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:2.0:1788838351.065743:0:24878:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1788838351.065743:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788838351.065748:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff63a3cb000, rc 0) 00010000:00000080:2.0:1788838351.065755:0:24878:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d54700 x1875729116522752/t4294969493(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.065789:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+106:73667:x1875729116522240:12345-192.168.203.30@tcp:101:dd.0 Request processed in 295us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.065791:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2405:x1875729116522752:12345-192.168.203.30@tcp:10:dd.0 Request processed in 204us (598us total) trans 4294969493 rc 0/0 00000100:00100000:0.0:1788838351.065823:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1565 00000100:00100000:2.0:1788838351.065828:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1023 00002000:00010000:2.0:1788838351.065833:0:24878:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/906 (0->18446744073709551615) 00002000:00100000:2.0:1788838351.065836:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d54700 with x1875729116522752 ext(0->18446744073709551615) 00002000:00010000:2.0:1788838351.065841:0:24878:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d54700. 00000100:00100000:3.0:1788838351.066480:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1564 00000100:00100000:0.0:1788838351.071630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.071686:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116523264 00000100:00100000:3.0:1788838351.071695:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116523264 00002000:00100000:3.0:1788838351.071742:0:25108:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x386:0x0] (0->1023) req@ffff8ff637d54a80 x1875729116523264/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838351.071774:0:25108:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d54a80 with x1875729116523264 ext(0->1023) 00002000:00010000:3.0:1788838351.071781:0:25108:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d54a80 00000100:00100000:3.0:1788838351.071837:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1024 00000100:00100000:3.0:1788838351.071847:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2406:x1875729116523264:12345-192.168.203.30@tcp:4:dd.0 00000100:00100000:2.0:1788838351.073592:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.073633:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.073717:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.073745:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116523136 00000100:00100000:2.0:1788838351.073753:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116523136 00000100:00100000:2.0:1788838351.073793:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116523392 00000100:00100000:2.0:1788838351.073815:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116523392 00000100:00100000:2.0:1788838351.073841:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6034 00000100:00100000:2.0:1788838351.073850:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64134b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+20:73665:x1875729116523136:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838351.073869:0:26206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838351.073892:0:26206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e7bc6b8/0x88da08396cccabb0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d26b expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838351.073917:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38c:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:2.0:1788838351.073938:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38c:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:2.0:1788838351.073955:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838351.073963:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e7bc6b8/0x88da08396cccabb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d26b expref: 21 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.073980:0:26206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e7bc6b8/0x88da08396cccabb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d26b expref: 21 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.073992:0:26206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f10c00, rc 0) 00010000:00000080:2.0:1788838351.074000:0:26206:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff64134b450 x1875729116523136/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.074134:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116523008 00000100:00100000:0.0:1788838351.074141:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116523008 00000100:00100000:0.0:1788838351.074190:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1566 00000100:00100000:0.0:1788838351.074198:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+105:73667:x1875729116523008:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1788838351.074259:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838351.074281:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712ca00/0x88da08396cccab5c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d248 expref: 105 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.074309:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8ff61d841a00) 00010000:00010000:0.0:1788838351.074313:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838351.074481:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.074494:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.074503:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838351.074543:0:66255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051698 00000004:00010000:0.0:1788838351.074564:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000177478c6 reply state 00000000355725db transno 124554051699 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.074575:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.074582:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8ff61d841a00) 00010000:00010000:0.0:1788838351.074584:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838351.074587:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788838351.074965:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64134b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+23:73665:x1875729116523136:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1114us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.074985:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6034 00010000:00000080:3.0:1788838351.075008:0:25108:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d54a80 x1875729116523264/t4294969494(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.075273:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6035 00000100:00100000:2.0:1788838351.075287:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2406:x1875729116523392:12345-192.168.203.30@tcp:16:kworker.0 00000001:00080000:1.0:1788838351.076159:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969494 is committed 00010000:00000080:1.0:1788838351.076214:0:26206:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504c05880 x1875729116523392/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.083894:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+107:73667:x1875729116523008:12345-192.168.203.30@tcp:36:dd.0 Request processed in 9684us (10296us total) trans 124554051699 rc 0/0 00000100:00100000:0.0:1788838351.083908:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1566 00000020:00080000:0.0:1788838351.083917:0:66255:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788838351.086309:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2406:x1875729116523264:12345-192.168.203.30@tcp:4:dd.0 Request processed in 14452us (14677us total) trans 4294969494 rc 0/0 00000100:00100000:3.0:1788838351.086325:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1024 00002000:00100000:3.0:1788838351.086340:0:25108:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x386:0x0] (0->1023) req@ffff8ff637d54a80 x1875729116523264/t4294969494(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838351.086350:0:25108:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d54a80 with x1875729116523264 ext(0->1023) 00002000:00010000:3.0:1788838351.086356:0:25108:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d54a80 00000100:00100000:0.0:1788838351.086717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.086876:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.086903:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116523648 00000100:00100000:0.0:1788838351.086912:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116523648 00000100:00100000:0.0:1788838351.086985:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1567 00000100:00100000:0.0:1788838351.086998:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+107:73668:x1875729116523648:12345-192.168.203.30@tcp:101:dd.0 00000100:00100000:3.0:1788838351.087006:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116523776 00010000:00010000:0.0:1788838351.087020:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788838351.087053:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116523776 00000100:00100000:3.0:1788838351.087085:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 275 00000100:00100000:3.0:1788838351.087093:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+108:73663:x1875729116523776:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:3.0:1788838351.087341:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+109:73663:x1875729116523776:12345-192.168.203.30@tcp:35:dd.0 Request processed in 249us (625us total) trans 124554051700 rc 0/0 00000100:00100000:3.0:1788838351.087348:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 275 00010000:00010000:0.0:1788838351.088786:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccabbe lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d272 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.088863:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccabc5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.088878:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccabc5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.088889:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccabc5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.090567:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccabbe lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d272 expref: 110 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.090594:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601528e00/0x88da08396cccabc5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d272 expref: 109 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838351.090605:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1788838351.090608:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8ff5037c5700) 00010000:00010000:0.0:1788838351.090613:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788838351.090617:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff601528e00, rc 0) 00000100:00100000:0.0:1788838351.090692:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+109:73668:x1875729116523648:12345-192.168.203.30@tcp:101:dd.0 Request processed in 3696us (3815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.090700:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1567 00000100:00100000:2.0:1788838351.091567:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116524032 00000100:00100000:2.0:1788838351.091577:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116524032 00000100:00100000:2.0:1788838351.091636:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 276 00000100:00100000:2.0:1788838351.091645:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632ec0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+109:73664:x1875729116524032:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:2.0:1788838351.091956:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632ec0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+110:73664:x1875729116524032:12345-192.168.203.30@tcp:35:dd.0 Request processed in 299us (1343us total) trans 124554051701 rc 0/0 00000100:00100000:2.0:1788838351.091964:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 276 00000100:00100000:1.0:1788838351.092530:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+17:2406:x1875729116523392:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 17245us (18808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.092542:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6035 00000100:00100000:3.0:1788838351.095057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.095234:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116524416 00000100:00100000:0.0:1788838351.095243:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116524416 00000100:00100000:0.0:1788838351.095333:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6036 00000100:00100000:0.0:1788838351.095344:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+17:73667:x1875729116524416:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.095364:0:26207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.095386:0:26207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecd773ea/0x88da08396cccabcc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d280 expref: -99 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788838351.095530:0:26207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38e:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:0.0:1788838351.095562:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38e:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:0.0:1788838351.095567:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788838351.095575:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd773ea/0x88da08396cccabcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d280 expref: 18 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.095592:0:26207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecd773ea/0x88da08396cccabcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d280 expref: 18 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.095605:0:26207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff60148fe00, rc 0) 00010000:00000080:0.0:1788838351.095613:0:26207:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e3480 x1875729116524416/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.095756:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+18:73667:x1875729116524416:12345-192.168.203.30@tcp:101:dd.0 Request processed in 413us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.095764:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6036 00000100:00100000:3.0:1788838351.098717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.098826:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116524288 00000100:00100000:1.0:1788838351.098836:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116524288 00000100:00100000:1.0:1788838351.098902:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1568 00000100:00100000:1.0:1788838351.098912:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+110:73666:x1875729116524288:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838351.098932:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838351.099050:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396cccabd3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d279 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099256:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099281:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099292:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099307:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccabe1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099314:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccabe1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099332:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccabe1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099519:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccabe8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099528:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccabe8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099536:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccabe8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838351.099546:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x11:0x0]: returning size 0 00010000:00010000:1.0:1788838351.099623:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099632:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099639:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099664:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099671:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838351.099676:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099684:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099696:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:1.0:1788838351.099699:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838351.099704:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099711:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccabda lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099727:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccabe1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099734:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccabe1 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099741:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccabe1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099746:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838351.099749:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccabe1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099767:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccabe1 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099776:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff8ff627601d00) 00010000:00010000:1.0:1788838351.099779:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838351.099782:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccabe1 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.099789:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccabe1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788838351.099914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1788838351.100110:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9c00/0x88da08396cccabd3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d279 expref: 113 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.100124:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccabe8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d279 expref: 112 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.100132:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:1.0:1788838351.100134:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838351.100136:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e8c00, rc 0) 00000100:00100000:1.0:1788838351.100299:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+112:73666:x1875729116524288:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1388us (1589us total) trans 124554051702 rc 0/0 00000100:00100000:1.0:1788838351.100307:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1568 00000100:00100000:3.0:1788838351.100372:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116524544 00000100:00100000:3.0:1788838351.100379:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116524544 00002000:00010000:3.0:1788838351.101539:0:8466:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/908 (0->18446744073709551615) 00002000:00100000:3.0:1788838351.101546:0:8466:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff504c05c00 with x1875729116524544 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838351.101556:0:8466:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff504c05c00. 00000100:00100000:3.0:1788838351.101593:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1025 00000100:00100000:3.0:1788838351.101606:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2404:x1875729116524544:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:3.0:1788838351.102856:0:8466:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788838351.102864:0:8466:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:3.0:1788838351.102867:0:8466:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:3.0:1788838351.102869:0:8466:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:3.0:1788838351.102872:0:8466:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788838351.103229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.103268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.103521:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116524800 00000100:00100000:2.0:1788838351.103530:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116524800 00000100:00100000:2.0:1788838351.103587:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1569 00000100:00100000:2.0:1788838351.103598:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+112:73668:x1875729116524800:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:2.0:1788838351.103663:0:76060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838351.103690:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d400/0x88da08396cccab94 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d264 expref: 112 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.103709:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8ff5037c5700) 00010000:00010000:2.0:1788838351.103714:0:76060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00000080:3.0:1788838351.103742:0:8466:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff504c05c00 x1875729116524544/t4294969495(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.103866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.103903:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116524928 00000100:00100000:3.0:1788838351.103908:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116524928 00002000:00010000:3.0:1788838351.103929:0:26090:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/910 (0->18446744073709551615) 00002000:00100000:3.0:1788838351.103933:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d56a00 with x1875729116524928 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838351.103943:0:26090:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d56a00. 00000100:00100000:2.0:1788838351.104101:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+20:2404:x1875729116524544:12345-192.168.203.30@tcp:10:dd.0 Request processed in 2498us (4186us total) trans 4294969495 rc 0/0 00000100:00100000:2.0:1788838351.104111:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1025 00002000:00010000:2.0:1788838351.104128:0:8466:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/908 (0->18446744073709551615) 00002000:00100000:2.0:1788838351.104132:0:8466:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff504c05c00 with x1875729116524544 ext(0->18446744073709551615) 00002000:00010000:2.0:1788838351.104137:0:8466:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff504c05c00. 00000100:00100000:2.0:1788838351.104295:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116525056 00000100:00100000:2.0:1788838351.104300:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116525056 00000100:00100000:3.0:1788838351.104361:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1026 00000100:00100000:3.0:1788838351.104371:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+20:2406:x1875729116524928:12345-192.168.203.30@tcp:10:dd.0 00002000:00100000:2.0:1788838351.104447:0:8466:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x387:0x0] (0->1023) req@ffff8ff505765500 x1875729116525056/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788838351.104457:0:8466:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505765500 with x1875729116525056 ext(0->1023) 00002000:00010000:2.0:1788838351.104462:0:8466:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505765500 00000100:00100000:1.0:1788838351.105275:0:24888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1027 00000100:00100000:1.0:1788838351.105289:0:24888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+20:2407:x1875729116525056:12345-192.168.203.30@tcp:4:dd.0 00002000:00010000:3.0:1788838351.105469:0:26090:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788838351.105473:0:26090:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:3.0:1788838351.105476:0:26090:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:3.0:1788838351.105479:0:26090:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:3.0:1788838351.105481:0:26090:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788838351.105500:0:26090:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d56a00 x1875729116524928/t4294969496(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.105552:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+21:2406:x1875729116524928:12345-192.168.203.30@tcp:10:dd.0 Request processed in 1183us (2283us total) trans 4294969496 rc 0/0 00000100:00100000:3.0:1788838351.105560:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1026 00002000:00010000:3.0:1788838351.105564:0:26090:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/910 (0->18446744073709551615) 00002000:00100000:3.0:1788838351.105567:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d56a00 with x1875729116524928 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838351.105573:0:26090:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d56a00. 00010000:00000080:1.0:1788838351.105780:0:24888:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505765500 x1875729116525056/t4294969497(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.105844:0:24888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2407:x1875729116525056:12345-192.168.203.30@tcp:4:dd.0 Request processed in 560us (1979us total) trans 4294969497 rc 0/0 00000100:00100000:1.0:1788838351.105851:0:24888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1027 00002000:00100000:1.0:1788838351.105858:0:24888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x387:0x0] (0->1023) req@ffff8ff505765500 x1875729116525056/t4294969497(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.105865:0:24888:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505765500 with x1875729116525056 ext(0->1023) 00002000:00010000:1.0:1788838351.105870:0:24888:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505765500 00010000:00010000:0.0:1788838351.107047:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.107082:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.107093:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838351.107095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000001:00080000:0.0:1788838351.107152:0:76060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051703 00000004:00010000:0.0:1788838351.107175:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b590c8ed reply state 000000002f95a561 transno 124554051704 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.107187:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.107194:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8ff5037c5700) 00010000:00010000:0.0:1788838351.107198:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838351.107201:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838351.107478:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+114:73668:x1875729116524800:12345-192.168.203.30@tcp:36:dd.0 Request processed in 3881us (4253us total) trans 124554051704 rc 0/0 00000100:00100000:0.0:1788838351.107486:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1569 00000020:00080000:0.0:1788838351.107490:0:76060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788838351.108605:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.108869:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116525184 00000100:00100000:1.0:1788838351.108878:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116525184 00000100:00100000:1.0:1788838351.108925:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6037 00000100:00100000:1.0:1788838351.108935:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2407:x1875729116525184:12345-192.168.203.30@tcp:16:kworker.0 00000100:00100000:0.0:1788838351.109498:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116525568 00000100:00100000:0.0:1788838351.109505:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116525568 00000100:00100000:0.0:1788838351.109539:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1570 00000100:00100000:0.0:1788838351.109546:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+114:73669:x1875729116525568:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.109562:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.109580:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccabfd lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d287 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109703:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109723:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109733:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109748:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac0b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109755:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac0b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109761:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac0b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109830:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396cccac12 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109839:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396cccac12 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109845:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396cccac12 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838351.109854:0:75504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x14:0x0]: returning size 0 00010000:00010000:0.0:1788838351.109920:0:75504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109927:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.109933:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788838351.110362:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969497 is committed 00010000:00000080:1.0:1788838351.112123:0:26217:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e0000 x1875729116525184/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.112196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1788838351.112288:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112295:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6c000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.112299:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112309:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112325:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838351.112328:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.112333:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112339:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac04 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112357:0:75504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac0b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112364:0:75504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac0b lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112370:0:75504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac0b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112375:0:75504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d800 already unused, calling callback (ffffffffc19eb4f0) 00000100:00100000:1.0:1788838351.112480:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2407:x1875729116525184:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 3545us (5384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.112490:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6037 00010000:00010000:0.0:1788838351.112611:0:75504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac0b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112634:0:75504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac0b lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112644:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff8ff604d0d700) 00010000:00010000:0.0:1788838351.112646:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.112661:0:75504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac0b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112667:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac0b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112727:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff601529a00/0x88da08396cccabfd lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d287 expref: 117 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112743:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396cccac12 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d287 expref: 116 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.112750:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8ff61254c300) 00010000:00010000:0.0:1788838351.112753:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838351.112755:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6cc00, rc 0) 00000100:00100000:2.0:1788838351.114880:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116525312 00000100:00100000:2.0:1788838351.114894:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116525312 00000100:00100000:2.0:1788838351.114968:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1571 00000100:00100000:2.0:1788838351.114978:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+117:73666:x1875729116525312:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838351.114998:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838351.115016:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396cccac20 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d28e expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.115047:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396cccac27 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.115061:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396cccac27 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.115073:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396cccac27 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.115203:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10600/0x88da08396cccac20 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d28e expref: 119 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.115236:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11a00/0x88da08396cccac27 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d28e expref: 118 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.115244:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:2.0:1788838351.115247:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788838351.115250:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f11a00, rc 0) 00000100:00100000:3.0:1788838351.116036:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.116665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.116706:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.116733:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116525952 00000100:00100000:3.0:1788838351.116739:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116525952 00000100:00100000:3.0:1788838351.116785:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00100000:3.0:1788838351.116813:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+119:73667:x1875729116525952:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:3.0:1788838351.117068:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+120:73667:x1875729116525952:12345-192.168.203.30@tcp:35:dd.0 Request processed in 275us (361us total) trans 124554051706 rc 0/0 00000100:00100000:3.0:1788838351.117206:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00100000:3.0:1788838351.117249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.117752:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116525696 00000100:00100000:1.0:1788838351.117758:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116525696 00000100:00100000:1.0:1788838351.117812:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116526208 00000100:00100000:1.0:1788838351.117815:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116526208 00000100:00100000:1.0:1788838351.117842:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6038 00000100:00100000:1.0:1788838351.117851:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+19:73668:x1875729116525696:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838351.117876:0:26212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838351.117897:0:26212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061af10e8/0x88da08396cccac2e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d295 expref: -99 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838351.117921:0:26212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38f:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:1.0:1788838351.117936:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38f:0x0].0x0 since=3745s v=(0 0) 00000100:00100000:3.0:1788838351.118059:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6039 00000100:00100000:3.0:1788838351.118160:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+20:2406:x1875729116526208:12345-192.168.203.30@tcp:16:kworker.0 00010000:00000080:3.0:1788838351.118200:0:8460:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e0700 x1875729116526208/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.118247:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+20:2406:x1875729116526208:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 180us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838351.118255:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6039 00010000:00010000:1.0:1788838351.121547:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838351.121572:0:26212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061af10e8/0x88da08396cccac2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d295 expref: 19 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.121599:0:26212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061af10e8/0x88da08396cccac2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d295 expref: 19 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.121617:0:26212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e9600, rc 0) 00010000:00000080:1.0:1788838351.121627:0:26212:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e1180 x1875729116525696/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.121706:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+19:73668:x1875729116525696:12345-192.168.203.30@tcp:101:dd.0 Request processed in 3856us (5715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.121715:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6038 00000100:00100000:0.0:1788838351.121969:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116526080 00000100:00100000:0.0:1788838351.121977:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116526080 00002000:00100000:0.0:1788838351.122015:0:24876:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x389:0x0] (0->1023) req@ffff8ff50f3e3100 x1875729116526080/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838351.122025:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f3e3100 with x1875729116526080 ext(0->1023) 00002000:00010000:0.0:1788838351.122030:0:24876:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f3e3100 00000100:00100000:0.0:1788838351.122063:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1028 00000100:00100000:0.0:1788838351.122080:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+19:2406:x1875729116526080:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:0.0:1788838351.122633:0:24876:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e3100 x1875729116526080/t4294969498(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.122685:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+21:2406:x1875729116526080:12345-192.168.203.30@tcp:4:dd.0 Request processed in 615us (6021us total) trans 4294969498 rc 0/0 00000100:00100000:0.0:1788838351.122693:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1028 00002000:00100000:0.0:1788838351.122700:0:24876:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x389:0x0] (0->1023) req@ffff8ff50f3e3100 x1875729116526080/t4294969498(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838351.122707:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f3e3100 with x1875729116526080 ext(0->1023) 00002000:00010000:0.0:1788838351.122711:0:24876:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f3e3100 00000100:00100000:0.0:1788838351.122737:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+119:73669:x1875729116525568:12345-192.168.203.30@tcp:101:dd.0 Request processed in 13191us (14136us total) trans 124554051705 rc 0/0 00000100:00100000:0.0:1788838351.122744:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1570 00000100:00100000:2.0:1788838351.122929:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+118:73666:x1875729116525312:12345-192.168.203.30@tcp:101:dd.0 Request processed in 7950us (10733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.122935:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1571 00000100:00100000:1.0:1788838351.131109:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.131221:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.131343:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116526592 00000100:00100000:2.0:1788838351.131353:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116526592 00000100:00100000:2.0:1788838351.131426:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1572 00000100:00100000:2.0:1788838351.131437:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+118:73669:x1875729116526592:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838351.131458:0:66255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838351.131480:0:66255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396cccac35 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d29c expref: -99 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.131515:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccac3c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.131532:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccac3c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.131544:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccac3c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.131668:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10800/0x88da08396cccac35 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d29c expref: 120 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.131695:0:66255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10400/0x88da08396cccac3c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d29c expref: 119 pid: 66255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.131703:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8ff61254c300) 00010000:00010000:2.0:1788838351.131707:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788838351.131711:0:66255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff503f10400, rc 0) 00000100:00100000:2.0:1788838351.131768:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+119:73669:x1875729116526592:12345-192.168.203.30@tcp:101:dd.0 Request processed in 333us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.131776:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1572 00000100:00100000:0.0:1788838351.132339:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116526464 00000100:00100000:0.0:1788838351.132346:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116526464 00000100:00100000:0.0:1788838351.132477:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 278 00000100:00100000:0.0:1788838351.132488:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+119:73665:x1875729116526464:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:0.0:1788838351.132745:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+120:73665:x1875729116526464:12345-192.168.203.30@tcp:35:dd.0 Request processed in 259us (1644us total) trans 124554051707 rc 0/0 00000100:00100000:0.0:1788838351.132753:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 278 00000100:00100000:3.0:1788838351.133239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.133390:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116526848 00000100:00100000:0.0:1788838351.133397:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116526848 00000100:00100000:0.0:1788838351.133439:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1573 00000100:00100000:0.0:1788838351.133448:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+120:73670:x1875729116526848:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.133461:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.133502:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396cccac43 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2a3 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133609:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133622:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133633:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133647:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccac51 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133665:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccac51 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133671:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccac51 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133717:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccac58 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133726:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccac58 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133732:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccac58 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838351.133741:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x15:0x0]: returning size 0 00010000:00010000:0.0:1788838351.133835:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133853:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133859:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133866:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133871:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6da00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.133876:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133884:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133897:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838351.133900:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.133904:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133911:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccac4a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133924:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccac51 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133930:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccac51 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.133934:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccac51 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.134085:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6c600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.134088:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccac51 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.134095:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccac51 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.134104:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff8ff604d0dc00) 00010000:00010000:0.0:1788838351.134107:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.134110:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccac51 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.134116:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccac51 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.134262:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396cccac43 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2a3 expref: 123 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.134279:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccac58 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2a3 expref: 122 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.134286:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8ff61254ca00) 00010000:00010000:0.0:1788838351.134289:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838351.134291:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6c200, rc 0) 00000100:00100000:0.0:1788838351.134370:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+122:73670:x1875729116526848:12345-192.168.203.30@tcp:101:dd.0 Request processed in 923us (1132us total) trans 124554051708 rc 0/0 00000100:00100000:0.0:1788838351.134385:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1573 00000100:00100000:3.0:1788838351.137224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.137320:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.137365:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.137447:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.137568:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116527232 00000100:00100000:0.0:1788838351.137589:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116527232 00000100:00100000:0.0:1788838351.137658:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6040 00000100:00100000:0.0:1788838351.137670:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+21:2405:x1875729116527232:12345-192.168.203.30@tcp:16:kworker.0 00010000:00000080:0.0:1788838351.137725:0:26218:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505766a00 x1875729116527232/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.137777:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+21:2405:x1875729116527232:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 109us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.137785:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6040 00000100:00100000:0.0:1788838351.137831:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116527488 00000100:00100000:0.0:1788838351.137835:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116527488 00000100:00100000:0.0:1788838351.137864:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1574 00000100:00100000:0.0:1788838351.137871:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+122:73666:x1875729116527488:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1788838351.137916:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838351.137952:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccabe8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d279 expref: 122 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.137970:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:0.0:1788838351.137976:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838351.138133:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.138146:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.138167:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838351.138210:0:75504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051709 00000004:00010000:0.0:1788838351.138241:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020967ed9 reply state 0000000093ccb465 transno 124554051710 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.138254:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.138260:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:0.0:1788838351.138263:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838351.138265:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838351.138317:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+124:73666:x1875729116527488:12345-192.168.203.30@tcp:36:dd.0 Request processed in 446us (870us total) trans 124554051710 rc 0/0 00000100:00100000:0.0:1788838351.138323:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1574 00000020:00080000:0.0:1788838351.138327:0:75504:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788838351.138642:0:24889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116527104 00000100:00100000:2.0:1788838351.138663:0:24889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116527104 00002000:00100000:2.0:1788838351.138695:0:24889:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x394:0x0] (0->1023) req@ffff8ff50f3e1f80 x1875729116527104/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788838351.138704:0:24889:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f3e1f80 with x1875729116527104 ext(0->1023) 00002000:00010000:2.0:1788838351.138708:0:24889:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f3e1f80 00000100:00100000:2.0:1788838351.138733:0:24889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116526976 00000100:00100000:2.0:1788838351.138736:0:24889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116526976 00002000:00010000:2.0:1788838351.138748:0:24889:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/911 (0->18446744073709551615) 00002000:00100000:2.0:1788838351.138752:0:24889:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505764700 with x1875729116526976 ext(0->18446744073709551615) 00002000:00010000:2.0:1788838351.138759:0:24889:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505764700. 00000100:00100000:2.0:1788838351.138774:0:24889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1029 00000100:00100000:2.0:1788838351.138782:0:24889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2405:x1875729116527104:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:2.0:1788838351.139115:0:24889:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e1f80 x1875729116527104/t4294969499(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.139170:0:24889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2405:x1875729116527104:12345-192.168.203.30@tcp:4:dd.0 Request processed in 388us (1954us total) trans 4294969499 rc 0/0 00000100:00100000:2.0:1788838351.139177:0:24889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1029 00002000:00100000:2.0:1788838351.139183:0:24889:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x394:0x0] (0->1023) req@ffff8ff50f3e1f80 x1875729116527104/t4294969499(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788838351.139190:0:24889:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f3e1f80 with x1875729116527104 ext(0->1023) 00002000:00010000:2.0:1788838351.139194:0:24889:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f3e1f80 00000100:00100000:2.0:1788838351.139208:0:24889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1030 00000100:00100000:2.0:1788838351.139215:0:24889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+23:2405:x1875729116526976:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:2.0:1788838351.139288:0:24889:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788838351.139291:0:24889:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:2.0:1788838351.139294:0:24889:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:2.0:1788838351.139296:0:24889:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:2.0:1788838351.139298:0:24889:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788838351.139305:0:24889:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505764700 x1875729116526976/t4294969500(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.139329:0:24889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2405:x1875729116526976:12345-192.168.203.30@tcp:10:dd.0 Request processed in 115us (2010us total) trans 4294969500 rc 0/0 00000100:00100000:2.0:1788838351.139337:0:24889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1030 00002000:00010000:2.0:1788838351.139340:0:24889:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/911 (0->18446744073709551615) 00002000:00100000:2.0:1788838351.139343:0:24889:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505764700 with x1875729116526976 ext(0->18446744073709551615) 00002000:00010000:2.0:1788838351.139348:0:24889:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505764700. 00000100:00100000:2.0:1788838351.140291:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.140677:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116527744 00000100:00100000:3.0:1788838351.140684:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116527744 00000100:00100000:3.0:1788838351.140737:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1575 00000100:00100000:3.0:1788838351.140747:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+124:73669:x1875729116527744:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:3.0:1788838351.140834:0:66255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788838351.140858:0:66255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6cc00/0x88da08396cccac12 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d287 expref: 124 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.140877:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8ff61254c300) 00010000:00010000:3.0:1788838351.140881:0:66255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788838351.141362:0:66255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838351.141492:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.141554:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116528000 00000100:00100000:0.0:1788838351.141560:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116528000 00000100:00100000:0.0:1788838351.141600:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1576 00000100:00100000:0.0:1788838351.141609:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+125:73671:x1875729116528000:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.141622:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.141634:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac74 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2aa expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141743:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141753:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141765:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141777:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccac82 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141824:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccac82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141833:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccac82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141876:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396cccac89 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141884:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396cccac89 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141891:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396cccac89 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838351.141899:0:67312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x16:0x0]: returning size 0 00010000:00010000:0.0:1788838351.141959:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141966:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141972:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141979:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.141985:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6dc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.141989:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142006:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142017:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838351.142019:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.142023:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142029:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccac7b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142042:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccac82 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142048:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccac82 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142054:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccac82 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142060:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.142062:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccac82 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142069:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccac82 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142076:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff8ff604d0d700) 00010000:00010000:0.0:1788838351.142079:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.142082:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccac82 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142099:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccac82 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142141:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccac74 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2aa expref: 128 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142549:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396cccac89 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2aa expref: 127 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.142558:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8ff61d841200) 00010000:00010000:0.0:1788838351.142560:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838351.142563:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6de00, rc 0) 00000100:00100000:0.0:1788838351.142625:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+127:73671:x1875729116528000:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1018us (1134us total) trans 124554051712 rc 0/0 00000100:00100000:0.0:1788838351.142633:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1576 00010000:00010000:3.0:1788838351.143038:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.143051:0:66255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788838351.143230:0:66255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051711 00000004:00010000:3.0:1788838351.143266:0:66255:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a701c965 reply state 0000000067f5b6e0 transno 124554051713 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.143293:0:66255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.143300:0:66255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8ff61254c300) 00010000:00010000:3.0:1788838351.143302:0:66255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788838351.143305:0:66255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788838351.143477:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63956bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+128:73669:x1875729116527744:12345-192.168.203.30@tcp:36:dd.0 Request processed in 2730us (3188us total) trans 124554051713 rc 0/0 00000100:00100000:3.0:1788838351.143485:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1575 00000020:00080000:3.0:1788838351.143489:0:66255:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788838351.148212:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.148272:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.148294:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.148315:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.148760:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116528256 00000100:00100000:2.0:1788838351.148771:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116528256 00000100:00100000:2.0:1788838351.148858:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116528384 00000100:00100000:2.0:1788838351.148862:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116528384 00000100:00100000:2.0:1788838351.148887:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6041 00000100:00100000:2.0:1788838351.148897:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+25:73666:x1875729116528256:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838351.148916:0:26208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838351.148949:0:26208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b50d7d6/0x88da08396cccac97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2b1 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838351.148976:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38d:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:2.0:1788838351.148999:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38d:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:2.0:1788838351.149004:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838351.149013:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b50d7d6/0x88da08396cccac97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2b1 expref: 26 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.149033:0:26208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b50d7d6/0x88da08396cccac97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2b1 expref: 26 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.149048:0:26208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718e400, rc 0) 00010000:00000080:2.0:1788838351.149056:0:26208:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61fc29f80 x1875729116528256/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.149130:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+26:73666:x1875729116528256:12345-192.168.203.30@tcp:101:dd.0 Request processed in 234us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.149137:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6041 00000100:00100000:2.0:1788838351.149168:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6042 00000100:00100000:2.0:1788838351.149184:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2405:x1875729116528384:12345-192.168.203.30@tcp:16:kworker.0 00010000:00000080:2.0:1788838351.149216:0:26208:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61fc29c00 x1875729116528384/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.149241:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2405:x1875729116528384:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 59us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.149247:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6042 00000100:00100000:3.0:1788838351.149878:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116528640 00000100:00100000:3.0:1788838351.149885:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116528640 00000100:00100000:3.0:1788838351.149974:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:3.0:1788838351.149984:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+128:73668:x1875729116528640:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:0.0:1788838351.150332:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.150360:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116528768 00000100:00100000:0.0:1788838351.150363:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116528768 00000100:00100000:0.0:1788838351.150405:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1577 00000100:00100000:0.0:1788838351.150413:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+129:73670:x1875729116528768:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.150424:0:75504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788838351.150440:0:75504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396cccac9e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2b8 expref: -99 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.150469:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccaca5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.150497:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccaca5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.150509:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccaca5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.150589:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d200/0x88da08396cccac9e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2b8 expref: 131 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.150604:0:75504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c600/0x88da08396cccaca5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2b8 expref: 130 pid: 75504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.150611:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8ff61254ca00) 00010000:00010000:0.0:1788838351.150614:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788838351.150617:0:75504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6c600, rc 0) 00000100:00100000:0.0:1788838351.150664:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+130:73670:x1875729116528768:12345-192.168.203.30@tcp:101:dd.0 Request processed in 251us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.150670:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1577 00000100:00100000:3.0:1788838351.151007:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+130:73668:x1875729116528640:12345-192.168.203.30@tcp:35:dd.0 Request processed in 1024us (2689us total) trans 124554051714 rc 0/0 00000100:00100000:3.0:1788838351.151014:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:3.0:1788838351.151043:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116528128 00000100:00100000:3.0:1788838351.151048:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116528128 00002000:00100000:3.0:1788838351.151075:0:25108:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x38b:0x0] (0->1023) req@ffff8ff6413f8c50 x1875729116528128/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838351.151086:0:25108:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff6413f8c50 with x1875729116528128 ext(0->1023) 00002000:00010000:3.0:1788838351.151090:0:25108:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff6413f8c50 00000100:00100000:3.0:1788838351.151298:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1031 00000100:00100000:3.0:1788838351.151308:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6413f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2405:x1875729116528128:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:3.0:1788838351.151760:0:24890:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff6413f8c50 x1875729116528128/t4294969501(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.151793:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6413f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+27:2405:x1875729116528128:12345-192.168.203.30@tcp:4:dd.0 Request processed in 487us (3590us total) trans 4294969501 rc 0/0 00000100:00100000:3.0:1788838351.151827:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1031 00002000:00100000:3.0:1788838351.151834:0:24890:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x38b:0x0] (0->1023) req@ffff8ff6413f8c50 x1875729116528128/t4294969501(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838351.151842:0:24890:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff6413f8c50 with x1875729116528128 ext(0->1023) 00002000:00010000:3.0:1788838351.151845:0:24890:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff6413f8c50 00000100:00100000:0.0:1788838351.156594:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.156640:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.156715:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116528896 00000100:00100000:3.0:1788838351.156727:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116528896 00000100:00100000:3.0:1788838351.156785:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6043 00000100:00100000:3.0:1788838351.156818:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+27:73669:x1875729116528896:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838351.156913:0:26210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838351.156936:0:26210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396cccacac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2bf expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838351.156976:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x390:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:3.0:1788838351.156998:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x390:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:3.0:1788838351.157002:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x390:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838351.157013:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396cccacac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2bf expref: 28 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.157031:0:26210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396cccacac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2bf expref: 28 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.157062:0:26210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712ce00, rc 0) 00010000:00000080:3.0:1788838351.157069:0:26210:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d55f80 x1875729116528896/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.157121:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+28:73669:x1875729116528896:12345-192.168.203.30@tcp:101:dd.0 Request processed in 327us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838351.157128:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6043 00000100:00100000:1.0:1788838351.157315:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116529024 00000100:00100000:1.0:1788838351.157329:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116529024 00002000:00010000:1.0:1788838351.157355:0:26090:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/909 (0->18446744073709551615) 00002000:00100000:1.0:1788838351.157360:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d56680 with x1875729116529024 ext(0->18446744073709551615) 00002000:00010000:1.0:1788838351.157367:0:26090:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d56680. 00000100:00100000:1.0:1788838351.157399:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1032 00000100:00100000:1.0:1788838351.157407:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+28:2406:x1875729116529024:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:1.0:1788838351.157536:0:26090:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788838351.157539:0:26090:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:1.0:1788838351.157542:0:26090:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:1.0:1788838351.157544:0:26090:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:1.0:1788838351.157547:0:26090:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788838351.157553:0:26090:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d56680 x1875729116529024/t4294969502(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.157582:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+29:2406:x1875729116529024:12345-192.168.203.30@tcp:10:dd.0 Request processed in 177us (942us total) trans 4294969502 rc 0/0 00000100:00100000:1.0:1788838351.157589:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1032 00002000:00010000:1.0:1788838351.157592:0:26090:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/909 (0->18446744073709551615) 00002000:00100000:1.0:1788838351.157595:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d56680 with x1875729116529024 ext(0->18446744073709551615) 00002000:00010000:1.0:1788838351.157600:0:26090:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d56680. 00000100:00100000:3.0:1788838351.162991:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.163130:0:24888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116529152 00000100:00100000:1.0:1788838351.163141:0:24888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116529152 00002000:00100000:1.0:1788838351.163197:0:24888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x38a:0x0] (0->1023) req@ffff8ff50f3e2300 x1875729116529152/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.163222:0:24888:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f3e2300 with x1875729116529152 ext(0->1023) 00002000:00010000:1.0:1788838351.163231:0:24888:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f3e2300 00000100:00100000:1.0:1788838351.163268:0:24888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1033 00000100:00100000:1.0:1788838351.163278:0:24888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+29:2405:x1875729116529152:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:1.0:1788838351.163947:0:24888:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e2300 x1875729116529152/t4294969503(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.164067:0:24888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+31:2405:x1875729116529152:12345-192.168.203.30@tcp:4:dd.0 Request processed in 790us (1084us total) trans 4294969503 rc 0/0 00000100:00100000:1.0:1788838351.164075:0:24888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1033 00002000:00100000:1.0:1788838351.164083:0:24888:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x38a:0x0] (0->1023) req@ffff8ff50f3e2300 x1875729116529152/t4294969503(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.164091:0:24888:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f3e2300 with x1875729116529152 ext(0->1023) 00002000:00010000:1.0:1788838351.164096:0:24888:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f3e2300 00000100:00100000:2.0:1788838351.166043:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.166087:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.166129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.166171:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.166597:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116529280 00000100:00100000:1.0:1788838351.166607:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116529280 00000100:00100000:1.0:1788838351.166672:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6044 00000100:00100000:1.0:1788838351.166683:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+31:2404:x1875729116529280:12345-192.168.203.30@tcp:16:kworker.0 00000001:00080000:1.0:1788838351.167005:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969503 is committed 00010000:00000080:1.0:1788838351.167058:0:26213:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637f8ce00 x1875729116529280/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.167451:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+21:2404:x1875729116529280:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 697us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.167460:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6044 00000100:00100000:0.0:1788838351.169270:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116529536 00000100:00100000:0.0:1788838351.169284:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116529536 00000100:00100000:0.0:1788838351.169361:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116529792 00000100:00100000:0.0:1788838351.169365:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116529792 00000100:00100000:0.0:1788838351.169559:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116529920 00000100:00100000:0.0:1788838351.169564:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116529920 00000100:00100000:0.0:1788838351.169595:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1578 00000100:00100000:0.0:1788838351.169605:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+132:73672:x1875729116529536:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1788838351.169646:0:76060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788838351.169662:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1579 00010000:00010000:0.0:1788838351.169683:0:76060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccacb3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2c6 expref: -99 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838351.169702:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+133:73671:x1875729116529792:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1788838351.169713:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838351.169725:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396cccacba lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2cd expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.169755:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccacc1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.169768:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccacc1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.169781:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccacc1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.169845:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.169856:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.169865:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.169880:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccaccf lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.169887:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccaccf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.169896:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396cccacba lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2cd expref: 135 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.169897:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccaccf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.169928:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712de00/0x88da08396cccacc1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2cd expref: 134 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.169944:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8ff61d841200) 00010000:00010000:3.0:1788838351.169947:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838351.169951:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712de00, rc 0) 00010000:00010000:0.0:1788838351.169972:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccacd6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.169982:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccacd6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.169989:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccacd6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788838351.169998:0:76060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x17:0x0]: returning size 0 00010000:00010000:0.0:1788838351.170086:0:76060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170095:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170101:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170117:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170124:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.170128:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170136:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170146:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:0.0:1788838351.170265:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.170270:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170277:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d400/0x88da08396cccacc8 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170288:0:76060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccaccf lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170294:0:76060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccaccf lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170299:0:76060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccaccf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170311:0:76060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6dc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838351.170314:0:76060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccaccf lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170330:0:76060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccaccf lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170338:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff8ff604d0d700) 00010000:00010000:0.0:1788838351.170341:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838351.170343:0:76060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccaccf lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170349:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccaccf lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170510:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c000/0x88da08396cccacb3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2c6 expref: 136 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170526:0:76060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccacd6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2c6 expref: 135 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170534:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:0.0:1788838351.170537:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788838351.170540:0:76060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6da00, rc 0) 00000100:00100000:0.0:1788838351.170602:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+135:73672:x1875729116529536:12345-192.168.203.30@tcp:101:dd.0 Request processed in 998us (4513us total) trans 124554051715 rc 0/0 00000100:00100000:0.0:1788838351.170610:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1578 00000100:00100000:0.0:1788838351.170633:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1580 00000100:00100000:0.0:1788838351.170659:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+134:73670:x1875729116529920:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1788838351.170688:0:76060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838351.170702:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccac58 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2a3 expref: 134 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170713:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8ff61254ca00) 00010000:00010000:0.0:1788838351.170716:0:76060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838351.170864:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170875:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.170882:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838351.170925:0:76060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051716 00000100:00100000:3.0:1788838351.171105:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+135:73671:x1875729116529792:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1430us (4973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838351.171113:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1579 00000004:00010000:0.0:1788838351.171259:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001357cb7e reply state 000000001425aa99 transno 124554051717 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.171273:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.171279:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8ff61254ca00) 00010000:00010000:0.0:1788838351.171282:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838351.171284:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838351.171466:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+135:73670:x1875729116529920:12345-192.168.203.30@tcp:36:dd.0 Request processed in 818us (5293us total) trans 124554051717 rc 0/0 00000100:00100000:0.0:1788838351.171472:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1580 00000020:00080000:0.0:1788838351.171476:0:76060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788838351.172119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.172176:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.172241:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116530304 00000100:00100000:1.0:1788838351.172250:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116530304 00000100:00100000:1.0:1788838351.172295:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 280 00000100:00100000:1.0:1788838351.172304:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+135:73666:x1875729116530304:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:1.0:1788838351.172522:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+136:73666:x1875729116530304:12345-192.168.203.30@tcp:35:dd.0 Request processed in 219us (345us total) trans 124554051718 rc 0/0 00000100:00100000:1.0:1788838351.172530:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 280 00000100:00100000:0.0:1788838351.172886:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116530048 00000100:00100000:0.0:1788838351.172891:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116530048 00002000:00010000:0.0:1788838351.172914:0:8466:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/912 (0->18446744073709551615) 00002000:00100000:0.0:1788838351.172918:0:8466:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f3e3100 with x1875729116530048 ext(0->18446744073709551615) 00002000:00010000:0.0:1788838351.172928:0:8466:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f3e3100. 00000100:00100000:0.0:1788838351.172957:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1034 00000100:00100000:0.0:1788838351.172965:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+21:2405:x1875729116530048:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:0.0:1788838351.173078:0:8466:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788838351.173082:0:8466:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:0.0:1788838351.173085:0:8466:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:0.0:1788838351.173088:0:8466:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:0.0:1788838351.173090:0:8466:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788838351.173099:0:8466:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e3100 x1875729116530048/t4294969504(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.173142:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2405:x1875729116530048:12345-192.168.203.30@tcp:10:dd.0 Request processed in 178us (1025us total) trans 4294969504 rc 0/0 00000100:00100000:0.0:1788838351.173158:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1034 00002000:00010000:0.0:1788838351.173161:0:8466:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/912 (0->18446744073709551615) 00002000:00100000:0.0:1788838351.173165:0:8466:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff50f3e3100 with x1875729116530048 ext(0->18446744073709551615) 00002000:00010000:0.0:1788838351.173169:0:8466:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff50f3e3100. 00000100:00100000:1.0:1788838351.178903:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.178963:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.179044:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116530560 00000100:00100000:3.0:1788838351.179055:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116530560 00000100:00100000:2.0:1788838351.179105:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116530432 00000100:00100000:2.0:1788838351.179111:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116530432 00000100:00100000:3.0:1788838351.179121:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1581 00000100:00100000:3.0:1788838351.179144:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+136:73672:x1875729116530560:12345-192.168.203.30@tcp:101:dd.0 00000100:00100000:2.0:1788838351.179164:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6045 00010000:00010000:3.0:1788838351.179170:0:67312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788838351.179175:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+22:73670:x1875729116530432:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838351.179186:0:26206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788838351.179192:0:67312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396cccaceb lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2db expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.179202:0:26206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396cccacf2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2d4 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.179226:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396cccacf9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838351.179226:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x391:0x0] initial LVB size: 0, mtime: 0x6a9f81c5, atime: 0x6a9f81c5, ctime: 0x6a9f81c5, blocks: 0x0 00010000:00010000:3.0:1788838351.179245:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396cccacf9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.179247:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x391:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:2.0:1788838351.179257:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788838351.179263:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396cccacf9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.179266:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396cccacf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2d4 expref: 23 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.179288:0:26206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396cccacf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2d4 expref: 23 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.179331:0:26206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718f400, rc 0) 00010000:00000080:2.0:1788838351.179340:0:26206:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff639c5df80 x1875729116530432/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788838351.179380:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712cc00/0x88da08396cccaceb lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2db expref: 138 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.179418:0:67312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712d200/0x88da08396cccacf9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2db expref: 137 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838351.179426:0:67312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:3.0:1788838351.179429:0:67312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788838351.179432:0:67312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d200, rc 0) 00000100:00100000:2.0:1788838351.179613:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+23:73670:x1875729116530432:12345-192.168.203.30@tcp:101:dd.0 Request processed in 440us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.179620:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6045 00000100:00100000:2.0:1788838351.183257:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+137:73672:x1875729116530560:12345-192.168.203.30@tcp:101:dd.0 Request processed in 4103us (4278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.183272:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1581 00000100:00100000:0.0:1788838351.186332:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.186715:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116530688 00000100:00100000:1.0:1788838351.186726:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116530688 00002000:00100000:1.0:1788838351.186776:0:24878:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x38c:0x0] (0->1023) req@ffff8ff637d54000 x1875729116530688/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.186788:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d54000 with x1875729116530688 ext(0->1023) 00002000:00010000:1.0:1788838351.186794:0:24878:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d54000 00000100:00100000:1.0:1788838351.186853:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1035 00000100:00100000:1.0:1788838351.186863:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+23:2404:x1875729116530688:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:1.0:1788838351.187277:0:24878:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d54000 x1875729116530688/t4294969505(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.187345:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2404:x1875729116530688:12345-192.168.203.30@tcp:4:dd.0 Request processed in 483us (1032us total) trans 4294969505 rc 0/0 00000100:00100000:1.0:1788838351.187353:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1035 00002000:00100000:1.0:1788838351.187361:0:24878:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x38c:0x0] (0->1023) req@ffff8ff637d54000 x1875729116530688/t4294969505(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.187370:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d54000 with x1875729116530688 ext(0->1023) 00002000:00010000:1.0:1788838351.187736:0:24878:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d54000 00000100:00100000:2.0:1788838351.189526:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.189568:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.189602:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.189606:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116530816 00000100:00100000:0.0:1788838351.189616:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116530816 00000100:00100000:2.0:1788838351.189625:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116531328 00000100:00100000:2.0:1788838351.189631:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116531328 00000100:00100000:0.0:1788838351.189681:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6046 00000100:00100000:2.0:1788838351.189684:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 281 00000100:00100000:0.0:1788838351.189698:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2404:x1875729116530816:12345-192.168.203.30@tcp:16:kworker.0 00000100:00100000:2.0:1788838351.189700:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+137:73669:x1875729116531328:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:2.0:1788838351.190055:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+138:73669:x1875729116531328:12345-192.168.203.30@tcp:35:dd.0 Request processed in 359us (450us total) trans 124554051719 rc 0/0 00000100:00100000:2.0:1788838351.190064:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 281 00000100:00100000:2.0:1788838351.190112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000001:00080000:1.0:1788838351.190119:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969505 is committed 00010000:00000080:1.0:1788838351.190286:0:26207:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637f8e300 x1875729116530816/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.190316:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2404:x1875729116530816:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 624us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.190455:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6046 00000100:00100000:1.0:1788838351.190478:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116531072 00000100:00100000:1.0:1788838351.190482:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116531072 00000100:00100000:1.0:1788838351.190515:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116531584 00000100:00100000:1.0:1788838351.190519:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116531584 00000100:00100000:1.0:1788838351.190540:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1582 00000100:00100000:1.0:1788838351.190547:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+139:73674:x1875729116531072:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838351.190558:0:66254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838351.190576:0:66254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccad00 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2e2 expref: -99 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190692:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190706:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190718:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190731:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccad0e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190736:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccad0e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190750:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccad0e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190815:0:66254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396cccad15 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190825:0:66254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396cccad15 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190831:0:66254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396cccad15 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788838351.190841:0:66254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x19:0x0]: returning size 0 00010000:00010000:1.0:1788838351.190897:0:66254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190905:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190911:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190919:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190926:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838351.190931:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.190938:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191034:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8ff60b5cf000) 00010000:00010000:1.0:1788838351.191037:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838351.191043:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191050:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8a00/0x88da08396cccad07 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191062:0:66254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccad0e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191069:0:66254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccad0e lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191075:0:66254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccad0e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191081:0:66254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8c00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:1.0:1788838351.191084:0:66254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccad0e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191090:0:66254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccad0e lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191098:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff8ff627601d00) 00010000:00010000:1.0:1788838351.191100:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788838351.191103:0:66254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccad0e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191109:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8c00/0x88da08396cccad0e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838351.191448:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1583 00000100:00100000:0.0:1788838351.191468:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+141:73671:x1875729116531584:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1788838351.191498:0:66253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838351.191521:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6de00/0x88da08396cccac89 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2aa expref: 141 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.191533:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8ff61d841200) 00010000:00010000:0.0:1788838351.191537:0:66253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838351.191628:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.191638:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.191646:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838351.191699:0:66253:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051721 00000004:00010000:0.0:1788838351.191719:0:66253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000209eed97 reply state 00000000a54fba53 transno 124554051722 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.191732:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.191738:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8ff61d841200) 00010000:00010000:0.0:1788838351.191741:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838351.191743:0:66253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838351.191817:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+143:73671:x1875729116531584:12345-192.168.203.30@tcp:36:dd.0 Request processed in 332us (1683us total) trans 124554051722 rc 0/0 00000100:00100000:0.0:1788838351.191824:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1583 00000020:00080000:0.0:1788838351.191829:0:66253:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788838351.191900:0:66254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9a00/0x88da08396cccad00 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2e2 expref: 143 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191915:0:66254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396cccad15 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2e2 expref: 142 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.191923:0:66254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8ff5037c5c00) 00010000:00010000:1.0:1788838351.191925:0:66254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788838351.191928:0:66254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e9000, rc 0) 00000100:00100000:1.0:1788838351.192016:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+142:73674:x1875729116531072:12345-192.168.203.30@tcp:101:dd.0 Request processed in 1468us (2446us total) trans 124554051720 rc 0/0 00000100:00100000:1.0:1788838351.192022:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1582 00000100:00100000:2.0:1788838351.193743:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.193846:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116531840 00000100:00100000:0.0:1788838351.193855:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116531840 00000100:00100000:0.0:1788838351.193911:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1584 00000100:00100000:0.0:1788838351.193920:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+142:73672:x1875729116531840:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1788838351.193999:0:76060:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838351.194022:0:76060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6da00/0x88da08396cccacd6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2c6 expref: 142 pid: 76060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.194040:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:0.0:1788838351.194044:0:76060:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788838351.194203:0:76060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.194216:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.194224:0:76060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788838351.194265:0:76060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051723 00000004:00010000:0.0:1788838351.194287:0:76060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4699378 reply state 000000001d196de8 transno 124554051724 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.194297:0:76060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838351.194304:0:76060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:0.0:1788838351.194306:0:76060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788838351.194309:0:76060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788838351.194614:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+144:73672:x1875729116531840:12345-192.168.203.30@tcp:36:dd.0 Request processed in 694us (876us total) trans 124554051724 rc 0/0 00000100:00100000:0.0:1788838351.194631:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1584 00000020:00080000:0.0:1788838351.194637:0:76060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788838351.197901:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.198039:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116531968 00000100:00100000:1.0:1788838351.198051:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116531968 00002000:00010000:1.0:1788838351.198094:0:8468:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/913 (0->18446744073709551615) 00002000:00100000:1.0:1788838351.198099:0:8468:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bc9b800 with x1875729116531968 ext(0->18446744073709551615) 00002000:00010000:1.0:1788838351.198112:0:8468:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff62bc9b800. 00000100:00100000:1.0:1788838351.198140:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1036 00000100:00100000:1.0:1788838351.198162:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2404:x1875729116531968:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:1.0:1788838351.198332:0:8468:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788838351.198336:0:8468:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb mtime from disk: 1788838341 -> 1788838351 00002000:00010000:1.0:1788838351.198339:0:8468:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb atime from disk: 1788838341 -> 1788838341 00002000:00010000:1.0:1788838351.198342:0:8468:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb ctime from disk: 1788838341 -> 1788838351 00002000:00010000:1.0:1788838351.198345:0:8468:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788838351.198354:0:8468:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc9b800 x1875729116531968/t4294969506(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.198512:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.198672:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+23:2404:x1875729116531968:12345-192.168.203.30@tcp:10:dd.0 Request processed in 522us (779us total) trans 4294969506 rc 0/0 00000100:00100000:1.0:1788838351.198680:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1036 00002000:00010000:1.0:1788838351.198684:0:8468:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/913 (0->18446744073709551615) 00002000:00100000:1.0:1788838351.198686:0:8468:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bc9b800 with x1875729116531968 ext(0->18446744073709551615) 00002000:00010000:1.0:1788838351.198691:0:8468:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff62bc9b800. 00000100:00100000:1.0:1788838351.198707:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116532096 00000100:00100000:1.0:1788838351.198710:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116532096 00002000:00100000:1.0:1788838351.198730:0:8468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x38e:0x0] (0->1023) req@ffff8ff637d55180 x1875729116532096/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.198739:0:8468:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d55180 with x1875729116532096 ext(0->1023) 00002000:00010000:1.0:1788838351.198743:0:8468:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d55180 00000100:00100000:1.0:1788838351.198769:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1037 00000100:00100000:1.0:1788838351.198777:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+23:2405:x1875729116532096:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:1.0:1788838351.199273:0:8468:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d55180 x1875729116532096/t4294969507(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.199305:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2405:x1875729116532096:12345-192.168.203.30@tcp:4:dd.0 Request processed in 530us (795us total) trans 4294969507 rc 0/0 00000100:00100000:1.0:1788838351.199313:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1037 00002000:00100000:1.0:1788838351.199319:0:8468:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x38e:0x0] (0->1023) req@ffff8ff637d55180 x1875729116532096/t4294969507(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.199327:0:8468:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d55180 with x1875729116532096 ext(0->1023) 00002000:00010000:1.0:1788838351.199331:0:8468:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d55180 00000100:00100000:2.0:1788838351.201619:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.201681:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116532224 00000100:00100000:1.0:1788838351.201690:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116532224 00000100:00100000:1.0:1788838351.201774:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6047 00000100:00100000:1.0:1788838351.201786:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2405:x1875729116532224:12345-192.168.203.30@tcp:16:kworker.0 00000100:00100000:2.0:1788838351.201937:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000001:00080000:3.0:1788838351.202371:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969507 is committed 00010000:00000080:1.0:1788838351.202457:0:26217:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc98000 x1875729116532224/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.202517:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2405:x1875729116532224:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 734us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.202526:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6047 00000100:00100000:2.0:1788838351.204760:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.204793:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116532352 00000100:00100000:2.0:1788838351.204815:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116532352 00000100:00100000:2.0:1788838351.204867:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1585 00000100:00100000:2.0:1788838351.204876:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+144:73674:x1875729116532352:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838351.204901:0:66253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838351.204923:0:66253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396cccad31 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2e9 expref: -99 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.205271:0:66253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396cccad38 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.205287:0:66253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396cccad38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.205298:0:66253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396cccad38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.205493:0:66253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718fc00/0x88da08396cccad31 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2e9 expref: 146 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.205512:0:66253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50718ee00/0x88da08396cccad38 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2e9 expref: 145 pid: 66253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.205520:0:66253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8ff5037c5c00) 00010000:00010000:2.0:1788838351.205523:0:66253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788838351.205527:0:66253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718ee00, rc 0) 00000100:00100000:2.0:1788838351.205579:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+145:73674:x1875729116532352:12345-192.168.203.30@tcp:101:dd.0 Request processed in 704us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.205596:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1585 00000100:00100000:0.0:1788838351.205761:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116532480 00000100:00100000:0.0:1788838351.205768:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116532480 00000100:00100000:3.0:1788838351.207882:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6048 00000100:00100000:2.0:1788838351.208049:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+22:73671:x1875729116532480:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1788838351.208069:0:26212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788838351.208089:0:26212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396cccad3f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2f0 expref: -99 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788838351.208124:0:26212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x392:0x0] initial LVB size: 0, mtime: 0x6a9f81c6, atime: 0x6a9f81c6, ctime: 0x6a9f81c6, blocks: 0x0 00010000:00010000:2.0:1788838351.208145:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x392:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:2.0:1788838351.208150:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x392:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788838351.208159:0:26212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396cccad3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2f0 expref: 23 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.208175:0:26212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396cccad3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2f0 expref: 23 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838351.208188:0:26212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718ec00, rc 0) 00010000:00000080:2.0:1788838351.208195:0:26212:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc98e00 x1875729116532480/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.208260:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+23:73671:x1875729116532480:12345-192.168.203.30@tcp:101:dd.0 Request processed in 367us (6323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.208266:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6048 00000100:00100000:3.0:1788838351.208703:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.208722:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.208750:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116532608 00000100:00100000:1.0:1788838351.208758:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116532608 00000100:00100000:1.0:1788838351.208828:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6049 00000100:00100000:1.0:1788838351.208837:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+23:73672:x1875729116532608:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838351.208848:0:8463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838351.208861:0:8463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002464858/0x88da08396cccad46 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2f7 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838351.208877:0:8463:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x393:0x0] initial LVB size: 0, mtime: 0x6a9f81c6, atime: 0x6a9f81c6, ctime: 0x6a9f81c6, blocks: 0x0 00010000:00010000:1.0:1788838351.208887:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x393:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:1.0:1788838351.208892:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x393:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838351.208898:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002464858/0x88da08396cccad46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2f7 expref: 24 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.208912:0:8463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002464858/0x88da08396cccad46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2f7 expref: 24 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788838351.208914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.208937:0:66257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116533120 00010000:00010000:1.0:1788838351.208969:0:8463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50a2e9c00, rc 0) 00010000:00000080:1.0:1788838351.208976:0:8463:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e2680 x1875729116532608/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.209006:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+24:73672:x1875729116532608:12345-192.168.203.30@tcp:101:dd.0 Request processed in 171us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.209013:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6049 00000100:00100000:1.0:1788838351.209036:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116532736 00000100:00100000:1.0:1788838351.209040:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116532736 00002000:00100000:1.0:1788838351.209064:0:24890:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x38f:0x0] (0->1023) req@ffff8ff505932300 x1875729116532736/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.209073:0:24890:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505932300 with x1875729116532736 ext(0->1023) 00002000:00010000:1.0:1788838351.209078:0:24890:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505932300 00000100:00100000:1.0:1788838351.209096:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1038 00000100:00100000:1.0:1788838351.209104:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2407:x1875729116532736:12345-192.168.203.30@tcp:4:dd.0 00000100:00100000:3.0:1788838351.209298:0:66257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116533120 00000100:00100000:3.0:1788838351.209341:0:66257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 282 00000100:00100000:3.0:1788838351.209351:0:66257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632ec3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+145:73670:x1875729116533120:12345-192.168.203.30@tcp:35:dd.0 00010000:00000080:1.0:1788838351.209472:0:24890:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505932300 x1875729116532736/t4294969508(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.209503:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2407:x1875729116532736:12345-192.168.203.30@tcp:4:dd.0 Request processed in 399us (784us total) trans 4294969508 rc 0/0 00000100:00100000:1.0:1788838351.209510:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1038 00002000:00100000:1.0:1788838351.209516:0:24890:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x38f:0x0] (0->1023) req@ffff8ff505932300 x1875729116532736/t4294969508(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.209524:0:24890:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff505932300 with x1875729116532736 ext(0->1023) 00002000:00010000:1.0:1788838351.209534:0:24890:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff505932300 00000100:00100000:1.0:1788838351.209724:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000001:00080000:3.0:1788838351.209839:0:66257:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051725 00000100:00100000:1.0:1788838351.210180:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116532864 00000100:00100000:1.0:1788838351.210185:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116532864 00000100:00100000:1.0:1788838351.210220:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6050 00000100:00100000:1.0:1788838351.210229:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff505932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2407:x1875729116532864:12345-192.168.203.30@tcp:16:kworker.0 00000001:00080000:2.0:1788838351.210512:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969508 is committed 00000100:00100000:3.0:1788838351.210846:0:66257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632ec3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+147:73670:x1875729116533120:12345-192.168.203.30@tcp:35:dd.0 Request processed in 1494us (2048us total) trans 124554051726 rc 0/0 00000100:00100000:3.0:1788838351.210855:0:66257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 282 00000020:00080000:3.0:1788838351.210859:0:66257:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00000080:1.0:1788838351.212364:0:8462:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff505932680 x1875729116532864/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.212431:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff505932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2407:x1875729116532864:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 2203us (2708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.212440:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6050 00000100:00100000:2.0:1788838351.213526:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.213835:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116533376 00000100:00100000:1.0:1788838351.213845:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116533376 00000100:00100000:1.0:1788838351.213899:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1586 00000100:00100000:1.0:1788838351.213910:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+147:73674:x1875729116533376:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:1.0:1788838351.214035:0:75504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788838351.214063:0:75504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9000/0x88da08396cccad15 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2e2 expref: 147 pid: 66254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.214094:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8ff5037c5c00) 00010000:00010000:1.0:1788838351.214099:0:75504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788838351.214266:0:75504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.214282:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.214294:0:75504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788838351.214346:0:75504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051727 00000004:00010000:1.0:1788838351.214371:0:75504:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa9af3ca reply state 000000007ac75fe6 transno 124554051728 ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.214385:0:75504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.214391:0:75504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8ff5037c5c00) 00010000:00010000:1.0:1788838351.214394:0:75504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788838351.214397:0:75504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788838351.214484:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+149:73674:x1875729116533376:12345-192.168.203.30@tcp:36:dd.0 Request processed in 576us (961us total) trans 124554051728 rc 0/0 00000100:00100000:1.0:1788838351.214491:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1586 00000020:00080000:1.0:1788838351.214496:0:75504:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788838351.222392:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.222642:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116533632 00000100:00100000:3.0:1788838351.222663:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116533632 00002000:00100000:3.0:1788838351.222717:0:24879:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x38d:0x0] (0->1023) req@ffff8ff62bc9a300 x1875729116533632/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838351.222728:0:24879:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bc9a300 with x1875729116533632 ext(0->1023) 00002000:00010000:3.0:1788838351.222733:0:24879:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff62bc9a300 00000100:00100000:3.0:1788838351.222776:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1039 00000100:00100000:3.0:1788838351.222787:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2407:x1875729116533632:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:3.0:1788838351.223212:0:24879:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc9a300 x1875729116533632/t4294969509(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.223281:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2407:x1875729116533632:12345-192.168.203.30@tcp:4:dd.0 Request processed in 496us (907us total) trans 4294969509 rc 0/0 00000100:00100000:3.0:1788838351.223290:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1039 00002000:00100000:3.0:1788838351.223297:0:24879:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x38d:0x0] (0->1023) req@ffff8ff62bc9a300 x1875729116533632/t4294969509(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788838351.223304:0:24879:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bc9a300 with x1875729116533632 ext(0->1023) 00002000:00010000:3.0:1788838351.223308:0:24879:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff62bc9a300 00000100:00100000:0.0:1788838351.223357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.223474:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.223494:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116533760 00000100:00100000:0.0:1788838351.223498:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116533760 00000100:00100000:0.0:1788838351.223528:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6051 00000100:00100000:0.0:1788838351.223535:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2406:x1875729116533760:12345-192.168.203.30@tcp:16:kworker.0 00000100:00100000:3.0:1788838351.223627:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116533504 00000100:00100000:3.0:1788838351.223632:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116533504 00002000:00010000:3.0:1788838351.223660:0:8467:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/914 (0->18446744073709551615) 00002000:00100000:3.0:1788838351.223664:0:8467:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d54700 with x1875729116533504 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838351.223675:0:8467:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d54700. 00000100:00100000:3.0:1788838351.223699:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1040 00000100:00100000:3.0:1788838351.223708:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+27:2405:x1875729116533504:12345-192.168.203.30@tcp:10:dd.0 00000001:00080000:0.0:1788838351.223772:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969509 is committed 00002000:00010000:3.0:1788838351.223826:0:8467:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb size from disk: 0 -> 0 00010000:00000080:0.0:1788838351.223830:0:26215:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d54a80 x1875729116533760/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00002000:00010000:3.0:1788838351.223831:0:8467:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb mtime from disk: 1788838342 -> 1788838351 00002000:00010000:3.0:1788838351.223837:0:8467:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb atime from disk: 1788838342 -> 1788838342 00002000:00010000:3.0:1788838351.223843:0:8467:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb ctime from disk: 1788838342 -> 1788838351 00002000:00010000:3.0:1788838351.223848:0:8467:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788838351.223857:0:8467:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d54700 x1875729116533504/t4294969510(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.223874:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2406:x1875729116533760:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 338us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.223882:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6051 00000100:00100000:3.0:1788838351.223898:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2405:x1875729116533504:12345-192.168.203.30@tcp:10:dd.0 Request processed in 190us (540us total) trans 4294969510 rc 0/0 00000100:00100000:3.0:1788838351.223906:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1040 00002000:00010000:3.0:1788838351.223910:0:8467:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/914 (0->18446744073709551615) 00002000:00100000:3.0:1788838351.223914:0:8467:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff637d54700 with x1875729116533504 ext(0->18446744073709551615) 00002000:00010000:3.0:1788838351.223919:0:8467:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff637d54700. 00000100:00100000:0.0:1788838351.223929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.223990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.224072:0:24888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116534016 00000100:00100000:1.0:1788838351.224077:0:24888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116534016 00002000:00010000:1.0:1788838351.224095:0:24888:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/915 (0->18446744073709551615) 00002000:00100000:1.0:1788838351.224099:0:24888:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff639543100 with x1875729116534016 ext(0->18446744073709551615) 00002000:00010000:1.0:1788838351.224105:0:24888:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff639543100. 00000100:00100000:1.0:1788838351.224138:0:24888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1041 00000100:00100000:1.0:1788838351.224146:0:24888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2406:x1875729116534016:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:1.0:1788838351.224210:0:24888:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788838351.224214:0:24888:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb mtime from disk: 1788838342 -> 1788838351 00002000:00010000:1.0:1788838351.224216:0:24888:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb atime from disk: 1788838342 -> 1788838342 00002000:00010000:1.0:1788838351.224218:0:24888:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb ctime from disk: 1788838342 -> 1788838351 00002000:00010000:1.0:1788838351.224220:0:24888:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788838351.224226:0:24888:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff639543100 x1875729116534016/t4294969511(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.224262:0:24888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2406:x1875729116534016:12345-192.168.203.30@tcp:10:dd.0 Request processed in 117us (271us total) trans 4294969511 rc 0/0 00000100:00100000:1.0:1788838351.224270:0:24888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1041 00002000:00010000:1.0:1788838351.224273:0:24888:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/915 (0->18446744073709551615) 00002000:00100000:1.0:1788838351.224276:0:24888:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff639543100 with x1875729116534016 ext(0->18446744073709551615) 00002000:00010000:1.0:1788838351.224282:0:24888:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff639543100. 00000100:00100000:1.0:1788838351.224308:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116533888 00000100:00100000:1.0:1788838351.224312:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116533888 00000100:00100000:1.0:1788838351.224348:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6052 00000100:00100000:1.0:1788838351.224356:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:efc561ba-875e-4857-b79b-9bd7023bd57c+26:73674:x1875729116533888:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1788838351.224367:0:26211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788838351.224385:0:26211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a37da02/0x88da08396cccad54 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d2fe expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788838351.224403:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x395:0x0] initial LVB size: 0, mtime: 0x6a9f81c6, atime: 0x6a9f81c6, ctime: 0x6a9f81c6, blocks: 0x0 00010000:00010000:1.0:1788838351.224420:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x395:0x0].0x0 since=3745s v=(0 0) 00010000:00010000:1.0:1788838351.224425:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x395:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788838351.224433:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a37da02/0x88da08396cccad54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2fe expref: 27 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.224449:0:26211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a37da02/0x88da08396cccad54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2fe expref: 27 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838351.224462:0:26211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff6421c7400, rc 0) 00010000:00000080:1.0:1788838351.224468:0:26211:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff637d56a00 x1875729116533888/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 328/400 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.224513:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:efc561ba-875e-4857-b79b-9bd7023bd57c+27:73674:x1875729116533888:12345-192.168.203.30@tcp:101:dd.0 Request processed in 158us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.224520:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6052 00000100:00100000:2.0:1788838351.231072:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.233776:0:66256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116534272 00000100:00100000:1.0:1788838351.233791:0:66256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116534272 00000100:00100000:1.0:1788838351.235360:0:66256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:1.0:1788838351.235375:0:66256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+149:73672:x1875729116534272:12345-192.168.203.30@tcp:35:dd.0 00000001:00080000:1.0:1788838351.235628:0:66256:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051729 00000100:00100000:1.0:1788838351.235761:0:66256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+151:73672:x1875729116534272:12345-192.168.203.30@tcp:35:dd.0 Request processed in 388us (4699us total) trans 124554051730 rc 0/0 00000100:00100000:1.0:1788838351.235769:0:66256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:2.0:1788838351.235776:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000020:00080000:1.0:1788838351.235777:0:66256:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788838351.235893:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.235954:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.235973:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116534784 00000100:00100000:0.0:1788838351.235980:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116534784 00000100:00100000:0.0:1788838351.236010:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6053 00000100:00100000:0.0:1788838351.236017:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+27:2404:x1875729116534784:12345-192.168.203.30@tcp:16:kworker.0 00010000:00000080:0.0:1788838351.236049:0:26216:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc98a80 x1875729116534784/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.236095:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:efc561ba-875e-4857-b79b-9bd7023bd57c+27:2404:x1875729116534784:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838351.236102:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6053 00000100:00100000:0.0:1788838351.236121:0:24889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116534656 00000100:00100000:0.0:1788838351.236125:0:24889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116534656 00002000:00100000:0.0:1788838351.236144:0:24889:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x390:0x0] (0->1023) req@ffff8ff639541f80 x1875729116534656/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838351.236221:0:24889:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff639541f80 with x1875729116534656 ext(0->1023) 00002000:00010000:0.0:1788838351.236226:0:24889:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff639541f80 00000100:00100000:0.0:1788838351.236248:0:24889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1042 00000100:00100000:0.0:1788838351.236255:0:24889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+27:2404:x1875729116534656:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:0.0:1788838351.236793:0:24889:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff639541f80 x1875729116534656/t4294969512(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.236844:0:24889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+29:2404:x1875729116534656:12345-192.168.203.30@tcp:4:dd.0 Request processed in 589us (890us total) trans 4294969512 rc 0/0 00000100:00100000:0.0:1788838351.236854:0:24889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1042 00002000:00100000:0.0:1788838351.236861:0:24889:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x390:0x0] (0->1023) req@ffff8ff639541f80 x1875729116534656/t4294969512(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838351.236871:0:24889:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff639541f80 with x1875729116534656 ext(0->1023) 00002000:00010000:0.0:1788838351.236875:0:24889:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff639541f80 00000100:00100000:0.0:1788838351.245201:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.245239:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116535040 00000100:00100000:0.0:1788838351.245250:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116535040 00002000:00100000:0.0:1788838351.245300:0:25108:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x391:0x0] (0->1023) req@ffff8ff639540380 x1875729116535040/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838351.245326:0:25108:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff639540380 with x1875729116535040 ext(0->1023) 00002000:00010000:0.0:1788838351.245333:0:25108:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff639540380 00000100:00100000:0.0:1788838351.245364:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1043 00000100:00100000:0.0:1788838351.245373:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+29:2407:x1875729116535040:12345-192.168.203.30@tcp:4:dd.0 00000100:00100000:2.0:1788838351.245413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.245444:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00000080:0.0:1788838351.245791:0:25108:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff639540380 x1875729116535040/t4294969513(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.245881:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+31:2407:x1875729116535040:12345-192.168.203.30@tcp:4:dd.0 Request processed in 510us (691us total) trans 4294969513 rc 0/0 00000100:00100000:0.0:1788838351.245889:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1043 00002000:00100000:0.0:1788838351.245896:0:25108:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x391:0x0] (0->1023) req@ffff8ff639540380 x1875729116535040/t4294969513(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838351.245917:0:25108:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff639540380 with x1875729116535040 ext(0->1023) 00002000:00010000:0.0:1788838351.245921:0:25108:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff639540380 00000100:00100000:0.0:1788838351.245939:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116534912 00000100:00100000:0.0:1788838351.245942:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116534912 00002000:00010000:0.0:1788838351.246163:0:25108:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/917 (0->18446744073709551615) 00002000:00100000:0.0:1788838351.246167:0:25108:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bc99880 with x1875729116534912 ext(0->18446744073709551615) 00002000:00010000:0.0:1788838351.246177:0:25108:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff62bc99880. 00000100:00100000:0.0:1788838351.246199:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1044 00000100:00100000:0.0:1788838351.246208:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+31:2405:x1875729116534912:12345-192.168.203.30@tcp:10:dd.0 00002000:00010000:0.0:1788838351.246284:0:25108:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788838351.246288:0:25108:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb mtime from disk: 1788838342 -> 1788838352 00002000:00010000:0.0:1788838351.246290:0:25108:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb atime from disk: 1788838342 -> 1788838342 00002000:00010000:0.0:1788838351.246301:0:25108:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb ctime from disk: 1788838342 -> 1788838352 00002000:00010000:0.0:1788838351.246303:0:25108:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788838351.246310:0:25108:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc99880 x1875729116534912/t4294969514(0) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.246336:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+32:2405:x1875729116534912:12345-192.168.203.30@tcp:10:dd.0 Request processed in 130us (926us total) trans 4294969514 rc 0/0 00000100:00100000:0.0:1788838351.246342:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1044 00002000:00010000:0.0:1788838351.246345:0:25108:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/917 (0->18446744073709551615) 00002000:00100000:0.0:1788838351.246348:0:25108:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bc99880 with x1875729116534912 ext(0->18446744073709551615) 00002000:00010000:0.0:1788838351.246352:0:25108:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff62bc99880. 00000100:00100000:3.0:1788838351.248213:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116534528 00000100:00100000:3.0:1788838351.248229:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116534528 00000100:00100000:3.0:1788838351.248290:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 284 00000100:00100000:3.0:1788838351.248301:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+151:73671:x1875729116534528:12345-192.168.203.30@tcp:35:dd.0 00000001:00080000:3.0:1788838351.248672:0:85392:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051731 00000100:00100000:3.0:1788838351.248790:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+153:73671:x1875729116534528:12345-192.168.203.30@tcp:35:dd.0 Request processed in 489us (12893us total) trans 124554051732 rc 0/0 00000100:00100000:3.0:1788838351.248823:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 284 00000020:00080000:3.0:1788838351.248828:0:85392:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788838351.249763:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838351.249794:0:85392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116535424 00000100:00100000:3.0:1788838351.249829:0:85392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116535424 00000100:00100000:3.0:1788838351.249866:0:85392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 285 00000100:00100000:3.0:1788838351.249874:0:85392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+153:73674:x1875729116535424:12345-192.168.203.30@tcp:35:dd.0 00000100:00100000:1.0:1788838351.250087:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116535168 00000100:00100000:1.0:1788838351.250093:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116535168 00000100:00100000:1.0:1788838351.250124:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6054 00000100:00100000:1.0:1788838351.250131:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+32:2407:x1875729116535168:12345-192.168.203.30@tcp:16:kworker.0 00000001:00080000:1.0:1788838351.250378:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969514 is committed 00010000:00000080:1.0:1788838351.250439:0:26213:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc99c00 x1875729116535168/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.250483:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2407:x1875729116535168:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 351us (5038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838351.250491:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6054 00000100:00100000:3.0:1788838351.250860:0:85392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+154:73674:x1875729116535424:12345-192.168.203.30@tcp:35:dd.0 Request processed in 986us (1100us total) trans 124554051733 rc 0/0 00000100:00100000:3.0:1788838351.250867:0:85392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 285 00000100:00100000:0.0:1788838351.254492:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.254571:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116535680 00000100:00100000:2.0:1788838351.254582:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116535680 00000100:00100000:2.0:1788838351.254646:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6055 00000100:00100000:2.0:1788838351.254667:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2404:x1875729116535680:12345-192.168.203.30@tcp:16:kworker.0 00010000:00000080:2.0:1788838351.254727:0:26206:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61d2aea00 x1875729116535680/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.254815:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2404:x1875729116535680:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.254824:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6055 00000100:00100000:0.0:1788838351.262273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.262329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.262444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838351.262520:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116535552 00000100:00100000:1.0:1788838351.262530:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116535552 00002000:00100000:1.0:1788838351.262580:0:26090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x392:0x0] (0->1023) req@ffff8ff61d2aca80 x1875729116535552/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.262600:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff61d2aca80 with x1875729116535552 ext(0->1023) 00002000:00010000:1.0:1788838351.262606:0:26090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff61d2aca80 00000100:00100000:1.0:1788838351.262636:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116535808 00000100:00100000:1.0:1788838351.262639:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116535808 00002000:00100000:1.0:1788838351.262668:0:26090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x393:0x0] (0->1023) req@ffff8ff61d2adc00 x1875729116535808/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.262677:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff61d2adc00 with x1875729116535808 ext(0->1023) 00002000:00010000:1.0:1788838351.262681:0:26090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff61d2adc00 00000100:00100000:1.0:1788838351.262700:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1045 00000100:00100000:1.0:1788838351.262710:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2404:x1875729116535552:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:1.0:1788838351.263100:0:26090:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61d2aca80 x1875729116535552/t4294969515(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.263168:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+28:2404:x1875729116535552:12345-192.168.203.30@tcp:4:dd.0 Request processed in 459us (906us total) trans 4294969515 rc 0/0 00000100:00100000:1.0:1788838351.263177:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1045 00002000:00100000:1.0:1788838351.263184:0:26090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x392:0x0] (0->1023) req@ffff8ff61d2aca80 x1875729116535552/t4294969515(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.263192:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff61d2aca80 with x1875729116535552 ext(0->1023) 00002000:00010000:1.0:1788838351.263196:0:26090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff61d2aca80 00000100:00100000:1.0:1788838351.263215:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1046 00000100:00100000:1.0:1788838351.263223:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+27:2406:x1875729116535808:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:1.0:1788838351.263361:0:26090:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61d2adc00 x1875729116535808/t4294969516(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838351.263395:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+29:2406:x1875729116535808:12345-192.168.203.30@tcp:4:dd.0 Request processed in 173us (951us total) trans 4294969516 rc 0/0 00000100:00100000:1.0:1788838351.263402:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1046 00002000:00100000:1.0:1788838351.263408:0:26090:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x393:0x0] (0->1023) req@ffff8ff61d2adc00 x1875729116535808/t4294969516(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788838351.263415:0:26090:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff61d2adc00 with x1875729116535808 ext(0->1023) 00002000:00010000:1.0:1788838351.263418:0:26090:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff61d2adc00 00000100:00100000:3.0:1788838351.264517:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116535936 00000100:00100000:3.0:1788838351.264527:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116535936 00000100:00100000:3.0:1788838351.264962:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6056 00000100:00100000:3.0:1788838351.264974:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+29:2407:x1875729116535936:12345-192.168.203.30@tcp:16:kworker.0 00000001:00080000:1.0:1788838351.265471:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969516 is committed 00010000:00000080:3.0:1788838351.265572:0:20253:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff61d2ac700 x1875729116535936/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838351.265644:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2407:x1875729116535936:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 673us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838351.265661:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6056 00000100:00100000:2.0:1788838351.271013:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838351.271207:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116536064 00000100:00100000:0.0:1788838351.271218:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116536064 00002000:00100000:0.0:1788838351.271272:0:24878:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x395:0x0] (0->1023) req@ffff8ff62bc99180 x1875729116536064/t0(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/0 e 0 to 0 dl 1788838362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838351.271283:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bc99180 with x1875729116536064 ext(0->1023) 00002000:00010000:0.0:1788838351.271289:0:24878:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff62bc99180 00000100:00100000:3.0:1788838351.271774:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838351.271874:0:26217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116536192 00000100:00100000:2.0:1788838351.271879:0:26217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116536192 00000100:00100000:2.0:1788838351.271924:0:26217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6057 00000100:00100000:2.0:1788838351.271934:0:26217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2407:x1875729116536192:12345-192.168.203.30@tcp:16:kworker.0 00010000:00000080:2.0:1788838351.271978:0:26217:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e1f80 x1875729116536192/t0(0) o16->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 440/432 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838351.272038:0:26217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2407:x1875729116536192:12345-192.168.203.30@tcp:16:kworker.0 Request processed in 105us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838351.272046:0:26217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6057 00000100:00100000:0.0:1788838351.272282:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1047 00000100:00100000:0.0:1788838351.272292:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2407:x1875729116536064:12345-192.168.203.30@tcp:4:dd.0 00010000:00000080:0.0:1788838351.272702:0:24878:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff62bc99180 x1875729116536064/t4294969517(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838351.272738:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+27:2407:x1875729116536064:12345-192.168.203.30@tcp:4:dd.0 Request processed in 449us (1736us total) trans 4294969517 rc 0/0 00000100:00100000:0.0:1788838351.272753:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1047 00002000:00100000:0.0:1788838351.272761:0:24878:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x395:0x0] (0->1023) req@ffff8ff62bc99180 x1875729116536064/t4294969517(0) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:252/0 lens 1512/448 e 0 to 0 dl 1788838362 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788838351.272770:0:24878:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ff62bc99180 with x1875729116536064 ext(0->1023) 00002000:00010000:0.0:1788838351.272775:0:24878:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ff62bc99180 00010000:00010000:0.0:1788838351.935404:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838352.768043:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135210368:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.768117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838352.768156:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135210496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838352.768184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838352.768200:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135211136:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.768225:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838352.768241:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135211648:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.768264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838352.768276:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135210880:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.768279:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135212160:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.768297:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838352.768320:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788838352.768325:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135211008:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.768347:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838352.768364:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135211520:0@lo:400:kworker.0 00000100:00100000:2.0:1788838352.768386:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838352.768386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838352.768404:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135212032:0@lo:400:kworker.0 00000100:00100000:2.0:1788838352.768408:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135211392:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.768422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838352.768438:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135210496 00000100:00100000:2.0:1788838352.768445:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135210496 00000100:00100000:0.0:1788838352.768471:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135210368 00000100:00100000:0.0:1788838352.768475:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135210368 00000100:00100000:2.0:1788838352.768488:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4283 00000100:00100000:2.0:1788838352.768496:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135210496:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838352.768499:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788838352.768503:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135210368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.768546:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3646:x1875729135210368:12345-0@lo:400:kworker.0 Request processed in 41us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.768553:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788838352.768585:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135211136 00000100:00100000:0.0:1788838352.768588:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135211136 00000004:00000024:2.0:1788838352.768604:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00000100:00100000:0.0:1788838352.768621:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135211648 00000100:00100000:0.0:1788838352.768624:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135211648 00000100:00100000:0.0:1788838352.768635:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135212160 00000100:00100000:2.0:1788838352.768649:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135210496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.768650:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135212160 00000100:00100000:2.0:1788838352.768655:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4283 00000100:00100000:0.0:1788838352.768660:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135211008 00000100:00100000:0.0:1788838352.768663:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135211008 00000100:00100000:2.0:1788838352.768673:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135210880 00000100:00100000:2.0:1788838352.768676:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135210880 00000100:00100000:0.0:1788838352.768677:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:0.0:1788838352.768682:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135211136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838352.768690:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:2.0:1788838352.768695:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135211648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.768712:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135211136:12345-0@lo:400:kworker.0 Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838352.768717:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135211648:12345-0@lo:400:kworker.0 Request processed in 23us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.768719:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1788838352.768722:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1788838352.768731:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1788838352.768736:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135212160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.768820:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875729135212160:12345-0@lo:400:kworker.0 Request processed in 58us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838352.773665:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1788838352.773693:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135211008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838352.774469:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135211008:12345-0@lo:400:kworker.0 Request processed in 787us (6117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838352.774480:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1788838352.774494:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1788838352.774515:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1788838352.775447:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135210880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838352.775512:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135210880:12345-0@lo:400:kworker.0 Request processed in 991us (7126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838352.777093:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135210752:0@lo:400:kworker.0 00000100:00100000:1.0:1788838352.777165:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838352.777199:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135210624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838352.777227:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838352.777254:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135211264:0@lo:400:kworker.0 00000100:00100000:1.0:1788838352.777278:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838352.777299:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135211776:0@lo:400:kworker.0 00000100:00100000:1.0:1788838352.777327:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838352.777370:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135210752 00000100:00100000:1.0:1788838352.777379:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135210752 00000100:00100000:0.0:1788838352.778490:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135211520 00000100:00100000:0.0:1788838352.778499:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135211520 00000100:00100000:0.0:1788838352.778545:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135212032 00000100:00100000:0.0:1788838352.778549:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135212032 00000100:00100000:0.0:1788838352.778579:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:0.0:1788838352.778587:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135211520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.778668:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135211520:12345-0@lo:400:kworker.0 Request processed in 82us (10280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.778676:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00100000:0.0:1788838352.778692:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:0.0:1788838352.778699:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135212032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.778727:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135212032:12345-0@lo:400:kworker.0 Request processed in 29us (10303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.778732:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000100:00100000:0.0:1788838352.778778:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135211008:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.778790:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135211520:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.778819:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135212032:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.778831:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57943c9a-ca27-46d8-8845-5d2bce640e45:3646:1875729135210368:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.778848:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135210496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838352.778860:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135211136:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.778871:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135211648:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.778881:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875729135212160:0@lo:400:kworker.0 00000100:00080000:0.0:1788838352.778926:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788838352.778930:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788838352.778933:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838352.778959:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135210624 00000100:00100000:0.0:1788838352.778963:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135210624 00000100:00100000:0.0:1788838352.778989:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135211264 00000100:00100000:0.0:1788838352.778993:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135211264 00000100:00100000:0.0:1788838352.779002:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135211776 00000100:00100000:0.0:1788838352.779004:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135211776 00000100:00100000:0.0:1788838352.779015:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4284 00000100:00100000:0.0:1788838352.779021:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135210624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788838352.779045:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:0.0:1788838352.779082:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135210624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.779088:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4284 00000100:00100000:0.0:1788838352.779100:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4285 00000100:00100000:0.0:1788838352.779106:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640735500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135211264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.779134:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640735500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135211264:12345-0@lo:400:kworker.0 Request processed in 28us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.779140:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4285 00000100:00100000:0.0:1788838352.779150:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4286 00000100:00100000:0.0:1788838352.779156:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135211776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.779181:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135211776:12345-0@lo:400:kworker.0 Request processed in 25us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.779186:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4286 00000100:00100000:0.0:1788838352.779220:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135210624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838352.779231:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135211264:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.779238:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135211776:0@lo:400:kworker.0 00000100:00100000:3.0:1788838352.783964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838352.784036:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135211904:0@lo:400:kworker.0 00000100:00100000:3.0:1788838352.784093:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838352.784145:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135210880:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.785979:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135211392 00000100:00100000:0.0:1788838352.785993:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135211392 00000100:00100000:0.0:1788838352.786076:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135211904 00000100:00100000:0.0:1788838352.786080:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135211904 00000100:00100000:0.0:1788838352.786104:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:0.0:1788838352.786113:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135211392:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838352.786140:0:8460:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e3b80 x1875729135211392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:253/0 lens 224/224 e 0 to 0 dl 1788838363 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838352.786211:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135211392:12345-0@lo:400:kworker.0 Request processed in 99us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.786218:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:0.0:1788838352.786235:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751 00000100:00100000:0.0:1788838352.786241:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135211904:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788838352.786252:0:8460:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8ff50f3e3800 x1875729135211904/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:253/0 lens 224/224 e 0 to 0 dl 1788838363 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838352.786280:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135211904:12345-0@lo:400:kworker.0 Request processed in 39us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.786286:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751 00000100:00080000:0.0:1788838352.786309:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788838352.786907:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:0.0:1788838352.787736:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135211392:0@lo:400:kworker.0 00000100:00100000:0.0:1788838352.787755:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135211904:0@lo:400:kworker.0 00000100:00100000:1.0:1788838352.791999:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:1.0:1788838352.792021:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135210752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838352.792115:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135210752:12345-0@lo:400:kworker.0 Request processed in 106us (14950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838352.792123:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:3.0:1788838352.792307:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135210752:0@lo:400:kworker.0 00000020:01000004:2.0:1788838352.914028:0:96023:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788838352.914083:0:96023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838352.914099:0:96023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838352.914107:0:96023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838352.914115:0:96023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838352.914134:0:96023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788838352.914140:0:96023:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788838352.914167:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788838352.914173:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838352.914182:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d600 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:2.0:1788838352.914185:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838352.914195:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788838352.914202:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788838352.914219:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788838352.914222:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788838352.914225:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788838352.914259:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838352.914266:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788838352.914287:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838352.914294:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d600/0x88da08396ccca375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccca37c expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838352.914305:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838352.914307:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838352.914309:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838352.914338:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135212288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788838352.914402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838352.914460:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135212288 00000100:00100000:2.0:1788838352.914467:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135212288 00000100:00100000:2.0:1788838352.914508:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1788838352.914516:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135212288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788838352.914528:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788838352.914542:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601528a00/0x88da08396ccca37c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccca375 expref: 24 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838352.914555:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788838352.914587:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3643:x1875729135212288:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838352.914600:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1788838352.914635:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135212288:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788838352.914671:0:96023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788838352.914676:0:96023:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788838352.914681:0:96023:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788838352.914694:0:96023:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788838352.914828:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135212416:0@lo:39:umount.0 00000100:00100000:3.0:1788838352.914864:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838352.914935:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135212416 00000100:00100000:2.0:1788838352.914940:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135212416 00000100:00100000:2.0:1788838352.914993:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:2.0:1788838352.915002:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875729135212416:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788838352.915023:0:66255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9fa1 00000100:00080000:2.0:1788838352.915037:0:66255:0:(import.c:65:import_set_state_nolock()) ffff8ff639653000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788838352.915082:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+1:3642:x1875729135212416:12345-0@lo:39:umount.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838352.915088:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000020:00000080:2.0:1788838352.915094:0:66255:0:(genops.c:885:class_export_put()) final put ffff8ff627f2d800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1788838352.915175:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838352.915195:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788838352.915211:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135212416:0@lo:39:umount.0 00000100:00080000:2.0:1788838352.915256:0:96023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788838352.915259:0:96023:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788838352.915263:0:96023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788838352.915288:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627f2d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788838352.915348:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff639653000 for lustre-MDT0000 00000100:00080000:3.0:1788838352.916829:0:96023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788838352.916836:0:96023:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788838352.916843:0:96023:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788838352.916864:0:96023:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788838352.917155:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875729135212544:0@lo:39:umount.0 00000100:00100000:0.0:1788838352.917217:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838352.917595:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135212544 00000100:00100000:3.0:1788838352.917602:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135212544 00000100:00100000:3.0:1788838352.917745:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:3.0:1788838352.917754:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875729135212544:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788838352.917779:0:66254:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc3d00 00000100:00080000:3.0:1788838352.917787:0:66254:0:(import.c:65:import_set_state_nolock()) ffff8ff503192000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788838352.917880:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3642:x1875729135212544:12345-0@lo:39:umount.0 Request processed in 126us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838352.917887:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000020:00000080:3.0:1788838352.917899:0:66254:0:(genops.c:885:class_export_put()) final put ffff8ff503190000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:0.0:1788838352.917959:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788838352.918005:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788838352.918023:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61fc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875729135212544:0@lo:39:umount.0 00000020:00000080:1.0:1788838352.918063:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff503190000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788838352.918094:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff503192000 for lustre-MDT0001 00000100:00080000:0.0:1788838352.918254:0:96023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788838352.918257:0:96023:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788838352.918261:0:96023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788838352.921025:0:96023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921054:0:96023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921061:0:96023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921068:0:96023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921090:0:96023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788838352.921098:0:96023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921105:0:96023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921112:0:96023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921130:0:96023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921154:0:96023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788838352.921158:0:96023:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788838352.921241:0:96023:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788838352.921246:0:96023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00010000:00010000:0.0:1788838352.921262:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788838352.921268:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921285:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3eea00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788838352.921288:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921297:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838352.921304:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838352.921310:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788838352.921313:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788838352.921315:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788838352.921348:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921355:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838352.921386:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921393:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50f3eea00/0x88da08396ccca383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccca38a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921407:0:15289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788838352.921411:0:15289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921416:0:15289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff626ab9000 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:0.0:1788838352.921419:0:15289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921432:0:15289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788838352.921439:0:15289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838352.921444:0:15289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788838352.921446:0:15289:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788838352.921448:0:15289:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788838352.921461:0:15289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921467:0:15289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788838352.921483:0:15289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921489:0:15289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff626ab9000/0x88da08396ccc9f70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x88da08396ccc9f77 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921499:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838352.921501:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838352.921503:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838352.921513:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788838352.921532:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135212672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838352.921596:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838352.921657:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135212800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838352.921678:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838352.921710:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135212672 00000100:00100000:0.0:1788838352.921717:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135212672 00000100:00100000:0.0:1788838352.921769:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135212800 00000100:00100000:0.0:1788838352.921773:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135212800 00000100:00100000:0.0:1788838352.921816:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1788838352.921825:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135212672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838352.921836:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838352.921849:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff601529e00/0x88da08396ccca38a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccca383 expref: 24 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921862:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838352.921896:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3643:x1875729135212672:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.921902:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1788838352.921917:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1788838352.921923:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3645:x1875729135212800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838352.921930:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788838352.921938:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff5059a5e00/0x88da08396ccc9f77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x88da08396ccc9f70 expref: 22 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.921947:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788838352.921971:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3645:x1875729135212800:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838352.921977:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1788838352.922017:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135212800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788838352.922041:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135212672:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788838352.922056:0:96023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788838352.922066:0:96023:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:2.0:1788838352.923783:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:0.0:1788838352.929676:0:96023:0:(ofd_obd.c:1268:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1788838352.929727:0:96023:0:(ofd_obd.c:1282:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:2.0:1788838352.930364:0:8455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969517 is committed 00000020:00000080:0.0:1788838352.930646:0:96023:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1788838352.930656:0:96023:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8ff50443f800 efc561ba-875e-4857-b79b-9bd7023bd57c 192.168.203.30@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294969517 stale:0 00000020:00080000:0.0:1788838352.930864:0:96023:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8ff632f53000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969473 stale:0 00000020:00080000:0.0:1788838352.930869:0:96023:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8ff6048e1000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969444 stale:0 00000020:00080000:0.0:1788838352.930874:0:96023:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8ff624ff4d28) has exports, disconnecting them 00000020:00080000:0.0:1788838352.930880:0:96023:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.30@tcp (ffff8ff50443f800), last request at 1788838351 00000020:00000080:0.0:1788838352.930886:0:96023:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccca1b5 00000020:00010000:0.0:1788838352.930894:0:96023:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ff50443f800: total 0 00000100:00080000:0.0:1788838352.930899:0:96023:0:(import.c:65:import_set_state_nolock()) ffff8ff50443d800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788838352.931015:0:96023:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.30@tcp (ffff8ff50443f800): rc 0 00000020:00080000:0.0:1788838352.931019:0:96023:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8ff632f53000), last request at 1788838352 00000020:00000080:0.0:1788838352.931023:0:96023:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc9e82 00000100:00080000:0.0:1788838352.931028:0:96023:0:(import.c:65:import_set_state_nolock()) ffff8ff632f51000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788838352.932385:0:6535:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ff50443f800: total 0 00010000:00010000:3.0:1788838352.932532:0:6535:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ff50443f800, canceled 0 locks, left on hash table 20. 00002000:00010000:3.0:1788838352.932567:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb size from disk: 0 -> 1024 00000020:00080000:0.0:1788838352.932569:0:96023:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff632f53000): rc 0 00002000:00010000:3.0:1788838352.932571:0:6535:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb mtime from disk: 1788838351 -> 1788838352 00000020:00000080:0.0:1788838352.932572:0:96023:0:(genops.c:885:class_export_put()) final put ffff8ff632f53000/lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1788838352.932574:0:6535:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb ctime from disk: 1788838351 -> 1788838352 00002000:00010000:3.0:1788838352.932576:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:0.0:1788838352.932586:0:96023:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8ff6048e1000), last request at 1788838352 00000020:00000080:0.0:1788838352.932592:0:96023:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396ccc3c66 00000100:00080000:0.0:1788838352.932599:0:96023:0:(import.c:65:import_set_state_nolock()) ffff8ff6048e0800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788838352.932600:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd740578/0x88da08396cccacf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2d4 expref: 21 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.932620:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788838352.932629:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb size from disk: 0 -> 1024 00000020:00080000:0.0:1788838352.932629:0:96023:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff6048e1000): rc 0 00000020:00000080:0.0:1788838352.932631:0:96023:0:(genops.c:885:class_export_put()) final put ffff8ff6048e1000/lustre-MDT0001-mdtlov_UUID 00002000:00010000:3.0:1788838352.932632:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:0.0:1788838352.932667:0:96023:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8ff624ff4d28) has no exports 00010000:00010000:1.0:1788838352.932671:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838352.932700:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da54206c/0x88da08396cccaad0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d225 expref: 20 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.932717:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000001d8e0cd5/0x88da08396ccca8fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d184 expref: 19 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838352.932719:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788838352.932722:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788838352.932730:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b50d7d6/0x88da08396cccac97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2b1 expref: 19 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.932731:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d8e0cd5/0x88da08396ccca8fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d184 expref: 19 pid: 26220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838352.932767:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788838352.932769:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788838352.932776:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c5525c/0x88da08396cccaa75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d202 expref: 17 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.932782:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000008178cdca/0x88da08396ccca93a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d199 expref: 17 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838352.932790:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788838352.932792:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788838352.932793:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008178cdca/0x88da08396ccca93a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d199 expref: 16 pid: 26213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.932845:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000035506005/0x88da08396ccca9e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1d1 expref: 15 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.932856:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035506005/0x88da08396ccca9e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1d1 expref: 15 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.932882:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396cccaa36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1ed expref: 14 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.932892:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5a34368/0x88da08396cccaa36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1ed expref: 14 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.932930:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000004733fc58/0x88da08396ccca9fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1d8 expref: 13 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933071:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004733fc58/0x88da08396ccca9fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1d8 expref: 13 pid: 26215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933242:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000004bbc9797/0x88da08396ccca979 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1ae expref: 12 pid: 8657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933376:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bbc9797/0x88da08396ccca979 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d1ae expref: 12 pid: 8657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933408:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396cccaaf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d22c expref: 11 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933417:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046e1109e/0x88da08396cccaaf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d22c expref: 11 pid: 8462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933448:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000086fcecf0/0x88da08396cccab71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d256 expref: 10 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933459:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086fcecf0/0x88da08396cccab71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d256 expref: 10 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933487:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396cccab6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d24f expref: 9 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933497:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049d8fd5d/0x88da08396cccab6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d24f expref: 9 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933537:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000008e7bc6b8/0x88da08396cccabb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d26b expref: 8 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838352.933550:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e7bc6b8/0x88da08396cccabb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d26b expref: 8 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788838352.933667:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff632f53000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788838352.933716:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6048e1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788838352.933735:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff632f51000 for lustre-OST0000 00000020:00000080:2.0:1788838352.933741:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff6048e0800 for lustre-OST0000 00010000:00010000:0.0:1788838352.934039:0:96023:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000ecd773ea/0x88da08396cccabcc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40107480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d280 expref: 7 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838352.936433:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788838352.936442:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788838352.936458:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023372e95/0x88da08396cccacac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2bf expref: 7 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838352.936492:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788838352.936495:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788838352.936503:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a37da02/0x88da08396cccad54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2fe expref: 6 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838352.936521:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788838352.936524:0:6535:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb mtime from disk: 1788838351 -> 1788838352 00002000:00010000:3.0:1788838352.936527:0:6535:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb ctime from disk: 1788838351 -> 1788838352 00002000:00010000:3.0:1788838352.936529:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788838352.936536:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055a03679/0x88da08396cccad3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2f0 expref: 5 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838352.936581:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788838352.936583:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788838352.936592:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061af10e8/0x88da08396cccac2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d295 expref: 4 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788838352.936606:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788838352.936609:0:6535:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb mtime from disk: 1788838351 -> 1788838352 00002000:00010000:3.0:1788838352.936611:0:6535:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb ctime from disk: 1788838351 -> 1788838352 00002000:00010000:3.0:1788838352.936614:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788838352.936621:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002464858/0x88da08396cccad46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d2f7 expref: 3 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838352.936636:0:6535:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ff50443f800, canceled 10 locks, left on hash table 0. 00010000:00010000:0.0:1788838352.937245:0:96023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecd773ea/0x88da08396cccabcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d280 expref: 2 pid: 26207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788838352.939691:0:6535:0:(genops.c:885:class_export_put()) final put ffff8ff50443f800/efc561ba-875e-4857-b79b-9bd7023bd57c 00010000:00010000:3.0:1788838352.939720:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838352.939723:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788838352.939726:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838352.939842:0:27607:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff50443f800/efc561ba-875e-4857-b79b-9bd7023bd57c for lustre-OST0000 00000020:00000080:1.0:1788838352.939894:0:27607:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff50443d800 for lustre-OST0000 00000020:01000000:0.0:1788838352.941634:0:96023:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff50334f360 - data ffff8ff633ee45e8/ffff8ff627fe3c00 00000020:01000000:0.0:1788838352.941788:0:96023:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ff502377840 - data ffff8ff633e7da20/ffff8ff6411a1c00 00100000:10000000:0.0:1788838352.952050:0:96023:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788838352.964869:0:96023:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396cc7d1b5 00000020:00000080:1.0:1788838352.964883:0:96023:0:(genops.c:885:class_export_put()) final put ffff8ff501b1a800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788838352.964903:0:96023:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff627f9a800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788838352.964907:0:96023:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff627f9a800 2 00000020:01000004:1.0:1788838352.964910:0:96023:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ff627f9a800 from lustre-OST0000 00000020:00000080:1.0:1788838352.964933:0:96023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838352.964948:0:96023:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788838352.964951:0:96023:0:(genops.c:885:class_export_put()) final put ffff8ff501b1f800/lustre-OST0000_UUID 00000020:00000080:1.0:1788838352.964954:0:96023:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff501b1f800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788838352.964961:0:96023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788838352.965058:0:96023:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1788838352.965062:0:96023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788838352.965065:0:96023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788838352.965071:0:96023:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788838352.965077:0:96023:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ff5021a6800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788838352.965083:0:96023:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8ff502198000) has exports, disconnecting them 00000020:00080000:1.0:1788838352.965088:0:96023:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ff5021a6800), last request at 1788834832 00000020:00000080:1.0:1788838352.965092:0:96023:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396cc7d1df 00000020:00080000:1.0:1788838352.965100:0:96023:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff5021a6800): rc 0 00000020:00000080:1.0:1788838352.965105:0:96023:0:(genops.c:885:class_export_put()) final put ffff8ff5021a6800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788838352.965750:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff501b1a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788838352.965765:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5021a6800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000100:00100000:2.0:1788838352.970980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838352.971023:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116536448 00000100:00100000:2.0:1788838352.971047:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116536448 00000100:00100000:2.0:1788838352.971114:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1474 00000100:00100000:2.0:1788838352.971124:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+154:2407:x1875729116536448:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838352.971209:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+154:2407:x1875729116536448:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838352.971217:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1474 00000100:00100000:2.0:1788838352.971259:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838352.971282:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116536704 00000100:00100000:2.0:1788838352.971285:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116536704 00000100:00100000:2.0:1788838352.971311:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6058 00000100:00100000:2.0:1788838352.971317:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2407:x1875729116536704:12345-192.168.203.30@tcp:400:kworker.0 00000020:00080000:2.0:1788838352.971323:0:26211:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.30@tcp 00000100:00100000:2.0:1788838352.971348:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2407:x1875729116536704:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (88us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788838352.971354:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6058 00000100:00100000:2.0:1788838352.971416:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838352.971435:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116536320 00000100:00100000:2.0:1788838352.971439:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116536320 00000100:00100000:2.0:1788838352.971465:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:2.0:1788838352.971472:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50a21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116536320:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838352.971496:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50a21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116536320:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838352.971503:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:2.0:1788838352.971549:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838352.971565:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116536576 00000100:00100000:2.0:1788838352.971569:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116536576 00000100:00100000:2.0:1788838352.971604:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1475 00000100:00100000:2.0:1788838352.971611:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116536576:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838352.973307:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838352.974029:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116536576:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2412us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838352.974043:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1475 00000100:00100000:2.0:1788838352.974090:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116536832 00000100:00100000:2.0:1788838352.974097:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116536832 00000100:00100000:2.0:1788838352.974140:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2752 00000100:00100000:2.0:1788838352.974148:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116536832:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838352.974213:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116536832:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 66us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838352.974219:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2752 00000100:00080000:2.0:1788838352.977180:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838352.977191:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838352.977194:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788838352.985560:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838352.985754:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116536960 00000100:00100000:3.0:1788838352.985766:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116536960 00000100:00100000:3.0:1788838352.985852:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6059 00000100:00100000:3.0:1788838352.985860:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2403:x1875729116536960:12345-192.168.203.30@tcp:8:ptlrpcd_01_01.0 00010000:00020000:3.0:1788838352.985885:0:26213:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838352.985980:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2403:x1875729116536960:12345-192.168.203.30@tcp:8:ptlrpcd_01_01.0 Request processed in 119us (430us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838352.985988:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6059 00010000:01000000:2.0:1788838352.991876:0:96023:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788838352.991887:0:96023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788838352.991892:0:96023:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788838352.991900:0:96023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788838352.992080:0:96023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788838352.992093:0:96023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788838352.992100:0:96023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788838352.992107:0:96023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788838352.992112:0:96023:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788838352.992133:0:96023:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8ff5021a1800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788838352.992140:0:96023:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8ff50219cd28) has exports, disconnecting them 00000020:00080000:2.0:1788838352.992160:0:96023:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8ff5021a1800), last request at 1788834832 00000020:00000080:2.0:1788838352.992165:0:96023:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396cc7d1f4 00000020:00080000:2.0:1788838352.992179:0:96023:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ff5021a1800): rc 0 00000020:00000080:2.0:1788838352.992185:0:96023:0:(genops.c:885:class_export_put()) final put ffff8ff5021a1800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788838352.992555:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5021a5800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788838352.992562:0:63434:0:(genops.c:885:class_export_put()) final put ffff8ff501a41800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788838352.992565:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff501a41800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788838352.992574:0:63434:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788838352.992663:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5021a1800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788838352.999074:0:96023:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788838352.999081:0:96023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788838352.999085:0:96023:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788838352.999091:0:96023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788838352.999503:0:63434:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ff5021a5000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788838352.999678:0:96023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788838352.999692:0:96023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788838352.999698:0:96023:0:(genops.c:885:class_export_put()) final put ffff8ff5021a3800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788838352.999701:0:96023:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff5021a3800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788838352.999707:0:96023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788838352.999812:0:96023:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff627f9a800 1 00000020:00000080:3.0:1788838352.999818:0:96023:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x88da08396cc7d17d 00000020:00000080:3.0:1788838352.999825:0:96023:0:(genops.c:885:class_export_put()) final put ffff8ff6104dc800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788838353.000464:0:96023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788838353.000478:0:63434:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff6104dc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788838353.000491:0:96023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788838353.000500:0:96023:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788838353.000504:0:96023:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8ff624ff0000) has no exports 00010000:00010000:2.0:1788838353.089776:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788838353.099563:0:96023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788838353.099582:0:96023:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788838353.099589:0:96023:0:(genops.c:885:class_export_put()) final put ffff8ff627f98800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788838353.099594:0:96023:0:(genops.c:844:class_export_destroy()) destroying export ffff8ff627f98800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788838353.099604:0:96023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788838353.099765:0:96023:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ff627f9c800 00000020:02000400:1.0:1788838353.099840:0:96023:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:3.0:1788838353.277594:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff637f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135212928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788838353.277690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838353.277753:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135212928 00000100:00100000:3.0:1788838353.277760:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135212928 00000100:00100000:3.0:1788838353.277811:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:3.0:1788838353.277818:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3646:x1875729135212928:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:3.0:1788838353.277826:0:12691:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838353.277862:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3646:x1875729135212928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (173us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838353.278488:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:02020000:3.0:1788838353.278538:0:3646:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1788838353.278708:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135213056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838353.278746:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838353.278782:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135213056 00000100:00100000:1.0:1788838353.278786:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135213056 00000100:00100000:1.0:1788838353.278831:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:1.0:1788838353.278839:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135213056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838353.278865:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838353.278902:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135213056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838353.278908:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00100000:1.0:1788838353.278942:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135213056:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788838353.292341:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788838353.292349:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788838353.292353:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1788838353.292365:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1788838353.292368:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788838353.292373:0:3646:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3695 00000100:00080000:3.0:1788838353.292381:0:3646:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff62c81b000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1788838353.292784:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff611a7ce00 x1875729135213184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838353.292851:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135213184:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:3.0:1788838353.292914:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838353.292961:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135213184 00000100:00100000:3.0:1788838353.292969:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135213184 00000100:00100000:3.0:1788838353.293004:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6060 00000100:00100000:3.0:1788838353.293011:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3642:x1875729135213184:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:3.0:1788838353.293031:0:26207:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838353.293075:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3642:x1875729135213184:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 63us (160us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838353.293083:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6060 00000100:00080000:3.0:1788838353.293258:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838353.293263:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788838353.293267:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135213184:0@lo:8:ptlrpcd_00_03.0 00010000:00010000:1.0:1788838354.109955:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838354.300976:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135213312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788838354.301125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838354.301189:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135213312 00000100:00100000:3.0:1788838354.301199:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135213312 00000100:00100000:3.0:1788838354.301253:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:3.0:1788838354.301263:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135213312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838354.301286:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838354.301327:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135213312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838354.301523:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00080000:3.0:1788838354.301549:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838354.301586:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135213312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838354.302424:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788838354.302435:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135213440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788838354.302483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838354.303616:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135213440 00000100:00100000:3.0:1788838354.303635:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135213440 00000100:00100000:3.0:1788838354.303684:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:3.0:1788838354.303691:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3646:x1875729135213440:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1788838354.303699:0:12691:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788838354.303760:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3646:x1875729135213440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (1277us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788838354.303767:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:02020000:1.0:1788838354.305614:0:3646:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788838354.305621:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788838354.305638:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788838354.305643:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1788838354.305665:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1788838354.305668:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838354.305673:0:3646:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2815 00000100:00080000:1.0:1788838354.305682:0:3646:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ff604585000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1788838354.305720:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640735180 x1875729135213568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838354.305829:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135213568:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:0.0:1788838354.305887:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838354.305935:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135213568 00000100:00100000:3.0:1788838354.305942:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135213568 00000100:00100000:3.0:1788838354.305985:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6061 00000100:00100000:3.0:1788838354.305991:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3642:x1875729135213568:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:3.0:1788838354.306011:0:20253:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788838354.306061:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3642:x1875729135213568:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 68us (173us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838354.306069:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6061 00000100:00080000:0.0:1788838354.306289:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838354.306295:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838354.306298:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135213568:0@lo:8:ptlrpcd_00_03.0 00010000:00010000:1.0:1788838355.133059:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838356.158006:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788838356.865882:0:94387:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051733 is committed 00010000:00010000:0.0:1788838356.873007:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873032:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873042:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873050:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f10a00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.873056:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873066:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873376:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8ff508af1800) 00010000:00010000:0.0:1788838356.873381:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.873388:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873396:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f10a00/0x88da08396ccca8d1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873424:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873432:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873438:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873467:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50f3eee00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.873471:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873478:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873488:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8ff60b5cf500) 00010000:00010000:0.0:1788838356.873490:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.873493:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873499:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50f3eee00/0x88da08396ccca902 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873513:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873519:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873525:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873530:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.873533:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873540:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873562:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8ff60b5cf700) 00010000:00010000:0.0:1788838356.873564:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.873568:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873575:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626800/0x88da08396ccca941 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873590:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873596:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873604:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873609:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff503f11600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.873622:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873628:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873637:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8ff508af1100) 00010000:00010000:0.0:1788838356.873639:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.873643:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873648:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff503f11600/0x88da08396ccca9b1 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873680:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873687:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.873694:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878575:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c6e00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.878586:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878601:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878635:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8ff508af1400) 00010000:00010000:0.0:1788838356.878639:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.878645:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878654:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6e00/0x88da08396ccca9f0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878694:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878703:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878711:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878738:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.878742:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878748:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878758:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8ff605587000) 00010000:00010000:0.0:1788838356.878760:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.878764:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878770:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c200/0x88da08396ccca9f7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878789:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878823:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878832:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878838:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff504626000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.878841:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878848:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878874:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8ff5037c5200) 00010000:00010000:0.0:1788838356.878876:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.878881:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878887:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff504626000/0x88da08396cccaa3d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 67312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878905:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878911:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878917:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878923:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cb200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.878926:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878932:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878940:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8ff61d841800) 00010000:00010000:0.0:1788838356.878942:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.878947:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878954:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cb200/0x88da08396cccaab4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878982:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878990:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.878996:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.879003:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8600 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.879007:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.879013:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.879020:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8ff61d841300) 00010000:00010000:0.0:1788838356.879023:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.879026:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.879031:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8600/0x88da08396cccaaad lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.879044:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.879051:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.879057:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.879071:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e9200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.879075:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.879081:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.879090:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8ff61d841600) 00010000:00010000:0.0:1788838356.879092:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880269:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880293:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e9200/0x88da08396cccab2b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880322:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880330:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880337:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880342:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3ca200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.880346:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880353:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880390:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8ff61d841700) 00010000:00010000:0.0:1788838356.880393:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880397:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880403:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3ca200/0x88da08396cccab32 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880416:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880422:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880429:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880433:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.880436:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880442:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880448:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8ff61d841500) 00010000:00010000:0.0:1788838356.880451:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880453:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880459:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50a2e8200/0x88da08396cccab78 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880484:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880491:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880497:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880502:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff63a3cbe00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.880505:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880512:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880521:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8ff61d841a00) 00010000:00010000:0.0:1788838356.880524:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880527:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880533:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff63a3cbe00/0x88da08396cccabb7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880544:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880550:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880557:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880567:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff60148e000 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.880570:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880576:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880584:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8ff5037c5700) 00010000:00010000:0.0:1788838356.880586:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880589:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880595:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff60148e000/0x88da08396cccabf6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880608:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880626:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880632:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880637:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.880639:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880645:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880662:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8ff60b5cfe00) 00010000:00010000:0.0:1788838356.880664:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880668:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880674:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6d800/0x88da08396cccac66 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880688:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880694:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880700:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880706:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50712c800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.880709:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880714:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880721:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8ff61254c300) 00010000:00010000:0.0:1788838356.880723:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880726:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880732:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff50712c800/0x88da08396cccac6d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880755:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880761:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880767:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880773:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6c800 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.880776:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880782:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880790:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8ff61254ca00) 00010000:00010000:0.0:1788838356.880792:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880795:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880822:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c800/0x88da08396cccace4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880837:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880843:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880849:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880859:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6c200 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.880862:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880868:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880876:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8ff61d841200) 00010000:00010000:0.0:1788838356.880878:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880881:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880887:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6c200/0x88da08396cccad23 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880897:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880903:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880909:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880914:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6dc00 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.880917:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880923:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880939:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8ff61254c800) 00010000:00010000:0.0:1788838356.880941:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880944:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880950:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff509c6dc00/0x88da08396cccad2a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 76060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880959:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880964:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880970:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880975:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff6421c6400 already unused, calling callback (ffffffffc19eb4f0) 00010000:00010000:0.0:1788838356.880977:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880984:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.880990:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8ff5037c5c00) 00010000:00010000:0.0:1788838356.880992:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788838356.880995:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838356.881000:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ff6421c6400/0x88da08396cccad4d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 75504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838357.181964:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788838357.885184:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1788838357.885189:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135213824:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788838357.885192:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788838357.885197:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838357.885205:0:27607:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3748 00000100:00080000:0.0:1788838357.885211:0:27607:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838357.885218:0:27607:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ff604585000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838357.885241:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd2c380 x1875729135214464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788838357.885273:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838357.885276:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788838357.885278:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838357.885281:0:27607:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3747 00000100:00080000:0.0:1788838357.885284:0:27607:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788838357.885287:0:27607:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff62c81b000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1788838357.885297:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071cf800 x1875729135214976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788838357.885319:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838357.885329:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135213696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838357.885357:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135214080:0@lo:400:kworker.0 00000100:00100000:0.0:1788838357.885364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838357.885367:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135214336:0@lo:400:kworker.0 00000100:00100000:1.0:1788838357.885391:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838357.885391:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135214208:0@lo:400:kworker.0 00000100:00100000:1.0:1788838357.885413:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135214720:0@lo:400:kworker.0 00000100:00100000:3.0:1788838357.885422:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838357.885425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838357.885446:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135214080 00000100:00100000:1.0:1788838357.885453:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135214080 00000100:00100000:3.0:1788838357.885457:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135215104:0@lo:400:kworker.0 00000100:00100000:0.0:1788838357.885458:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135214848:0@lo:400:kworker.0 00000100:00100000:1.0:1788838357.885498:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135214208 00000100:00100000:1.0:1788838357.885502:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135214208 00000100:00100000:3.0:1788838357.885506:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838357.885507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838357.885524:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:3.0:1788838357.885536:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788838357.885536:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135214080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838357.885547:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135213952:0@lo:400:kworker.0 00000100:00100000:3.0:1788838357.885578:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838357.885599:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135214080:12345-0@lo:400:kworker.0 Request processed in 65us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838357.885618:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:3.0:1788838357.885628:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135214592:0@lo:400:kworker.0 00000100:00100000:1.0:1788838357.885638:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:1.0:1788838357.885647:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135214208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838357.885657:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838357.885679:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135215232:0@lo:400:kworker.0 00000100:00100000:1.0:1788838357.885689:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875729135214208:12345-0@lo:400:kworker.0 Request processed in 44us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838357.885696:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:3.0:1788838357.885713:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788838357.885715:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838357.885719:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838357.885731:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135215232 00000100:00100000:1.0:1788838357.885735:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135215232 00000100:00100000:1.0:1788838357.885763:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:1.0:1788838357.885778:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135215232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838357.885831:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135215232:12345-0@lo:400:kworker.0 Request processed in 54us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838357.885837:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:1.0:1788838357.885875:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135215232:0@lo:400:kworker.0 00000100:00100000:0.0:1788838357.886325:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875729135214208:0@lo:400:kworker.0 00000100:00100000:0.0:1788838357.886360:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135214464:0@lo:8:kworker.0 00000100:00100000:0.0:1788838357.886389:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838357.886412:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135214976:0@lo:8:kworker.0 00000100:00100000:0.0:1788838357.886432:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838357.887839:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135213824 00000100:00100000:3.0:1788838357.887851:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135213824 00000100:00100000:0.0:1788838357.887913:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135213696 00000100:00100000:0.0:1788838357.887920:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135213696 00000100:00100000:3.0:1788838357.887924:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135214336 00000100:00100000:3.0:1788838357.887929:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135214336 00000100:00100000:0.0:1788838357.887953:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135214848 00000100:00100000:0.0:1788838357.887959:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135214848 00000100:00100000:3.0:1788838357.887963:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4287 00000100:00100000:3.0:1788838357.887988:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135213824:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838357.887991:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4288 00000100:00100000:0.0:1788838357.888004:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1875729135213696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838357.888028:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000004:00000024:0.0:1788838357.888029:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00000100:00100000:0.0:1788838357.888092:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3646:x1875729135213696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (2727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838357.888099:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4288 00000100:00100000:0.0:1788838357.888116:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4289 00000100:00100000:0.0:1788838357.888122:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135214336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838357.888161:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135214336:12345-0@lo:400:kworker.0 Request processed in 39us (2744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838357.888167:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4289 00000100:00100000:0.0:1788838357.888180:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4290 00000100:00100000:0.0:1788838357.888185:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135214848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838357.888187:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135214336:0@lo:400:kworker.0 00000100:00100000:0.0:1788838357.888214:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875729135214848:12345-0@lo:400:kworker.0 Request processed in 28us (2713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838357.888219:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4290 00000100:00100000:0.0:1788838357.888249:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838357.888276:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135214720 00000100:00100000:1.0:1788838357.888280:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135214720 00000100:00100000:0.0:1788838357.888300:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135214080:0@lo:400:kworker.0 00000100:00100000:1.0:1788838357.888305:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:1.0:1788838357.888310:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135214720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838357.888321:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135213952 00000100:00100000:0.0:1788838357.888325:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135213952 00000100:00100000:1.0:1788838357.888347:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135214720:12345-0@lo:400:kworker.0 Request processed in 37us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838357.888349:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788838357.888353:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:0.0:1788838357.888355:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63a3cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3643:x1875729135213952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838357.888381:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135214720:0@lo:400:kworker.0 00000100:00100000:0.0:1788838357.888387:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63a3cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3643:x1875729135213952:12345-0@lo:400:kworker.0 Request processed in 33us (2810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838357.888394:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788838357.888403:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135213952:0@lo:400:kworker.0 00000100:00100000:0.0:1788838357.888422:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135215104 00000100:00100000:0.0:1788838357.888426:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135215104 00000100:00080000:1.0:1788838357.888448:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838357.888462:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135214592 00000100:00100000:0.0:1788838357.888465:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135214592 00000100:00080000:1.0:1788838357.888483:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838357.888490:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135214464 00000100:00100000:0.0:1788838357.888493:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135214464 00000100:00100000:0.0:1788838357.888505:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135214976 00000100:00100000:0.0:1788838357.888508:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135214976 00000100:00100000:3.0:1788838357.888556:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135213824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 574us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838357.888565:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4287 00000100:00100000:1.0:1788838357.888575:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135213824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838357.888793:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:0.0:1788838357.888822:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:3.0:1788838357.888824:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135215104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838357.888835:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135214592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838357.888874:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135215104:12345-0@lo:400:kworker.0 Request processed in 55us (3373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838357.888881:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:3.0:1788838357.888897:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6062 00000100:00100000:3.0:1788838357.888901:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875729135214464:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788838357.888918:0:8463:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838357.888948:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135214592:12345-0@lo:400:kworker.0 Request processed in 117us (3290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838357.888957:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:3.0:1788838357.888967:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875729135214464:12345-0@lo:8:kworker.0 Request processed in 62us (2576us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838357.888974:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6063 00000100:00100000:3.0:1788838357.888983:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6062 00000100:00100000:0.0:1788838357.888984:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3642:x1875729135214976:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788838357.888999:0:26214:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788838357.889027:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3642:x1875729135214976:12345-0@lo:8:kworker.0 Request processed in 46us (2594us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838357.889033:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6063 00000100:00080000:0.0:1788838357.889109:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838357.889115:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838357.889118:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135214464:0@lo:8:kworker.0 00000100:00080000:0.0:1788838357.889128:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838357.889132:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788838357.889135:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135214976:0@lo:8:kworker.0 00000100:00100000:0.0:1788838357.889166:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135213696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838357.889175:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135214848:0@lo:400:kworker.0 00000100:00100000:2.0:1788838357.891433:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135214592:0@lo:400:kworker.0 00000100:00100000:2.0:1788838357.891453:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135215104:0@lo:400:kworker.0 00000100:00100000:2.0:1788838358.078153:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838358.078198:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838358.078235:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838358.078260:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116537600 00000100:00100000:2.0:1788838358.078267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838358.078272:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116537600 00000100:00100000:2.0:1788838358.078297:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838358.078325:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116537088 00000100:00100000:2.0:1788838358.078330:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116537088 00000100:00100000:0.0:1788838358.078342:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116537472 00000100:00100000:0.0:1788838358.078347:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116537472 00000100:00100000:2.0:1788838358.078366:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:0.0:1788838358.078377:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2755 00000100:00100000:2.0:1788838358.078380:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5056c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2406:x1875729116537088:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838358.078396:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2406:x1875729116537600:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838358.078463:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116537216 00000100:00100000:1.0:1788838358.078468:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116537216 00000100:00100000:1.0:1788838358.078500:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116537344 00000100:00100000:1.0:1788838358.078503:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116537344 00000100:00100000:1.0:1788838358.078523:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1480 00000100:00100000:1.0:1788838358.078531:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2406:x1875729116537216:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838358.078593:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5056c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2406:x1875729116537088:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 217us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838358.078598:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2406:x1875729116537600:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 202us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838358.078616:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:0.0:1788838358.078623:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2755 00000100:00100000:0.0:1788838358.078643:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6064 00000100:00100000:0.0:1788838358.078649:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2403:x1875729116537472:12345-192.168.203.30@tcp:8:kworker.0 00000100:00100000:2.0:1788838358.078660:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1481 00000100:00100000:2.0:1788838358.078669:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2406:x1875729116537344:12345-192.168.203.30@tcp:400:kworker.0 00010000:00020000:0.0:1788838358.078671:0:26210:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788838358.078702:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2406:x1875729116537344:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 34us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838358.078709:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1481 00000100:00100000:0.0:1788838358.078715:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2403:x1875729116537472:12345-192.168.203.30@tcp:8:kworker.0 Request processed in 64us (417us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838358.078721:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6064 00000100:00080000:3.0:1788838358.080537:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788838358.080547:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788838358.080550:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838358.082134:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2406:x1875729116537216:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3594us (3980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838358.082158:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1480 00010000:00010000:0.0:1788838358.211480:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838358.400435:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135215360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838358.400519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838358.400550:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135215360 00000100:00100000:2.0:1788838358.400559:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135215360 00000100:00100000:2.0:1788838358.401935:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:2.0:1788838358.401951:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135215360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838358.401983:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788838358.402056:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135215360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838358.402064:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:3.0:1788838358.402924:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135215360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788838359.229454:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838359.422860:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135215488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838359.422926:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838359.422982:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135215488 00000100:00100000:1.0:1788838359.422989:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135215488 00000100:00100000:1.0:1788838359.423036:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:1.0:1788838359.423046:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135215488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838359.423064:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838359.423101:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135215488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838359.423107:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00080000:1.0:1788838359.423124:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838359.423153:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135215488:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788838360.011585:0:96368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:0.0:1788838360.255299:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838361.278072:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838362.300949:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1788838363.010008:0:94404:0:(genops.c:1210:class_import_get()) import ffff8ff6271d7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1788838363.010040:0:94404:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000049b4467d] to pc [ptlrpcd_00_00+0] req@ffff8ff640736300 x1875729135215616/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.010082:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:1.0:1788838363.010095:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff640736300 x1875729135215616/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.010108:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135215616:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788838363.010135:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff640736300 x1875729135215616/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.010157:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838363.010199:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff640734000 x1875729135215616 msgsize 224 00000100:00100000:1.0:1788838363.010203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838363.010223:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff640736300 x1875729135215616/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.010236:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5520 usecs (6 jiffies) 00000100:00100000:1.0:1788838363.010271:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135215616 00000100:00100000:1.0:1788838363.010279:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135215616 00000020:00000040:1.0:1788838363.010281:0:8472:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e66 00000020:00000040:1.0:1788838363.010286:0:8472:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff624a94800 refcount=5 00000100:00000040:1.0:1788838363.010310:0:8472:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1788838363.010336:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4291 00000100:00000040:1.0:1788838363.010341:0:8472:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff624a94800 : new rpc_count 1 00000100:00000040:1.0:1788838363.010348:0:8472:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff640734000 x1875729135215616/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.010363:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135215616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838363.010400:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00010000:00000040:1.0:1788838363.010411:0:8472:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135215616 00000100:00000040:1.0:1788838363.010421:0:8472:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838363.010426:0:8472:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838363.010443:0:8472:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff640736300 x1875729135215616/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.010465:0:8472:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838363.010470:0:8472:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff640734000 x1875729135215616/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:264/0 lens 224/368 e 0 to 0 dl 1788838374 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.010479:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135215616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838363.010494:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4291 00000100:00000040:1.0:1788838363.010498:0:8472:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff624a94800 : new rpc_count 0 00000020:00000040:1.0:1788838363.010510:0:8472:0:(genops.c:879:class_export_put()) PUTting export ffff8ff624a94800 : new refcount 4 00000100:00000040:1.0:1788838363.010541:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788838363.010547:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff640736300 x1875729135215616/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788838363.010558:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352889 avail=317186 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023681 state=0: rc = 0 00000100:00000040:1.0:1788838363.010567:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff640736300 x1875729135215616/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.010589:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135215616:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788838363.010595:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff640736300 x1875729135215616/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838363.010605:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff6271d7800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:0.0:1788838363.015988:0:75685:0:(genops.c:1210:class_import_get()) import ffff8ff6061da800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1788838363.016027:0:75685:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000787e9825] to pc [ptlrpcd_00_01+1] req@ffff8ff5071cdc00 x1875729135215744/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.016151:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838363.016161:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000100:00000040:1.0:1788838363.016171:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS req@ffff8ff640736300 x1875729135215872/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838363.016182:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000049b4467d] to pc [ptlrpcd_00_02+2] req@ffff8ff640736300 x1875729135215872/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.016199:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838363.016204:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff501ab3000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1788838363.016211:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8ff640734700 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838363.016220:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000005413239] to pc [ptlrpcd_00_03+3] req@ffff8ff640734700 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.016238:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838363.016243:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff5031c5000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1788838363.016251:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8ff640736d80 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838363.016259:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005947e70b] to pc [ptlrpcd_00_00+0] req@ffff8ff640736d80 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.018768:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff640736d80 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.018827:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135216128:0@lo:400:kworker.0 00000100:00000040:2.0:1788838363.018868:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff640736d80 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.018881:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838363.018964:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b5c00 x1875729135216128 msgsize 224 00000100:00100000:2.0:1788838363.018974:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838363.019026:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff640736d80 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.019061:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7412 usecs (8 jiffies) 00000100:00100000:2.0:1788838363.019090:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1788838363.019102:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff5071cdc00 x1875729135215744/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.019119:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135215744:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1788838363.019143:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff5071cdc00 x1875729135215744/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.019177:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838363.019199:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b7480 x1875729135215744 msgsize 224 00000100:00100000:2.0:1788838363.019203:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838363.019219:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff5071cdc00 x1875729135215744/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.019229:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1502828 usecs (1503 jiffies) 00000100:00100000:2.0:1788838363.019262:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135216128 00000100:00100000:2.0:1788838363.019271:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135216128 00000020:00000040:2.0:1788838363.019275:0:76060:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3d07 00000020:00000040:2.0:1788838363.019279:0:76060:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d2000 refcount=5 00000020:00000040:2.0:1788838363.019292:0:76060:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00000040:2.0:1788838363.019316:0:76060:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788838363.019350:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00000040:2.0:1788838363.019354:0:76060:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d2000 : new rpc_count 1 00000100:00000040:2.0:1788838363.019361:0:76060:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b5c00 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.019373:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135216128:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838363.019393:0:76060:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135216128 00000100:00000040:2.0:1788838363.019403:0:76060:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838363.019408:0:76060:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838363.019423:0:76060:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff640736d80 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.019539:0:76060:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838363.019544:0:76060:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b5c00 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.019553:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135216128:12345-0@lo:400:kworker.0 Request processed in 182us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838363.019594:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00000040:2.0:1788838363.019599:0:76060:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d2000 : new rpc_count 0 00000020:00000040:2.0:1788838363.019617:0:76060:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d2000 : new refcount 4 00000100:00100000:2.0:1788838363.019653:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135215744 00000100:00100000:2.0:1788838363.019660:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135215744 00000020:00000040:2.0:1788838363.019664:0:23765:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e20 00000020:00000040:2.0:1788838363.019670:0:23765:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d6800 refcount=7 00000100:00000040:2.0:1788838363.019693:0:23765:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788838363.019729:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4292 00000100:00000040:2.0:1788838363.019734:0:23765:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d6800 : new rpc_count 1 00000100:00000040:2.0:1788838363.019745:0:23765:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b7480 x1875729135215744/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.019769:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135215744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838363.019846:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00010000:00000040:2.0:1788838363.019873:0:23765:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875729135215744 00000100:00000040:2.0:1788838363.019895:0:23765:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838363.019907:0:23765:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838363.019971:0:23765:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff5071cdc00 x1875729135215744/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.020280:0:23765:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838363.020286:0:23765:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b7480 x1875729135215744/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:264/0 lens 224/368 e 0 to 0 dl 1788838374 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.020294:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135215744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 534us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838363.020715:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4292 00000100:00000040:2.0:1788838363.022698:0:23765:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d6800 : new rpc_count 0 00000020:00000040:2.0:1788838363.022723:0:23765:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d6800 : new refcount 6 00000100:00080000:2.0:1788838363.022774:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1788838363.022781:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00080000:1.0:1788838363.022863:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838363.022868:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788838363.022872:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838363.022878:0:27607:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3751 00000100:00080000:1.0:1788838363.022883:0:27607:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:1.0:1788838363.022885:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:1.0:1788838363.022888:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:1.0:1788838363.022891:0:27607:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c5f 00000020:00000040:1.0:1788838363.022894:0:27607:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604967800 refcount=4 00000100:00000040:1.0:1788838363.022897:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:1.0:1788838363.022899:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:1.0:1788838363.022902:0:27607:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604967800 : new refcount 3 00000100:00080000:1.0:1788838363.022904:0:27607:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ff604585000 using connection 192.168.203.130@tcp/0@lo 00000020:00000040:1.0:1788838363.022919:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff604585000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1788838363.022944:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640734380 x1875729135216256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838363.024257:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003926ba85] to pc [ptlrpcd_rcv+-1] req@ffff8ff640734380 x1875729135216256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024291:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838363.024314:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff61942c000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788838363.024331:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff640737800 x1875729135216384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838363.024342:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000eb85ba7b] to pc [ptlrpcd_00_01+1] req@ffff8ff640737800 x1875729135216384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024352:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838363.024357:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff632feb800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1788838363.024366:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8ff640737480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838363.024375:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005108023d] to pc [ptlrpcd_00_02+2] req@ffff8ff640737480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838363.024382:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838363.024385:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788838363.024388:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838363.024393:0:27607:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3751 00000100:00080000:1.0:1788838363.024396:0:27607:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:1.0:1788838363.024399:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:1.0:1788838363.024402:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:1.0:1788838363.024405:0:27607:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e6d 00000020:00000040:1.0:1788838363.024409:0:27607:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff602d1e800 refcount=4 00000100:00000040:1.0:1788838363.024412:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:1.0:1788838363.024413:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:1.0:1788838363.024417:0:27607:0:(genops.c:879:class_export_put()) PUTting export ffff8ff602d1e800 : new refcount 3 00000100:00080000:1.0:1788838363.024420:0:27607:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff62c81b000 using connection 192.168.203.130@tcp/0@lo 00000020:00000040:1.0:1788838363.024430:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff62c81b000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1788838363.024440:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff640735180 x1875729135216640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838363.024456:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000554135e8] to pc [ptlrpcd_rcv+-1] req@ffff8ff640735180 x1875729135216640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024463:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838363.024470:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff619428000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788838363.024478:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff61d27dc00 x1875729135216768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838363.024487:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c58742b0] to pc [ptlrpcd_00_03+3] req@ffff8ff61d27dc00 x1875729135216768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024494:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838363.024499:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff6104d8000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1788838363.024505:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8ff62bc70a80 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838363.024514:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d265e88a] to pc [ptlrpcd_00_00+0] req@ffff8ff62bc70a80 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024525:0:27607:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3762) 00000100:00000040:1.0:1788838363.024546:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff640736300 x1875729135215872/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.024558:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135215872:0@lo:400:kworker.0 00000100:00000040:1.0:1788838363.024596:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff640736300 x1875729135215872/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024607:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838363.024651:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff60753a450 x1875729135215872 msgsize 224 00000100:00100000:1.0:1788838363.024657:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838363.024659:0:3645:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788838363.024684:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff640736300 x1875729135215872/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024716:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff640737480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.024725:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135216512:0@lo:400:kworker.0 00000100:00000040:1.0:1788838363.024742:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff640737480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024750:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838363.024765:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc73480 x1875729135216512 msgsize 224 00000100:00100000:1.0:1788838363.024768:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838363.024784:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff640737480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024793:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 136908 usecs (137 jiffies) 00000100:00100000:1.0:1788838363.024831:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:1.0:1788838363.024837:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff640734700 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.024845:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135216000:0@lo:400:kworker.0 00000100:00000040:1.0:1788838363.024858:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff640734700 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024864:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838363.024877:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc72680 x1875729135216000 msgsize 224 00000100:00100000:1.0:1788838363.024882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838363.024902:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff640734700 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024911:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8012 usecs (9 jiffies) 00000100:00000040:1.0:1788838363.024917:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff61d27dc00 x1875729135216768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.024938:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d27dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135216768:0@lo:400:kworker.0 00000100:00000040:1.0:1788838363.024952:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff61d27dc00 x1875729135216768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.024958:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838363.024974:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc70e00 x1875729135216768 msgsize 224 00000100:00100000:1.0:1788838363.024977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838363.024991:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff61d27dc00 x1875729135216768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.025001:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9551 usecs (10 jiffies) 00000100:00000040:1.0:1788838363.025030:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff640737800 x1875729135216384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.025039:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135216384:0@lo:400:kworker.0 00000100:00000040:1.0:1788838363.025130:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff640737800 x1875729135216384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.025137:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838363.025151:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc73b80 x1875729135216384 msgsize 224 00000100:00100000:1.0:1788838363.025155:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838363.025168:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff640737800 x1875729135216384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.025177:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5655 usecs (6 jiffies) 00000100:00100000:1.0:1788838363.025184:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:1.0:1788838363.025189:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc70a80 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.025198:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135216896:0@lo:400:kworker.0 00000100:00000040:1.0:1788838363.025209:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc70a80 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.025227:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838363.025244:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc70000 x1875729135216896 msgsize 224 00000100:00100000:1.0:1788838363.025248:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838363.025262:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc70a80 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.025272:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6662 usecs (7 jiffies) 00000100:00000040:2.0:1788838363.025369:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1788838363.025377:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff5071cdc00 x1875729135215744/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1788838363.025388:0:3643:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352795 avail=317092 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023577 state=0: rc = 0 00000100:00000040:2.0:1788838363.025396:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071cdc00 x1875729135215744/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.025403:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135215744:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1788838363.025418:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838363.025423:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff640736d80 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.025431:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff640736d80 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.025437:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135216128:0@lo:400:kworker.0 00000100:00000040:2.0:1788838363.025443:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff5071cdc00 x1875729135215744/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838363.025454:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff6061da800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788838363.025462:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff640736d80 x1875729135216128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838363.025469:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff5031c5000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00100000:2.0:1788838363.025497:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135216512 00000100:00100000:2.0:1788838363.025503:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135216512 00000020:00000040:2.0:1788838363.025505:0:67312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9faf 00000020:00000040:2.0:1788838363.025509:0:67312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609254800 refcount=5 00000100:00000040:2.0:1788838363.025525:0:67312:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788838363.025561:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135216000 00000100:00100000:2.0:1788838363.025564:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135216000 00000020:00000040:2.0:1788838363.025566:0:67312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fa8 00000020:00000040:2.0:1788838363.025578:0:67312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639656800 refcount=5 00000020:00000040:2.0:1788838363.025589:0:67312:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00100000:2.0:1788838363.025611:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135216896 00000100:00100000:2.0:1788838363.025614:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135216896 00000020:00000040:2.0:1788838363.025615:0:67312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fb6 00000020:00000040:2.0:1788838363.025617:0:67312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609257000 refcount=5 00000100:00100000:2.0:1788838363.025636:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00000040:2.0:1788838363.025640:0:67312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609254800 : new rpc_count 1 00000100:00000040:2.0:1788838363.025645:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc73480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.025657:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135216512:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838363.025675:0:67312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135216512 00000100:00000040:2.0:1788838363.025683:0:67312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838363.025687:0:67312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838363.025705:0:67312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff640737480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.025728:0:67312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838363.025733:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc73480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.025742:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135216512:12345-0@lo:400:kworker.0 Request processed in 86us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838363.025749:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00000040:2.0:1788838363.025753:0:67312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609254800 : new rpc_count 0 00000020:00000040:2.0:1788838363.025763:0:67312:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609254800 : new refcount 4 00000100:00100000:2.0:1788838363.025772:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00000040:2.0:1788838363.025774:0:67312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639656800 : new rpc_count 1 00000100:00000040:2.0:1788838363.025784:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc72680 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.025818:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135216000:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838363.025829:0:67312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135216000 00000100:00000040:2.0:1788838363.025834:0:67312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838363.025837:0:67312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838363.025853:0:67312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff640734700 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.025867:0:67312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838363.025871:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc72680 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.025879:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135216000:12345-0@lo:400:kworker.0 Request processed in 86us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838363.025885:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00000040:2.0:1788838363.025887:0:67312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639656800 : new rpc_count 0 00000020:00000040:2.0:1788838363.025894:0:67312:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639656800 : new refcount 4 00000100:00100000:2.0:1788838363.025904:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00000040:2.0:1788838363.025906:0:67312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609257000 : new rpc_count 1 00000100:00000040:2.0:1788838363.025910:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc70000 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.025920:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135216896:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838363.025929:0:67312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135216896 00000100:00000040:2.0:1788838363.025933:0:67312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838363.025936:0:67312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838363.025948:0:67312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc70a80 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.025977:0:67312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838363.025981:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc70000 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.025989:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135216896:12345-0@lo:400:kworker.0 Request processed in 70us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838363.025995:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00000040:2.0:1788838363.025997:0:67312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609257000 : new rpc_count 0 00000020:00000040:2.0:1788838363.026003:0:67312:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609257000 : new refcount 4 00000100:00100000:2.0:1788838363.026019:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135216768 00000100:00100000:2.0:1788838363.026023:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135216768 00000020:00000040:2.0:1788838363.026025:0:26216:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e90 00000020:00000040:2.0:1788838363.026028:0:26216:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff632f51800 refcount=5 00000020:00000040:2.0:1788838363.026037:0:26216:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:2.0:1788838363.026046:0:26216:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1788838363.026191:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135216384 00000100:00100000:3.0:1788838363.026196:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135216384 00000020:00000040:3.0:1788838363.026197:0:26213:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c82 00000020:00000040:3.0:1788838363.026200:0:26213:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a649800 refcount=5 00000100:00000040:1.0:1788838363.026280:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788838363.026287:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc70a80 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838363.026295:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc70a80 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838363.026302:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135216896:0@lo:400:kworker.0 00000100:00000040:1.0:1788838363.026308:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc70a80 x1875729135216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838363.026316:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff6104d8000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00100000:2.0:1788838363.027169:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756 00000100:00000040:2.0:1788838363.027173:0:26216:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff632f51800 : new rpc_count 1 00000100:00000040:2.0:1788838363.027178:0:26216:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc70e00 x1875729135216768/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.027193:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135216768:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838363.027208:0:26216:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875729135216768 00000100:00000040:2.0:1788838363.027215:0:26216:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838363.027219:0:26216:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838363.027245:0:26216:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff61d27dc00 x1875729135216768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.027262:0:26216:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838363.027265:0:26216:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc70e00 x1875729135216768/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.027288:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135216768:12345-0@lo:400:kworker.0 Request processed in 99us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838363.027297:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756 00000100:00000040:2.0:1788838363.027299:0:26216:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff632f51800 : new rpc_count 0 00000100:00000040:0.0:1788838363.028131:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff640734380 x1875729135216256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.028145:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135216256:0@lo:8:kworker.0 00000100:00000040:0.0:1788838363.028170:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff640734380 x1875729135216256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838383 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.028177:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838363.028199:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5071cf800 x1875729135216256 msgsize 520 00000100:00100000:0.0:1788838363.028203:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838363.028222:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff640734380 x1875729135216256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838383 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.028234:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5803 usecs (6 jiffies) 00000100:00000040:0.0:1788838363.028242:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff640735180 x1875729135216640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.028250:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135216640:0@lo:8:kworker.0 00000100:00000040:0.0:1788838363.028261:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff640735180 x1875729135216640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838383 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.028267:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838363.028281:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff64134a450 x1875729135216640 msgsize 520 00000100:00100000:0.0:1788838363.028286:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838363.028287:0:3642:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838363.028300:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff640735180 x1875729135216640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838383 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.028308:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8617 usecs (9 jiffies) 00000100:00100000:0.0:1788838363.028345:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135215872 00000100:00100000:0.0:1788838363.028351:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135215872 00000020:00000040:0.0:1788838363.028354:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:0.0:1788838363.028360:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=21 00000100:00000040:0.0:1788838363.028377:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788838363.028415:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00000040:0.0:1788838363.028419:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:0.0:1788838363.028423:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff60753a450 x1875729135215872/t0(0) o400->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.028433:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3645:x1875729135215872:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838363.028446:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135215872 00000100:00000040:0.0:1788838363.028451:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:0.0:1788838363.028455:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838363.028473:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff640736300 x1875729135215872/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.028487:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:0.0:1788838363.028491:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff60753a450 x1875729135215872/t0(0) o400->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.028501:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3645:x1875729135215872:12345-0@lo:400:kworker.0 Request processed in 68us (3848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838363.028509:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00000040:0.0:1788838363.028512:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:0.0:1788838363.028521:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 20 00000100:00100000:0.0:1788838363.028554:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135216256 00000100:00100000:0.0:1788838363.028559:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135216256 00000020:00000040:0.0:1788838363.028560:0:26207:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c66 00000100:00100000:0.0:1788838363.028597:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135216640 00000100:00100000:0.0:1788838363.028600:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135216640 00000020:00000040:0.0:1788838363.028601:0:26207:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e82 00000100:00100000:0.0:1788838363.028628:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6065 00000100:00000040:0.0:1788838363.028634:0:26207:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5071cf800 x1875729135216256/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838383 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.028642:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3642:x1875729135216256:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788838363.028661:0:26207:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1788838363.028670:0:26207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:0.0:1788838363.028672:0:26207:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:0.0:1788838363.028675:0:26207:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838363.028692:0:26207:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8ff640734380 x1875729135216256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838383 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.028708:0:26207:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:0.0:1788838363.028711:0:26207:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071cf800 x1875729135216256/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838383 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.028718:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3642:x1875729135216256:12345-0@lo:8:kworker.0 Request processed in 76us (519us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838363.028724:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6065 00000100:00100000:0.0:1788838363.028735:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6066 00000100:00000040:0.0:1788838363.028738:0:26207:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff64134a450 x1875729135216640/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838383 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.028744:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64134a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3642:x1875729135216640:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788838363.028752:0:26207:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1788838363.028758:0:26207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:0.0:1788838363.028760:0:26207:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:0.0:1788838363.028764:0:26207:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838363.028776:0:26207:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8ff640735180 x1875729135216640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838383 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.028817:0:26207:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:0.0:1788838363.028821:0:26207:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff64134a450 x1875729135216640/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838383 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.028829:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64134a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3642:x1875729135216640:12345-0@lo:8:kworker.0 Request processed in 84us (546us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838363.028835:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6066 00000100:00000040:0.0:1788838363.028876:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff640734380 x1875729135216256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838383 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838363.028884:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838363.028888:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:0.0:1788838363.028892:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff640734380 x1875729135216256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838383 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.028899:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135216256:0@lo:8:kworker.0 00000100:00000040:0.0:1788838363.028908:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff640735180 x1875729135216640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838383 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838363.028915:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788838363.028918:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:0.0:1788838363.028921:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff640735180 x1875729135216640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838383 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.028928:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135216640:0@lo:8:kworker.0 00000100:00000040:0.0:1788838363.028933:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff640734380 x1875729135216256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838383 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838363.028941:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff604585000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1788838363.028948:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff640735180 x1875729135216640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838383 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838363.028960:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff62c81b000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1788838363.029255:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757 00000100:00000040:3.0:1788838363.029259:0:26213:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff63a649800 : new rpc_count 1 00000100:00000040:3.0:1788838363.029271:0:26213:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc73b80 x1875729135216384/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.029284:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135216384:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788838363.029299:0:26213:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1875729135216384 00000100:00000040:3.0:1788838363.029304:0:26213:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838363.029307:0:26213:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838363.029326:0:26213:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff640737800 x1875729135216384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838363.029345:0:26213:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:3.0:1788838363.029349:0:26213:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc73b80 x1875729135216384/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.029356:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135216384:12345-0@lo:400:kworker.0 Request processed in 77us (4204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838363.029362:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757 00000100:00000040:3.0:1788838363.029365:0:26213:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a649800 : new rpc_count 0 00000020:00000040:3.0:1788838363.029373:0:26213:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a649800 : new refcount 4 00000100:00000040:3.0:1788838363.029405:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1788838363.029411:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff640737800 x1875729135216384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838363.029419:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff640737800 x1875729135216384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.029425:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135216384:0@lo:400:kworker.0 00000100:00000040:3.0:1788838363.029431:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff640737800 x1875729135216384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838363.029439:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff61942c000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1788838363.031907:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1788838363.031924:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff640734700 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.031937:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff640734700 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.031943:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135216000:0@lo:400:kworker.0 00000100:00000040:0.0:1788838363.031956:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:0.0:1788838363.031961:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff61d27dc00 x1875729135216768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.031968:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61d27dc00 x1875729135216768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.031974:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d27dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135216768:0@lo:400:kworker.0 00000100:00000040:0.0:1788838363.031986:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff640736300 x1875729135215872/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.031993:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff640736300 x1875729135215872/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.032000:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135215872:0@lo:400:kworker.0 00000100:00000040:0.0:1788838363.032011:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1788838363.032015:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff640737480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838363.032023:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff640737480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838363.032058:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135216512:0@lo:400:kworker.0 00000100:00000040:0.0:1788838363.032066:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff640734700 x1875729135216000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838363.032076:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff501ab3000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1788838363.032087:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff61d27dc00 x1875729135216768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838363.032092:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff619428000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1788838363.032097:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff640736300 x1875729135215872/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838363.032103:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000100:00000040:0.0:1788838363.032107:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff640737480 x1875729135216512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838363.032114:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff632feb800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00080000:3.0:1788838363.032914:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1788838363.032932:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00080000:3.0:1788838363.032938:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1788838363.032940:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000020:00000040:2.0:1788838363.037002:0:26216:0:(genops.c:879:class_export_put()) PUTting export ffff8ff632f51800 : new refcount 4 00000100:00000040:3.0:1788838363.197306:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7c000 x1875729116537856 msgsize 224 00000100:00100000:3.0:1788838363.197323:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:3.0:1788838363.197371:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7f480 x1875729116538240 msgsize 224 00000100:00100000:3.0:1788838363.197376:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:3.0:1788838363.197405:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff607539850 x1875729116537728 msgsize 224 00000100:00100000:3.0:1788838363.197410:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:3.0:1788838363.197412:0:3636:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838363.197430:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7ed80 x1875729116537984 msgsize 224 00000100:00100000:3.0:1788838363.197435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:3.0:1788838363.197470:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7fb80 x1875729116538112 msgsize 520 00000100:00100000:3.0:1788838363.197475:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838363.197505:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116538240 00000100:00100000:3.0:1788838363.197516:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116538240 00000020:00000040:3.0:1788838363.197519:0:26214:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccca1bc 00000020:00000040:3.0:1788838363.197523:0:26214:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff50443a000 refcount=7 00000020:00000040:3.0:1788838363.197540:0:26214:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:3.0:1788838363.197567:0:26214:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1788838363.197602:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116538112 00000100:00100000:3.0:1788838363.197605:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116538112 00000020:00000040:3.0:1788838363.197607:0:26214:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccca1b5 00000100:00100000:3.0:1788838363.197628:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2758 00000100:00000040:3.0:1788838363.197633:0:26214:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff50443a000 : new rpc_count 1 00000100:00000040:3.0:1788838363.197641:0:26214:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7f480 x1875729116538240/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.197654:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116538240:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:3.0:1788838363.197680:0:26214:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116538240 00000100:00000040:3.0:1788838363.197705:0:26214:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.197712:0:26214:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838363.197751:0:26214:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.197757:0:26214:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7f480 x1875729116538240/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.197765:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116538240:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 114us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838363.197773:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2758 00000100:00000040:3.0:1788838363.197776:0:26214:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff50443a000 : new rpc_count 0 00000020:00000040:3.0:1788838363.197786:0:26214:0:(genops.c:879:class_export_put()) PUTting export ffff8ff50443a000 : new refcount 6 00000100:00100000:3.0:1788838363.197818:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6067 00000100:00000040:3.0:1788838363.197822:0:26214:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7fb80 x1875729116538112/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838383 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.197831:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2403:x1875729116538112:12345-192.168.203.30@tcp:8:kworker.0 00010000:00020000:3.0:1788838363.197853:0:26214:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1788838363.197865:0:26214:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.197868:0:26214:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.197871:0:26214:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838363.197883:0:26214:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.197887:0:26214:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7fb80 x1875729116538112/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838383 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.197896:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2403:x1875729116538112:12345-192.168.203.30@tcp:8:kworker.0 Request processed in 65us (423us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788838363.197902:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6067 00000100:00100000:3.0:1788838363.197922:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116537728 00000100:00100000:3.0:1788838363.197926:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116537728 00000020:00000040:3.0:1788838363.197933:0:94395:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9da2 00000020:00000040:3.0:1788838363.197936:0:94395:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff61d4bf800 refcount=10 00000100:00000040:3.0:1788838363.197947:0:94395:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838363.197968:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00000040:3.0:1788838363.197971:0:94395:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff61d4bf800 : new rpc_count 1 00000100:00000040:3.0:1788838363.197976:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff607539850 x1875729116537728/t0(0) o400->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.197987:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116537728:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:3.0:1788838363.197996:0:94395:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116537728 00000100:00000040:3.0:1788838363.198001:0:94395:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.198005:0:94395:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838363.198020:0:94395:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.198025:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff607539850 x1875729116537728/t0(0) o400->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.198032:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116537728:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 47us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838363.198038:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00000040:3.0:1788838363.198041:0:94395:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff61d4bf800 : new rpc_count 0 00000020:00000040:3.0:1788838363.198046:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff61d4bf800 : new refcount 9 00000100:00100000:3.0:1788838363.198071:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116537856 00000100:00100000:3.0:1788838363.198075:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116537856 00000020:00000040:3.0:1788838363.198077:0:66254:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e27 00000020:00000040:3.0:1788838363.198079:0:66254:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609269000 refcount=51 00000020:00000040:3.0:1788838363.198088:0:66254:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00000040:3.0:1788838363.198096:0:66254:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1788838363.198116:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116537984 00000100:00100000:3.0:1788838363.198119:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116537984 00000020:00000040:3.0:1788838363.198121:0:66254:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc941e 00000020:00000040:3.0:1788838363.198123:0:66254:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604960800 refcount=11 00000020:00000040:3.0:1788838363.198136:0:66254:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00100000:3.0:1788838363.198159:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1486 00000100:00000040:3.0:1788838363.198161:0:66254:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609269000 : new rpc_count 1 00000100:00000040:3.0:1788838363.198165:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7c000 x1875729116537856/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.198176:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2404:x1875729116537856:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:3.0:1788838363.198189:0:66254:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 124554051733, transno 0, xid 1875729116537856 00000100:00000040:3.0:1788838363.198194:0:66254:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.198198:0:66254:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838363.198212:0:66254:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.198216:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7c000 x1875729116537856/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.198224:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2404:x1875729116537856:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 50us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838363.198230:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1486 00000100:00000040:3.0:1788838363.198232:0:66254:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609269000 : new rpc_count 0 00000020:00000040:3.0:1788838363.198237:0:66254:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609269000 : new refcount 50 00000100:00100000:3.0:1788838363.198246:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1487 00000100:00000040:3.0:1788838363.198248:0:66254:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604960800 : new rpc_count 1 00000100:00000040:3.0:1788838363.198252:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7ed80 x1875729116537984/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.198263:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2404:x1875729116537984:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:3.0:1788838363.198273:0:66254:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 77309411471, transno 0, xid 1875729116537984 00000100:00000040:3.0:1788838363.198277:0:66254:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.198281:0:66254:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838363.198300:0:66254:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838363.198305:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7ed80 x1875729116537984/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:264/0 lens 224/224 e 0 to 0 dl 1788838374 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.198314:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2404:x1875729116537984:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 53us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838363.198320:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1487 00000100:00000040:3.0:1788838363.198322:0:66254:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604960800 : new rpc_count 0 00000020:00000040:3.0:1788838363.198328:0:66254:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604960800 : new refcount 10 00000100:00080000:3.0:1788838363.198346:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1788838363.198349:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00080000:3.0:1788838363.198352:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1788838363.198353:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00080000:3.0:1788838363.198356:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1788838363.198358:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00010000:00010000:1.0:1788838363.326444:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1788838363.516943:0:94408:0:(genops.c:1210:class_import_get()) import ffff8ff619428000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788838363.517008:0:94408:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000262bfbc9] to pc [ptlrpcd_00_01+1] req@ffff8ff611a7f800 x1875729135217024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.517223:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7f800 x1875729135217024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.517241:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135217024:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1788838363.517281:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7f800 x1875729135217024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838379 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.517290:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838363.517346:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b6680 x1875729135217024 msgsize 224 00000100:00100000:2.0:1788838363.517351:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838363.517378:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7f800 x1875729135217024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838379 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838363.517395:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9542 usecs (10 jiffies) 00000100:00100000:3.0:1788838363.517485:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135217024 00000100:00100000:3.0:1788838363.517497:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135217024 00000020:00000040:3.0:1788838363.517500:0:8465:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e90 00000020:00000040:3.0:1788838363.517505:0:8465:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff632f51800 refcount=5 00000100:00000040:3.0:1788838363.517540:0:8465:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1788838363.517583:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00000040:3.0:1788838363.517589:0:8465:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff632f51800 : new rpc_count 1 00000100:00000040:3.0:1788838363.517595:0:8465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b6680 x1875729135217024/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788838374 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.517609:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135217024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838363.517652:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1788838363.517682:0:8465:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875729135217024 00000100:00000040:3.0:1788838363.517695:0:8465:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838363.517700:0:8465:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838363.517724:0:8465:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff611a7f800 x1875729135217024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838363.517744:0:8465:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:3.0:1788838363.517748:0:8465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6680 x1875729135217024/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:264/0 lens 224/368 e 0 to 0 dl 1788838374 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838363.517756:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135217024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838363.517762:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00000040:3.0:1788838363.517766:0:8465:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff632f51800 : new rpc_count 0 00000020:00000040:3.0:1788838363.517779:0:8465:0:(genops.c:879:class_export_put()) PUTting export ffff8ff632f51800 : new refcount 4 00000100:00000040:2.0:1788838363.517906:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:2.0:1788838363.517914:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7f800 x1875729135217024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1788838363.517927:0:3644:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1788838363.517931:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1788838363.517939:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7f800 x1875729135217024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838363.517947:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135217024:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1788838363.517953:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7f800 x1875729135217024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838363.517972:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff619428000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:0.0:1788838364.348982:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1788838364.542550:0:75689:0:(genops.c:1210:class_import_get()) import ffff8ff61942c000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788838364.542615:0:75689:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d265e88a] to pc [ptlrpcd_00_02+2] req@ffff8ff62bc70a80 x1875729135217152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838364.542717:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc70a80 x1875729135217152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838364.542735:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135217152:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1788838364.542777:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc70a80 x1875729135217152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838380 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838364.542787:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838364.542876:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5071cf100 x1875729135217152 msgsize 224 00000100:00100000:0.0:1788838364.542881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838364.542911:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc70a80 x1875729135217152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838380 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838364.542928:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5656 usecs (6 jiffies) 00000100:00100000:1.0:1788838364.543059:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135217152 00000100:00100000:1.0:1788838364.543069:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135217152 00000020:00000040:1.0:1788838364.543073:0:12691:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c82 00000020:00000040:1.0:1788838364.543079:0:12691:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a649800 refcount=5 00000100:00000040:1.0:1788838364.543120:0:12691:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1788838364.543157:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00000040:1.0:1788838364.543163:0:12691:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff63a649800 : new rpc_count 1 00000100:00000040:1.0:1788838364.543170:0:12691:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5071cf100 x1875729135217152/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:265/0 lens 224/0 e 0 to 0 dl 1788838375 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838364.543195:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135217152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838364.543226:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1788838364.543238:0:12691:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1875729135217152 00000100:00000040:1.0:1788838364.543251:0:12691:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838364.543256:0:12691:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838364.543458:0:12691:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff62bc70a80 x1875729135217152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838380 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838364.543481:0:12691:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838364.543487:0:12691:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071cf100 x1875729135217152/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:265/0 lens 224/368 e 0 to 0 dl 1788838375 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838364.543496:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135217152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 304us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838364.543504:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00000040:1.0:1788838364.543507:0:12691:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a649800 : new rpc_count 0 00000020:00000040:1.0:1788838364.543520:0:12691:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a649800 : new refcount 4 00000100:00000040:1.0:1788838364.543577:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:1.0:1788838364.543584:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc70a80 x1875729135217152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788838364.543595:0:3645:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:1.0:1788838364.543599:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:1.0:1788838364.543607:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc70a80 x1875729135217152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838380 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838364.543615:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135217152:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1788838364.543623:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc70a80 x1875729135217152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838380 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838364.543640:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff61942c000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:3.0:1788838365.381684:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788838366.420503:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838367.430600:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1788838368.126070:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838368.126116:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000100:00000040:1.0:1788838368.126176:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS req@ffff8ff62bc70a80 x1875729135217280/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126207:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d265e88a] to pc [ptlrpcd_00_03+3] req@ffff8ff62bc70a80 x1875729135217280/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.126256:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838368.126263:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff501ab3000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1788838368.126273:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8ff62bc72300 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126297:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f28b093d] to pc [ptlrpcd_00_00+0] req@ffff8ff62bc72300 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.126326:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838368.126332:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff5031c5000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1788838368.126353:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8ff62bc72d80 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126364:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002069053c] to pc [ptlrpcd_00_01+1] req@ffff8ff62bc72d80 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.126373:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838368.126391:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff6061da800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1788838368.126400:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8ff62bc71f80 x1875729135217664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126441:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b1f4dc4a] to pc [ptlrpcd_00_02+2] req@ffff8ff62bc71f80 x1875729135217664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838368.126450:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838368.126454:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788838368.126457:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838368.126463:0:27607:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3757 00000100:00080000:1.0:1788838368.126469:0:27607:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:1.0:1788838368.126471:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:1.0:1788838368.126475:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:1.0:1788838368.126479:0:27607:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c5f 00000020:00000040:1.0:1788838368.126484:0:27607:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604967800 refcount=4 00000100:00000040:1.0:1788838368.126487:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:1.0:1788838368.126490:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:1.0:1788838368.126493:0:27607:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604967800 : new refcount 3 00000100:00080000:1.0:1788838368.126497:0:27607:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ff604585000 using connection 192.168.203.130@tcp/0@lo 00000020:00000040:1.0:1788838368.126526:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff604585000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1788838368.126553:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bc73100 x1875729135217792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126562:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f98af772] to pc [ptlrpcd_rcv+-1] req@ffff8ff62bc73100 x1875729135217792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.126579:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838368.126586:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff61942c000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788838368.126596:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff62bc73800 x1875729135217920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126621:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bca5b3d6] to pc [ptlrpcd_00_03+3] req@ffff8ff62bc73800 x1875729135217920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.126637:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838368.126644:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff632feb800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1788838368.126681:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8ff62bc73b80 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126692:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000dc4109d6] to pc [ptlrpcd_00_00+0] req@ffff8ff62bc73b80 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.126711:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838368.126717:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff6271d7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1788838368.126740:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff8ff62bc70e00 x1875729135218176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126748:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000061c7231e] to pc [ptlrpcd_00_01+1] req@ffff8ff62bc70e00 x1875729135218176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838368.126756:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788838368.126759:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788838368.126761:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788838368.126767:0:27607:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3757 00000100:00080000:1.0:1788838368.126770:0:27607:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:1.0:1788838368.126773:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:1.0:1788838368.126775:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:1.0:1788838368.126777:0:27607:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e6d 00000020:00000040:1.0:1788838368.126781:0:27607:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff602d1e800 refcount=4 00000100:00000040:1.0:1788838368.126784:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:1.0:1788838368.126832:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:1.0:1788838368.126835:0:27607:0:(genops.c:879:class_export_put()) PUTting export ffff8ff602d1e800 : new refcount 3 00000100:00080000:1.0:1788838368.126838:0:27607:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff62c81b000 using connection 192.168.203.130@tcp/0@lo 00000020:00000040:1.0:1788838368.126856:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff62c81b000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1788838368.126867:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd6dc00 x1875729135218304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126877:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e438d42f] to pc [ptlrpcd_rcv+-1] req@ffff8ff62bd6dc00 x1875729135218304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.126885:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838368.126890:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff619428000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788838368.126897:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff62bd6e680 x1875729135218432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126906:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003581862a] to pc [ptlrpcd_00_02+2] req@ffff8ff62bd6e680 x1875729135218432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.126913:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838368.126919:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff6104d8000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1788838368.126938:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8ff63f746d80 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838368.126947:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c3390f84] to pc [ptlrpcd_00_03+3] req@ffff8ff63f746d80 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.126969:0:27607:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3767) 00000100:00000040:1.0:1788838368.127002:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc71f80 x1875729135217664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.127018:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135217664:0@lo:400:kworker.0 00000100:00000040:1.0:1788838368.127070:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc71f80 x1875729135217664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.127080:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.127137:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f747100 x1875729135217664 msgsize 224 00000100:00100000:1.0:1788838368.127148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838368.127203:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc71f80 x1875729135217664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.127220:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1498925 usecs (1499 jiffies) 00000100:00000040:1.0:1788838368.127231:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd6e680 x1875729135218432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.127255:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135218432:0@lo:400:kworker.0 00000100:00000040:1.0:1788838368.127292:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd6e680 x1875729135218432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.127298:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.127315:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f746a00 x1875729135218432 msgsize 224 00000100:00100000:1.0:1788838368.127319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838368.127350:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd6e680 x1875729135218432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.127373:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9240 usecs (10 jiffies) 00000100:00100000:1.0:1788838368.127400:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00000040:1.0:1788838368.127407:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc70a80 x1875729135217280/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.127415:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135217280:0@lo:400:kworker.0 00000100:00000040:1.0:1788838368.127447:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc70a80 x1875729135217280/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.127455:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.127475:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff607539050 x1875729135217280 msgsize 224 00000100:00100000:1.0:1788838368.127479:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838368.127481:0:3645:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788838368.127494:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc70a80 x1875729135217280/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.127520:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc73800 x1875729135217920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.127563:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135217920:0@lo:400:kworker.0 00000100:00000040:1.0:1788838368.127578:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc73800 x1875729135217920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.127585:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.127600:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f747800 x1875729135217920 msgsize 224 00000100:00100000:1.0:1788838368.127604:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838368.127617:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc73800 x1875729135217920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.127652:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5643 usecs (6 jiffies) 00000100:00000040:1.0:1788838368.127659:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff63f746d80 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.127668:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135218560:0@lo:400:kworker.0 00000100:00000040:1.0:1788838368.127698:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff63f746d80 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.127715:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.127732:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f747480 x1875729135218560 msgsize 224 00000100:00100000:1.0:1788838368.127736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838368.127764:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff63f746d80 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.127774:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6318 usecs (7 jiffies) 00000020:00000040:2.0:1788838368.128156:0:94404:0:(genops.c:1210:class_import_get()) import ffff8ff6271d7800 refcount=4 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788838368.128196:0:94404:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007ad9eaab] to pc [ptlrpcd_00_00+0] req@ffff8ff6329b6300 x1875729135218688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128234:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc72300 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.128243:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135217408:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.128286:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc72300 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128293:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.128324:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b4000 x1875729135217408 msgsize 224 00000100:00100000:2.0:1788838368.128328:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838368.128364:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc72300 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128393:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8030 usecs (9 jiffies) 00000100:00000040:2.0:1788838368.128401:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc73b80 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.128409:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135218048:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.128423:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc73b80 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128430:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.128444:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b4e00 x1875729135218048 msgsize 224 00000100:00100000:2.0:1788838368.128448:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838368.128461:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc73b80 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128471:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 136287 usecs (137 jiffies) 00000100:00000040:2.0:1788838368.128487:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135218688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.128495:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135218688:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1788838368.128512:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135218688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128518:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.128545:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b7800 x1875729135218688 msgsize 224 00000100:00100000:2.0:1788838368.128549:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838368.128566:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135218688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128576:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5337 usecs (6 jiffies) 00000100:00100000:2.0:1788838368.128589:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:2.0:1788838368.128594:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc72d80 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.128603:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135217536:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.128615:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc72d80 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128622:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.128634:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b4380 x1875729135217536 msgsize 224 00000100:00100000:2.0:1788838368.128638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838368.128650:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc72d80 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128659:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7418 usecs (8 jiffies) 00000100:00000040:2.0:1788838368.128666:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc70e00 x1875729135218176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.128674:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135218176:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.128686:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc70e00 x1875729135218176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128699:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.128713:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b7b80 x1875729135218176 msgsize 224 00000100:00100000:2.0:1788838368.128716:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838368.128729:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc70e00 x1875729135218176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.128738:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5337 usecs (6 jiffies) 00000020:00000040:2.0:1788838368.128765:0:75685:0:(genops.c:1210:class_import_get()) import ffff8ff6061da800 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788838368.128782:0:75685:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002dccf355] to pc [ptlrpcd_00_01+1] req@ffff8ff6329b4a80 x1875729135218816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.128841:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135218560 00000100:00100000:2.0:1788838368.128850:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135218560 00000020:00000040:2.0:1788838368.128853:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fb6 00000020:00000040:2.0:1788838368.128859:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609257000 refcount=5 00000100:00000040:2.0:1788838368.128888:0:66255:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788838368.128916:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135217408 00000100:00100000:2.0:1788838368.128919:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135217408 00000020:00000040:2.0:1788838368.128921:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fa8 00000020:00000040:2.0:1788838368.128924:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639656800 refcount=5 00000020:00000040:2.0:1788838368.128935:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00100000:2.0:1788838368.128958:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135218048 00000100:00100000:2.0:1788838368.128962:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135218048 00000020:00000040:2.0:1788838368.128964:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9faf 00000020:00000040:2.0:1788838368.128966:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609254800 refcount=5 00000100:00100000:2.0:1788838368.128978:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135217536 00000100:00100000:2.0:1788838368.128980:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135217536 00000020:00000040:2.0:1788838368.128982:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3d07 00000020:00000040:2.0:1788838368.128985:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d2000 refcount=5 00000020:00000040:2.0:1788838368.128990:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00100000:2.0:1788838368.129007:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00000040:2.0:1788838368.129012:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609257000 : new rpc_count 1 00000100:00000040:2.0:1788838368.129018:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f747480 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129039:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135218560:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838368.129070:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135218560 00000100:00000040:2.0:1788838368.129081:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838368.129087:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.129109:0:66255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff63f746d80 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.129133:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838368.129139:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f747480 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129148:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135218560:12345-0@lo:400:kworker.0 Request processed in 112us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838368.129156:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00000040:2.0:1788838368.129160:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609257000 : new rpc_count 0 00000020:00000040:2.0:1788838368.129173:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609257000 : new refcount 4 00000100:00100000:2.0:1788838368.129185:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00000040:2.0:1788838368.129188:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639656800 : new rpc_count 1 00000100:00000040:2.0:1788838368.129192:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b4000 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129203:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135217408:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838368.129213:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135217408 00000100:00000040:2.0:1788838368.129218:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838368.129221:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.129236:0:66255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc72300 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.129249:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838368.129260:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b4000 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129268:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135217408:12345-0@lo:400:kworker.0 Request processed in 67us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838368.129274:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00000040:2.0:1788838368.129277:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639656800 : new rpc_count 0 00000020:00000040:2.0:1788838368.129285:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639656800 : new refcount 4 00000100:00100000:2.0:1788838368.129295:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00000040:2.0:1788838368.129298:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609254800 : new rpc_count 1 00000100:00000040:2.0:1788838368.129303:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b4e00 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129313:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135218048:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838368.129323:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135218048 00000100:00000040:2.0:1788838368.129328:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838368.129331:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.129346:0:66255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc73b80 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.129359:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838368.129363:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b4e00 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129370:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135218048:12345-0@lo:400:kworker.0 Request processed in 59us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838368.129376:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00000040:2.0:1788838368.129378:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609254800 : new rpc_count 0 00000020:00000040:2.0:1788838368.129383:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609254800 : new refcount 4 00000100:00100000:2.0:1788838368.129391:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00000040:2.0:1788838368.129394:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d2000 : new rpc_count 1 00000100:00000040:2.0:1788838368.129404:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b4380 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129414:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135217536:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838368.129427:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135217536 00000100:00000040:2.0:1788838368.129432:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838368.129435:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.129452:0:66255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc72d80 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.129465:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838368.129469:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b4380 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129477:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135217536:12345-0@lo:400:kworker.0 Request processed in 65us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838368.129483:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00000040:2.0:1788838368.129486:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d2000 : new rpc_count 0 00000020:00000040:2.0:1788838368.129493:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d2000 : new refcount 4 00000100:00100000:2.0:1788838368.129515:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135217664 00000100:00100000:2.0:1788838368.129520:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135217664 00000020:00000040:2.0:1788838368.129522:0:37907:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e20 00000020:00000040:2.0:1788838368.129525:0:37907:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d6800 refcount=7 00000100:00000040:2.0:1788838368.129550:0:37907:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788838368.129571:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135218688 00000100:00100000:2.0:1788838368.129574:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135218688 00000020:00000040:2.0:1788838368.129576:0:37907:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e66 00000020:00000040:2.0:1788838368.129579:0:37907:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff624a94800 refcount=5 00000100:00100000:2.0:1788838368.129595:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135218176 00000100:00100000:2.0:1788838368.129598:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135218176 00000020:00000040:2.0:1788838368.129600:0:37907:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e66 00000020:00000040:2.0:1788838368.129602:0:37907:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff624a94800 refcount=6 00000100:00100000:2.0:1788838368.129627:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4293 00000100:00000040:2.0:1788838368.129629:0:37907:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d6800 : new rpc_count 1 00000100:00000040:2.0:1788838368.129633:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f747100 x1875729135217664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129644:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135217664:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838368.129657:0:37907:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875729135217664 00000100:00000040:2.0:1788838368.129662:0:37907:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838368.129666:0:37907:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.129689:0:37907:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc71f80 x1875729135217664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.129704:0:37907:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838368.129708:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f747100 x1875729135217664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129717:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135217664:12345-0@lo:400:kworker.0 Request processed in 75us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838368.129722:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4293 00000100:00000040:2.0:1788838368.129724:0:37907:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d6800 : new rpc_count 0 00000020:00000040:2.0:1788838368.129730:0:37907:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d6800 : new refcount 6 00000100:00100000:2.0:1788838368.129737:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4294 00000100:00000040:2.0:1788838368.129740:0:37907:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff624a94800 : new rpc_count 1 00000100:00000040:2.0:1788838368.129743:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b7800 x1875729135218688/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129752:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135218688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838368.129783:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00010000:00000040:2.0:1788838368.129825:0:37907:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135218688 00000100:00000040:2.0:1788838368.129831:0:37907:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838368.129841:0:37907:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.129859:0:37907:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff6329b6300 x1875729135218688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.129873:0:37907:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838368.129878:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b7800 x1875729135218688/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:269/0 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129886:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875729135218688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838368.129892:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4294 00000100:00000040:2.0:1788838368.129894:0:37907:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff624a94800 : new rpc_count 0 00000020:00000040:2.0:1788838368.129902:0:37907:0:(genops.c:879:class_export_put()) PUTting export ffff8ff624a94800 : new refcount 5 00000100:00100000:2.0:1788838368.129912:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4295 00000100:00000040:2.0:1788838368.129915:0:37907:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff624a94800 : new rpc_count 1 00000100:00000040:2.0:1788838368.129919:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b7b80 x1875729135218176/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129929:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135218176:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838368.129940:0:37907:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135218176 00000100:00000040:2.0:1788838368.129944:0:37907:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838368.129947:0:37907:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.129962:0:37907:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc70e00 x1875729135218176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.129974:0:37907:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838368.129978:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b7b80 x1875729135218176/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.129986:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135218176:12345-0@lo:400:kworker.0 Request processed in 59us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838368.129993:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4295 00000100:00000040:2.0:1788838368.130001:0:37907:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff624a94800 : new rpc_count 0 00000020:00000040:2.0:1788838368.130008:0:37907:0:(genops.c:879:class_export_put()) PUTting export ffff8ff624a94800 : new refcount 4 00000100:00000040:2.0:1788838368.130043:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b4a80 x1875729135218816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130056:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135218816:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1788838368.130077:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b4a80 x1875729135218816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.130085:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.130102:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b5500 x1875729135218816 msgsize 224 00000100:00100000:2.0:1788838368.130106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838368.130122:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b4a80 x1875729135218816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.130133:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1498925 usecs (1499 jiffies) 00000100:00100000:2.0:1788838368.130155:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135218816 00000100:00100000:2.0:1788838368.130158:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135218816 00000020:00000040:2.0:1788838368.130160:0:37907:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e20 00000020:00000040:2.0:1788838368.130162:0:37907:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d6800 refcount=7 00000100:00000040:2.0:1788838368.130172:0:37907:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788838368.130187:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4296 00000100:00000040:2.0:1788838368.130189:0:37907:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d6800 : new rpc_count 1 00000100:00000040:2.0:1788838368.130194:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b5500 x1875729135218816/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130203:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135218816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838368.130222:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00010000:00000040:2.0:1788838368.130231:0:37907:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875729135218816 00000100:00000040:2.0:1788838368.130235:0:37907:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838368.130239:0:37907:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.130255:0:37907:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff6329b4a80 x1875729135218816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.130281:0:37907:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838368.130286:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b5500 x1875729135218816/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:269/0 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130294:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135218816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838368.130300:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4296 00000100:00000040:2.0:1788838368.130303:0:37907:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d6800 : new rpc_count 0 00000020:00000040:2.0:1788838368.130308:0:37907:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d6800 : new refcount 6 00000100:00000040:2.0:1788838368.130342:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1788838368.130349:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b4a80 x1875729135218816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1788838368.130360:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352795 avail=317092 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023577 state=0: rc = 0 00000100:00000040:2.0:1788838368.130368:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b4a80 x1875729135218816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130376:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135218816:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1788838368.130383:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b4a80 x1875729135218816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.130394:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff6061da800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788838368.130423:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838368.130428:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc72d80 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.130437:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc72d80 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130442:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135217536:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.130463:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838368.130467:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc70e00 x1875729135218176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.130476:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc70e00 x1875729135218176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130482:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135218176:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.130495:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838368.130499:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc72300 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.130507:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc72300 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130515:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135217408:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.130527:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838368.130532:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc73b80 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.130555:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc73b80 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130561:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135218048:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.130569:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838368.130573:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b6300 x1875729135218688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1788838368.130581:0:3643:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352889 avail=317186 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023681 state=0: rc = 0 00000100:00000040:2.0:1788838368.130588:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135218688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130601:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135218688:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1788838368.130606:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc72d80 x1875729135217536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.130613:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff5031c5000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788838368.130623:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc70e00 x1875729135218176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.130628:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff6271d7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788838368.130633:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc72300 x1875729135217408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.130639:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff501ab3000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788838368.130643:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc73b80 x1875729135218048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.130648:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff632feb800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788838368.130653:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135218688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.130660:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff6271d7800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788838368.130693:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838368.130698:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff63f746d80 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.130706:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f746d80 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130711:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135218560:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.130720:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1788838368.130723:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc71f80 x1875729135217664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.130737:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc71f80 x1875729135217664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.130743:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135217664:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.130749:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff63f746d80 x1875729135218560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.130756:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff6104d8000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788838368.130764:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc71f80 x1875729135217664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.130770:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff6061da800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1788838368.131172:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1788838368.131179:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00080000:3.0:1788838368.131183:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1788838368.131185:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00000040:1.0:1788838368.132135:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc73100 x1875729135217792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.132164:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135217792:0@lo:8:kworker.0 00000100:00000040:1.0:1788838368.132207:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc73100 x1875729135217792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838393 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.132229:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.132283:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f744380 x1875729135217792 msgsize 520 00000100:00100000:1.0:1788838368.132289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838368.132321:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc73100 x1875729135217792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838393 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.132336:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5803 usecs (6 jiffies) 00000100:00000040:1.0:1788838368.132348:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd6dc00 x1875729135218304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.132358:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135218304:0@lo:8:kworker.0 00000100:00000040:1.0:1788838368.132374:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd6dc00 x1875729135218304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838393 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.132381:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.132394:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f745880 x1875729135218304 msgsize 520 00000100:00100000:1.0:1788838368.132399:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838368.132419:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd6dc00 x1875729135218304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838393 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.132429:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8508 usecs (9 jiffies) 00000100:00100000:1.0:1788838368.132484:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135218432 00000100:00100000:1.0:1788838368.132493:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135218432 00000020:00000040:1.0:1788838368.132497:0:8460:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e90 00000020:00000040:1.0:1788838368.132503:0:8460:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff632f51800 refcount=5 00000020:00000040:1.0:1788838368.132516:0:8460:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:1.0:1788838368.132550:0:8460:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788838368.132581:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135217920 00000100:00100000:1.0:1788838368.132586:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135217920 00000020:00000040:1.0:1788838368.132588:0:8460:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c82 00000020:00000040:1.0:1788838368.132590:0:8460:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a649800 refcount=5 00000100:00100000:1.0:1788838368.132615:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135217792 00000100:00100000:1.0:1788838368.132618:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135217792 00000020:00000040:1.0:1788838368.132627:0:8460:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c66 00000100:00100000:1.0:1788838368.132646:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135218304 00000100:00100000:1.0:1788838368.132648:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135218304 00000020:00000040:1.0:1788838368.132651:0:8460:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e82 00000100:00100000:1.0:1788838368.132673:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00000040:1.0:1788838368.132677:0:8460:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff632f51800 : new rpc_count 1 00000100:00000040:1.0:1788838368.132683:0:8460:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f746a00 x1875729135218432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.132695:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135218432:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788838368.132722:0:8460:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875729135218432 00000100:00000040:1.0:1788838368.132735:0:8460:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838368.132740:0:8460:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.132764:0:8460:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bd6e680 x1875729135218432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.132788:0:8460:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838368.132794:0:8460:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f746a00 x1875729135218432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.132830:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135218432:12345-0@lo:400:kworker.0 Request processed in 136us (5512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838368.132838:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00000040:1.0:1788838368.132842:0:8460:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff632f51800 : new rpc_count 0 00000020:00000040:1.0:1788838368.132858:0:8460:0:(genops.c:879:class_export_put()) PUTting export ffff8ff632f51800 : new refcount 4 00000100:00100000:1.0:1788838368.132868:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760 00000100:00000040:1.0:1788838368.132871:0:8460:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff63a649800 : new rpc_count 1 00000100:00000040:1.0:1788838368.132875:0:8460:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f747800 x1875729135217920/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.132885:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135217920:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788838368.132908:0:8460:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1875729135217920 00000100:00000040:1.0:1788838368.132913:0:8460:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838368.132917:0:8460:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.132933:0:8460:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc73800 x1875729135217920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.132944:0:8460:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838368.132948:0:8460:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f747800 x1875729135217920/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.132962:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135217920:12345-0@lo:400:kworker.0 Request processed in 78us (5359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838368.132967:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760 00000100:00000040:1.0:1788838368.132969:0:8460:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a649800 : new rpc_count 0 00000020:00000040:1.0:1788838368.132975:0:8460:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a649800 : new refcount 4 00000100:00100000:1.0:1788838368.132983:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6068 00000100:00000040:1.0:1788838368.132986:0:8460:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f744380 x1875729135217792/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838388 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.132994:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875729135217792:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788838368.133017:0:8460:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1788838368.133030:0:8460:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838368.133033:0:8460:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838368.133037:0:8460:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.133051:0:8460:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8ff62bc73100 x1875729135217792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838393 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.133069:0:8460:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838368.133073:0:8460:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f744380 x1875729135217792/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838388 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.133093:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875729135217792:12345-0@lo:8:kworker.0 Request processed in 98us (808us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838368.133100:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6068 00000100:00100000:1.0:1788838368.133114:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6069 00000100:00000040:1.0:1788838368.133118:0:8460:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f745880 x1875729135218304/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838388 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.133127:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875729135218304:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788838368.133137:0:8460:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1788838368.133145:0:8460:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838368.133148:0:8460:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838368.133151:0:8460:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.133166:0:8460:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8ff62bd6dc00 x1875729135218304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838393 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.133180:0:8460:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838368.133185:0:8460:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f745880 x1875729135218304/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838388 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.133193:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875729135218304:12345-0@lo:8:kworker.0 Request processed in 66us (797us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838368.133199:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6069 00000100:00100000:1.0:1788838368.133225:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135217280 00000100:00100000:1.0:1788838368.133230:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135217280 00000020:00000040:1.0:1788838368.133232:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:1.0:1788838368.133235:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=21 00000100:00000040:1.0:1788838368.133246:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788838368.133267:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1788838368.133270:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:1.0:1788838368.133275:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff607539050 x1875729135217280/t0(0) o400->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.133293:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3645:x1875729135217280:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788838368.133304:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135217280 00000100:00000040:1.0:1788838368.133308:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838368.133312:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838368.133331:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc70a80 x1875729135217280/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838368.133344:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838368.133348:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff607539050 x1875729135217280/t0(0) o400->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.133354:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3645:x1875729135217280:12345-0@lo:400:kworker.0 Request processed in 64us (5878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838368.133360:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1788838368.133362:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:1.0:1788838368.133367:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 20 00000100:00000040:1.0:1788838368.133434:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc73100 x1875729135217792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838393 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838368.133446:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838368.133451:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1788838368.133456:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc73100 x1875729135217792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838393 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.133462:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135217792:0@lo:8:kworker.0 00000100:00000040:1.0:1788838368.133474:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd6dc00 x1875729135218304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838393 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838368.133481:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788838368.133490:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1788838368.133495:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd6dc00 x1875729135218304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838393 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.133502:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135218304:0@lo:8:kworker.0 00000100:00000040:1.0:1788838368.133511:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc73100 x1875729135217792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838393 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838368.133523:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff604585000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00080000:3.0:1788838368.133654:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1788838368.133661:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:2.0:1788838368.137981:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc70a80 x1875729135217280/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.138001:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc70a80 x1875729135217280/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.138010:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135217280:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.138034:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:2.0:1788838368.138040:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc73800 x1875729135217920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.138049:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc73800 x1875729135217920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.138057:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135217920:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.138074:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:2.0:1788838368.138079:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd6e680 x1875729135218432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.138116:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd6e680 x1875729135218432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.138123:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135218432:0@lo:400:kworker.0 00000100:00000040:2.0:1788838368.138131:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc70a80 x1875729135217280/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.138145:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000100:00000040:2.0:1788838368.138155:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc73800 x1875729135217920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.138162:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff61942c000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788838368.138167:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd6e680 x1875729135218432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.138174:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff619428000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788838368.144324:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd6dc00 x1875729135218304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838393 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838368.144360:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff62c81b000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788838368.320462:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff607538850 x1875729116538368 msgsize 224 00000100:00100000:1.0:1788838368.320484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:1.0:1788838368.320486:0:3638:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788838368.320542:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f744a80 x1875729116538752 msgsize 520 00000100:00100000:1.0:1788838368.320547:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:1.0:1788838368.320575:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f744700 x1875729116538624 msgsize 224 00000100:00100000:1.0:1788838368.320579:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:1.0:1788838368.320607:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f746300 x1875729116538496 msgsize 224 00000100:00100000:1.0:1788838368.320612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:1.0:1788838368.320639:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f745180 x1875729116538880 msgsize 224 00000100:00100000:1.0:1788838368.320643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838368.320685:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116538624 00000100:00100000:1.0:1788838368.320698:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116538624 00000020:00000040:1.0:1788838368.320702:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc941e 00000020:00000040:1.0:1788838368.320710:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604960800 refcount=11 00000020:00000040:1.0:1788838368.320728:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00000040:1.0:1788838368.320762:0:66255:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1788838368.320822:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116538496 00000100:00100000:1.0:1788838368.320843:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116538496 00000020:00000040:1.0:1788838368.320845:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e27 00000020:00000040:1.0:1788838368.320849:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609269000 refcount=51 00000020:00000040:1.0:1788838368.320857:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00100000:1.0:1788838368.320891:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1492 00000100:00000040:1.0:1788838368.320896:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604960800 : new rpc_count 1 00000100:00000040:1.0:1788838368.320906:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f744700 x1875729116538624/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.320921:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116538624:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:1.0:1788838368.320957:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 77309411471, transno 0, xid 1875729116538624 00000100:00000040:1.0:1788838368.320970:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838368.320977:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321028:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321033:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f744700 x1875729116538624/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.321042:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116538624:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 124us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838368.321049:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1492 00000100:00000040:1.0:1788838368.321053:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604960800 : new rpc_count 0 00000020:00000040:1.0:1788838368.321065:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604960800 : new refcount 10 00000100:00100000:1.0:1788838368.321075:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1493 00000100:00000040:1.0:1788838368.321079:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609269000 : new rpc_count 1 00000100:00000040:1.0:1788838368.321083:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f746300 x1875729116538496/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.321100:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2407:x1875729116538496:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:1.0:1788838368.321114:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 124554051733, transno 0, xid 1875729116538496 00000100:00000040:1.0:1788838368.321128:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321132:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321149:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321154:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f746300 x1875729116538496/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.321163:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2407:x1875729116538496:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 65us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838368.321170:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1493 00000100:00000040:1.0:1788838368.321173:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609269000 : new rpc_count 0 00000020:00000040:1.0:1788838368.321178:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609269000 : new refcount 50 00000100:00100000:1.0:1788838368.321206:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116538752 00000100:00100000:1.0:1788838368.321210:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116538752 00000020:00000040:1.0:1788838368.321212:0:26212:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccca1b5 00000100:00100000:1.0:1788838368.321233:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116538880 00000100:00100000:1.0:1788838368.321236:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116538880 00000020:00000040:1.0:1788838368.321238:0:26212:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccca1bc 00000020:00000040:1.0:1788838368.321241:0:26212:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff50443a000 refcount=7 00000020:00000040:1.0:1788838368.321249:0:26212:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:1.0:1788838368.321258:0:26212:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788838368.321276:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2761 00000100:00000040:1.0:1788838368.321278:0:26212:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff50443a000 : new rpc_count 1 00000100:00000040:1.0:1788838368.321283:0:26212:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f745180 x1875729116538880/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.321294:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116538880:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:1.0:1788838368.321306:0:26212:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116538880 00000100:00000040:1.0:1788838368.321311:0:26212:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321315:0:26212:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321331:0:26212:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321346:0:26212:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f745180 x1875729116538880/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.321356:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116538880:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 64us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838368.321364:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2761 00000100:00000040:1.0:1788838368.321367:0:26212:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff50443a000 : new rpc_count 0 00000020:00000040:1.0:1788838368.321373:0:26212:0:(genops.c:879:class_export_put()) PUTting export ffff8ff50443a000 : new refcount 6 00000100:00100000:1.0:1788838368.321383:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6070 00000100:00000040:1.0:1788838368.321387:0:26212:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f744a80 x1875729116538752/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838388 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.321396:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2403:x1875729116538752:12345-192.168.203.30@tcp:8:kworker.0 00010000:00020000:1.0:1788838368.321423:0:26212:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1788838368.321438:0:26212:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321441:0:26212:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321444:0:26212:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321458:0:26212:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838368.321462:0:26212:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f744a80 x1875729116538752/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838388 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838368.321470:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2403:x1875729116538752:12345-192.168.203.30@tcp:8:kworker.0 Request processed in 74us (936us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838368.321476:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6070 00000100:00080000:1.0:1788838368.321494:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1788838368.321499:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00080000:1.0:1788838368.321502:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1788838368.321504:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00080000:1.0:1788838368.321507:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1788838368.321515:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00100000:3.0:1788838368.321790:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116538368 00000100:00100000:3.0:1788838368.321827:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116538368 00000020:00000040:3.0:1788838368.321830:0:94395:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9da2 00000020:00000040:3.0:1788838368.321834:0:94395:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff61d4bf800 refcount=10 00000100:00000040:3.0:1788838368.321853:0:94395:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838368.321880:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00000040:3.0:1788838368.321884:0:94395:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff61d4bf800 : new rpc_count 1 00000100:00000040:3.0:1788838368.321889:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff607538850 x1875729116538368/t0(0) o400->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838368.321900:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116538368:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:3.0:1788838368.321920:0:94395:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116538368 00000100:00000040:3.0:1788838368.321926:0:94395:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838368.321930:0:94395:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838368.321956:0:94395:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838368.321961:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff607538850 x1875729116538368/t0(0) o400->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:269/0 lens 224/224 e 0 to 0 dl 1788838379 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838368.321968:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607538850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116538368:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 70us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838368.321975:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00000040:3.0:1788838368.321978:0:94395:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff61d4bf800 : new rpc_count 0 00000020:00000040:3.0:1788838368.321986:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff61d4bf800 : new refcount 9 00010000:00010000:2.0:1788838368.450121:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1788838368.638895:0:94408:0:(genops.c:1210:class_import_get()) import ffff8ff619428000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788838368.638952:0:94408:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007ad9eaab] to pc [ptlrpcd_00_02+2] req@ffff8ff6329b6300 x1875729135218944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.639005:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135218944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.639035:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135218944:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1788838368.639077:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135218944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838384 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.639087:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.639159:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b4a80 x1875729135218944 msgsize 224 00000100:00100000:2.0:1788838368.639165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838368.639199:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135218944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.639239:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9402 usecs (10 jiffies) 00000100:00100000:2.0:1788838368.639304:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135218944 00000100:00100000:2.0:1788838368.639315:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135218944 00000020:00000040:2.0:1788838368.639319:0:8464:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e90 00000020:00000040:2.0:1788838368.639324:0:8464:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff632f51800 refcount=5 00000100:00000040:2.0:1788838368.639357:0:8464:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1788838368.639394:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00000040:2.0:1788838368.639399:0:8464:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff632f51800 : new rpc_count 1 00000100:00000040:2.0:1788838368.639405:0:8464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b4a80 x1875729135218944/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:269/0 lens 224/0 e 0 to 0 dl 1788838379 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.643189:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135218944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838368.643241:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:2.0:1788838368.643255:0:8464:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875729135218944 00000100:00000040:2.0:1788838368.643270:0:8464:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838368.643278:0:8464:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838368.643346:0:8464:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff6329b6300 x1875729135218944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838368.643393:0:8464:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838368.643400:0:8464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b4a80 x1875729135218944/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:269/0 lens 224/368 e 0 to 0 dl 1788838379 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.643410:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135218944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 242us (4249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838368.643620:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00000040:2.0:1788838368.643626:0:8464:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff632f51800 : new rpc_count 0 00000020:00000040:2.0:1788838368.643643:0:8464:0:(genops.c:879:class_export_put()) PUTting export ffff8ff632f51800 : new refcount 4 00000100:00000040:2.0:1788838368.643701:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:2.0:1788838368.643710:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b6300 x1875729135218944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1788838368.643737:0:3645:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1788838368.643741:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1788838368.643754:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135218944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838368.643763:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135218944:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1788838368.643774:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135218944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838368.643786:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff619428000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:2.0:1788838369.469403:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1788838369.661884:0:75689:0:(genops.c:1210:class_import_get()) import ffff8ff61942c000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788838369.661942:0:75689:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c3390f84] to pc [ptlrpcd_00_03+3] req@ffff8ff63f746d80 x1875729135219072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838369.662055:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff63f746d80 x1875729135219072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838369.662073:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135219072:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1788838369.662130:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff63f746d80 x1875729135219072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838385 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838369.662140:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838369.662197:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7f100 x1875729135219072 msgsize 224 00000100:00100000:3.0:1788838369.662202:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838369.662233:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff63f746d80 x1875729135219072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838385 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838369.662250:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5667 usecs (6 jiffies) 00000100:00100000:1.0:1788838369.662492:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135219072 00000100:00100000:1.0:1788838369.662504:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135219072 00000020:00000040:1.0:1788838369.662508:0:8465:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c82 00000020:00000040:1.0:1788838369.662514:0:8465:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a649800 refcount=5 00000100:00000040:1.0:1788838369.662553:0:8465:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1788838369.662734:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00000040:1.0:1788838369.662740:0:8465:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff63a649800 : new rpc_count 1 00000100:00000040:1.0:1788838369.662746:0:8465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7f100 x1875729135219072/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:270/0 lens 224/0 e 0 to 0 dl 1788838380 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838369.662762:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135219072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838369.663084:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1788838369.663101:0:8465:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1875729135219072 00000100:00000040:1.0:1788838369.663114:0:8465:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838369.663121:0:8465:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838369.667399:0:8465:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff63f746d80 x1875729135219072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838385 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838369.667771:0:8465:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:0.0:1788838369.667783:0:8465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7f100 x1875729135219072/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:270/0 lens 224/368 e 0 to 0 dl 1788838380 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838369.667794:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135219072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5036us (5595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838369.668094:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00000040:0.0:1788838369.668099:0:8465:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a649800 : new rpc_count 0 00000020:00000040:0.0:1788838369.668121:0:8465:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a649800 : new refcount 4 00000100:00000040:3.0:1788838369.673946:0:3646:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1788838369.673971:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff63f746d80 x1875729135219072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1788838369.673998:0:3646:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1788838369.674011:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1788838369.674025:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f746d80 x1875729135219072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838385 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838369.674034:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135219072:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1788838369.674049:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff63f746d80 x1875729135219072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838385 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838369.674063:0:3646:0:(genops.c:1223:class_import_put()) import ffff8ff61942c000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:0.0:1788838370.493142:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838371.537567:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838372.553155:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1788838373.245828:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1788838373.245849:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000100:00000040:0.0:1788838373.245886:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS req@ffff8ff5071cea00 x1875729135219200/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838373.245907:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000083f821b9] to pc [ptlrpcd_00_00+0] req@ffff8ff5071cea00 x1875729135219200/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.245942:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788838373.245955:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:0.0:1788838373.245991:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff5071cea00 x1875729135219200/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.246007:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135219200:0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.246046:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff5071cea00 x1875729135219200/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.246057:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838373.246123:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff60753ac50 x1875729135219200 msgsize 224 00000100:00100000:0.0:1788838373.246129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838373.246131:0:3644:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838373.246164:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff5071cea00 x1875729135219200/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.246186:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135219200 00000100:00100000:1.0:1788838373.246198:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135219200 00000020:00000040:1.0:1788838373.246201:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:1.0:1788838373.246208:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=21 00000020:00000040:0.0:1788838373.246215:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff501ab3000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1788838373.246229:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8ff5071cf800 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838373.246239:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:0.0:1788838373.246242:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000010c0329d] to pc [ptlrpcd_00_01+1] req@ffff8ff5071cf800 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.246270:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1788838373.246277:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:1.0:1788838373.246283:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:0.0:1788838373.246284:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff5071cf800 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.246293:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff60753ac50 x1875729135219200/t0(0) o400->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.246299:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135219328:0@lo:400:kworker.0 00000100:00100000:1.0:1788838373.246319:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3644:x1875729135219200:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.246325:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff5071cf800 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.246339:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:1.0:1788838373.246357:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135219200 00000100:00000040:0.0:1788838373.246360:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5071cdc00 x1875729135219328 msgsize 224 00000100:00000040:1.0:1788838373.246371:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00100000:0.0:1788838373.246377:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838373.246383:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838373.246400:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff5071cf800 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.246413:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff5071cea00 x1875729135219200/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.246415:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8025 usecs (9 jiffies) 00000100:00000040:1.0:1788838373.246437:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838373.246443:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff60753ac50 x1875729135219200/t0(0) o400->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.246453:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60753ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:3644:x1875729135219200:12345-0@lo:400:kworker.0 Request processed in 139us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838373.246462:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:1.0:1788838373.246465:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:1.0:1788838373.246476:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 20 00000020:00000040:2.0:1788838373.247209:0:75685:0:(genops.c:1210:class_import_get()) import ffff8ff6061da800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788838373.247237:0:75685:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007ad9eaab] to pc [ptlrpcd_00_02+2] req@ffff8ff6329b6300 x1875729135219456/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838373.247278:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:2.0:1788838373.247291:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135219456/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838373.247302:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135219456:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1788838373.247325:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135219456/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838373.247333:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838373.247361:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b5f80 x1875729135219456 msgsize 224 00000100:00100000:2.0:1788838373.247367:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838373.247391:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135219456/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838373.247406:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1491136 usecs (1492 jiffies) 00000100:00100000:2.0:1788838373.247441:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135219456 00000100:00100000:2.0:1788838373.247447:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135219456 00000020:00000040:2.0:1788838373.247449:0:8471:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e20 00000020:00000040:2.0:1788838373.247454:0:8471:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d6800 refcount=7 00000100:00000040:2.0:1788838373.247475:0:8471:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000020:00000040:1.0:1788838373.247622:0:94404:0:(genops.c:1210:class_import_get()) import ffff8ff6271d7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1788838373.247652:0:94404:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c3390f84] to pc [ptlrpcd_00_03+3] req@ffff8ff63f746d80 x1875729135219584/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.247677:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff63f746d80 x1875729135219584/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.247695:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63f746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135219584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788838373.247791:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4297 00000100:00000040:2.0:1788838373.247847:0:8471:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d6800 : new rpc_count 1 00000100:00000040:2.0:1788838373.247859:0:8471:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b5f80 x1875729135219456/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838373.247882:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135219456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788838373.247923:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00010000:00000040:2.0:1788838373.247937:0:8471:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875729135219456 00000100:00000040:2.0:1788838373.247947:0:8471:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838373.247953:0:8471:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838373.247999:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff63f746d80 x1875729135219584/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838373.248008:0:8471:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff6329b6300 x1875729135219456/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.248019:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838373.248054:0:8471:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838373.248060:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff8ff624ebf480 x1875729135219584 msgsize 224 00000100:00000040:2.0:1788838373.248062:0:8471:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b5f80 x1875729135219456/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:274/0 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.248078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838373.248097:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135219456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 224us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838373.248104:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4297 00000100:00000040:2.0:1788838373.248109:0:8471:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d6800 : new rpc_count 0 00000100:00000040:1.0:1788838373.248121:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff63f746d80 x1875729135219584/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838373.248123:0:8471:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d6800 : new refcount 6 00000100:00000040:1.0:1788838373.248142:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5230 usecs (6 jiffies) 00000100:00100000:2.0:1788838373.248143:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135219584 00000100:00100000:2.0:1788838373.248152:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135219584 00000020:00000040:2.0:1788838373.248156:0:8471:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e66 00000020:00000040:2.0:1788838373.248162:0:8471:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff624a94800 refcount=5 00000100:00000040:1.0:1788838373.248182:0:3646:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:1.0:1788838373.248191:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b6300 x1875729135219456/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838373.248193:0:8471:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000004:00000040:1.0:1788838373.248211:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352795 avail=317092 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023577 state=0: rc = 0 00000100:00000040:1.0:1788838373.248221:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135219456/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.248233:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135219456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788838373.248235:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4298 00000100:00000040:2.0:1788838373.248245:0:8471:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff624a94800 : new rpc_count 1 00000100:00000040:1.0:1788838373.248252:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135219456/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838373.248254:0:8471:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff624ebf480 x1875729135219584/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838373.248290:0:3646:0:(genops.c:1223:class_import_put()) import ffff8ff6061da800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:2.0:1788838373.248297:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135219584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838373.248324:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00010000:00000040:2.0:1788838373.248331:0:8471:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135219584 00000100:00000040:2.0:1788838373.248337:0:8471:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838373.248341:0:8471:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838373.248364:0:8471:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff63f746d80 x1875729135219584/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838373.249081:0:8471:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838373.249089:0:8471:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebf480 x1875729135219584/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:274/0 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838373.249098:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135219584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 806us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838373.249107:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4298 00000100:00000040:2.0:1788838373.249111:0:8471:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff624a94800 : new rpc_count 0 00000020:00000040:2.0:1788838373.249120:0:8471:0:(genops.c:879:class_export_put()) PUTting export ffff8ff624a94800 : new refcount 4 00000100:00000040:1.0:1788838373.254360:0:3646:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788838373.254385:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff63f746d80 x1875729135219584/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788838373.254406:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352889 avail=317186 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023681 state=0: rc = 0 00000100:00000040:1.0:1788838373.254422:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f746d80 x1875729135219584/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.254463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63f746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135219584:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788838373.254486:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff63f746d80 x1875729135219584/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838373.254515:0:3646:0:(genops.c:1223:class_import_put()) import ffff8ff6271d7800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1788838373.261321:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff5071cea00 x1875729135219200/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.261342:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071cea00 x1875729135219200/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.261352:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135219200:0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.261377:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff5071cea00 x1875729135219200/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838373.261392:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000100:00100000:0.0:1788838373.261461:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135219328 00000100:00100000:0.0:1788838373.261471:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135219328 00000020:00000040:0.0:1788838373.261475:0:75504:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fa8 00000020:00000040:0.0:1788838373.261480:0:75504:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639656800 refcount=5 00000020:00000040:0.0:1788838373.261496:0:75504:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00000040:0.0:1788838373.261607:0:75504:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1788838373.261651:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00000040:0.0:1788838373.261656:0:75504:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639656800 : new rpc_count 1 00000100:00000040:0.0:1788838373.261664:0:75504:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5071cdc00 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.261678:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135219328:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838373.261712:0:75504:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135219328 00000100:00000040:0.0:1788838373.261723:0:75504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:0.0:1788838373.261730:0:75504:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838373.261793:0:75504:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff5071cf800 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.261868:0:75504:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:0.0:1788838373.261874:0:75504:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071cdc00 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.261883:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135219328:12345-0@lo:400:kworker.0 Request processed in 207us (15520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838373.261891:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00000040:0.0:1788838373.261896:0:75504:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639656800 : new rpc_count 0 00000020:00000040:0.0:1788838373.261911:0:75504:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639656800 : new refcount 4 00000100:00000040:0.0:1788838373.262016:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1788838373.262022:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff5071cf800 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.262032:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071cf800 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.262039:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135219328:0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.262046:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff5071cf800 x1875729135219328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838373.262054:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff501ab3000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000020:00000040:0.0:1788838373.262070:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff5031c5000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1788838373.262101:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8ff5071cf800 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838373.262118:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000010c0329d] to pc [ptlrpcd_00_00+0] req@ffff8ff5071cf800 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838373.262136:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838373.262140:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788838373.262144:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838373.262149:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3762 00000100:00080000:0.0:1788838373.262154:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:0.0:1788838373.262156:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:0.0:1788838373.262159:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:0.0:1788838373.262162:0:36:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c5f 00000020:00000040:0.0:1788838373.262166:0:36:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604967800 refcount=4 00000100:00000040:0.0:1788838373.262169:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:0.0:1788838373.262171:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:0.0:1788838373.262173:0:36:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604967800 : new refcount 3 00000100:00080000:0.0:1788838373.262182:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ff604585000 using connection 192.168.203.130@tcp/0@lo 00000100:00000040:0.0:1788838373.262192:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff5071cf800 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.262219:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135219712:0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.262246:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff5071cf800 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.262253:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838373.262274:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5071cea00 x1875729135219712 msgsize 224 00000100:00100000:0.0:1788838373.262279:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838373.262298:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff5071cf800 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.262311:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7415 usecs (8 jiffies) 00000100:00100000:0.0:1788838373.262336:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135219712 00000100:00100000:0.0:1788838373.262341:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135219712 00000020:00000040:0.0:1788838373.262343:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3d07 00000020:00000040:0.0:1788838373.262345:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d2000 refcount=5 00000020:00000040:0.0:1788838373.262358:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00080000:3.0:1788838373.266420:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1788838373.266434:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00080000:3.0:1788838373.266443:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1788838373.266447:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00000040:0.0:1788838373.266697:0:66255:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1788838373.266770:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00000040:0.0:1788838373.266776:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d2000 : new rpc_count 1 00000100:00000040:0.0:1788838373.266786:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5071cea00 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.266821:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135219712:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838373.266855:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135219712 00000100:00000040:0.0:1788838373.266869:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:0.0:1788838373.266876:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838373.266950:0:66255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff5071cf800 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267024:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:0.0:1788838373.267030:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071cea00 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.267039:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135219712:12345-0@lo:400:kworker.0 Request processed in 225us (4763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838373.267048:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00000040:0.0:1788838373.267052:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d2000 : new rpc_count 0 00000020:00000040:0.0:1788838373.267066:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d2000 : new refcount 4 00000100:00000040:0.0:1788838373.267129:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1788838373.267138:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff5071cf800 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267150:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071cf800 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.267158:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135219712:0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.267166:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff5071cf800 x1875729135219712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838373.267178:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff5031c5000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000020:00000040:0.0:1788838373.267235:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff604585000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1788838373.267259:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff5071cf800 x1875729135219840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838373.267275:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000010c0329d] to pc [ptlrpcd_rcv+-1] req@ffff8ff5071cf800 x1875729135219840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1788838373.267302:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff61942c000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1788838373.267320:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff5071ce680 x1875729135219968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838373.267331:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008e5402c4] to pc [ptlrpcd_00_01+1] req@ffff8ff5071ce680 x1875729135219968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1788838373.267358:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff5071ce680 x1875729135219968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.267371:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135219968:0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.267402:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff5071ce680 x1875729135219968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267410:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838373.267434:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61d27dc00 x1875729135219968 msgsize 224 00000100:00100000:0.0:1788838373.267439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838373.267460:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff5071ce680 x1875729135219968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267473:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5693 usecs (6 jiffies) 00000020:00000040:0.0:1788838373.267509:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff632feb800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1788838373.267520:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8ff62bd2ed80 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838373.267531:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003f2ee32e] to pc [ptlrpcd_00_02+2] req@ffff8ff62bd2ed80 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788838373.267549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788838373.267554:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788838373.267558:0:36:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788838373.267563:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3762 00000100:00080000:0.0:1788838373.267574:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00000040:0.0:1788838373.267577:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:0.0:1788838373.267581:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:0.0:1788838373.267585:0:36:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e6d 00000020:00000040:0.0:1788838373.267590:0:36:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff602d1e800 refcount=4 00000100:00000040:0.0:1788838373.267593:0:36:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 50 to 0@lo 00000100:00000040:0.0:1788838373.267595:0:36:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 51 to 0@lo 00000020:00000040:0.0:1788838373.267597:0:36:0:(genops.c:879:class_export_put()) PUTting export ffff8ff602d1e800 : new refcount 3 00000100:00080000:0.0:1788838373.267600:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff62c81b000 using connection 192.168.203.130@tcp/0@lo 00000100:00000040:0.0:1788838373.267612:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2ed80 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.267622:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135220096:0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.267638:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2ed80 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267646:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838373.267667:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2d180 x1875729135220096 msgsize 224 00000100:00100000:0.0:1788838373.267672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838373.267686:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2ed80 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267698:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 135648 usecs (136 jiffies) 00000020:00000040:0.0:1788838373.267719:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff62c81b000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1788838373.267731:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd2f100 x1875729135220224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838373.267741:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004066007c] to pc [ptlrpcd_rcv+-1] req@ffff8ff62bd2f100 x1875729135220224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267749:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1788838373.267754:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff619428000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1788838373.267770:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff62bd2e680 x1875729135220352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838373.267779:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ea55f358] to pc [ptlrpcd_00_03+3] req@ffff8ff62bd2e680 x1875729135220352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267791:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788838373.267826:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1788838373.267832:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2e680 x1875729135220352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.267841:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135220352:0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.267857:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2e680 x1875729135220352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267865:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838373.267878:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2c380 x1875729135220352 msgsize 224 00000100:00100000:0.0:1788838373.267883:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838373.267898:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2e680 x1875729135220352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267909:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9285 usecs (10 jiffies) 00000020:00000040:0.0:1788838373.267921:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff6104d8000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1788838373.267931:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8ff62bd2f800 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838373.267939:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008c91458b] to pc [ptlrpcd_00_00+0] req@ffff8ff62bd2f800 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267959:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2f800 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.267967:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135220480:0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.267992:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2f800 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.267999:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838373.268014:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2fb80 x1875729135220480 msgsize 224 00000100:00100000:0.0:1788838373.268018:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838373.268031:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2f800 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.268041:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6200 usecs (7 jiffies) 00000100:00000040:0.0:1788838373.268061:0:36:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3772) 00000100:00100000:3.0:1788838373.268596:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135219968 00000100:00100000:1.0:1788838373.268597:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135220096 00000100:00100000:1.0:1788838373.268608:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135220096 00000100:00100000:3.0:1788838373.268609:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135219968 00000020:00000040:1.0:1788838373.268612:0:67312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9faf 00000020:00000040:3.0:1788838373.268613:0:26213:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c82 00000020:00000040:3.0:1788838373.268620:0:26213:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a649800 refcount=5 00000020:00000040:1.0:1788838373.268620:0:67312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609254800 refcount=5 00000020:00000040:3.0:1788838373.268638:0:26213:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:1.0:1788838373.268650:0:67312:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:3.0:1788838373.268660:0:26213:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788838373.268691:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135220480 00000100:00100000:3.0:1788838373.268692:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135220352 00000100:00100000:1.0:1788838373.268696:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135220480 00000100:00100000:3.0:1788838373.268699:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135220352 00000020:00000040:1.0:1788838373.268700:0:67312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fb6 00000020:00000040:3.0:1788838373.268703:0:26213:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e90 00000020:00000040:1.0:1788838373.268704:0:67312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609257000 refcount=5 00000020:00000040:3.0:1788838373.268709:0:26213:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff632f51800 refcount=5 00000100:00100000:1.0:1788838373.268734:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00000040:1.0:1788838373.268739:0:67312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609254800 : new rpc_count 1 00000100:00000040:1.0:1788838373.268744:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2d180 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.268758:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135220096:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788838373.268779:0:67312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135220096 00000100:00000040:1.0:1788838373.268787:0:67312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838373.268792:0:67312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00080000:0.0:1788838373.268825:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788838373.268831:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:1.0:1788838373.268850:0:67312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bd2ed80 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.268882:0:67312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838373.268887:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2d180 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.268897:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135220096:12345-0@lo:400:kworker.0 Request processed in 141us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838373.268905:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00000040:1.0:1788838373.268909:0:67312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609254800 : new rpc_count 0 00000020:00000040:1.0:1788838373.268919:0:67312:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609254800 : new refcount 4 00000100:00100000:1.0:1788838373.268929:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00000040:1.0:1788838373.268932:0:67312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609257000 : new rpc_count 1 00000100:00000040:0.0:1788838373.268932:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788838373.268940:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2fb80 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838373.268944:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2ed80 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.268957:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135220480:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788838373.268976:0:67312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135220480 00000100:00000040:1.0:1788838373.268981:0:67312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838373.268984:0:67312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838373.269000:0:67312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bd2f800 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.269019:0:67312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838373.269023:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2fb80 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.269031:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135220480:12345-0@lo:400:kworker.0 Request processed in 78us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838373.269036:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00000040:1.0:1788838373.269038:0:67312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609257000 : new rpc_count 0 00000020:00000040:1.0:1788838373.269045:0:67312:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609257000 : new refcount 4 00000100:00000040:1.0:1788838373.269065:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff5071cf800 x1875729135219840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.269076:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff5071cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135219840:0@lo:8:kworker.0 00000100:00000040:1.0:1788838373.269096:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff5071cf800 x1875729135219840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838398 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.269103:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838373.269118:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff624ebce00 x1875729135219840 msgsize 520 00000100:00100000:1.0:1788838373.269122:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838373.269138:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff5071cf800 x1875729135219840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838398 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.269149:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5811 usecs (6 jiffies) 00000100:00000040:1.0:1788838373.269157:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2f100 x1875729135220224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.269167:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135220224:0@lo:8:kworker.0 00000100:00000040:1.0:1788838373.269192:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2f100 x1875729135220224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838398 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.269198:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838373.269214:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff624ebdf80 x1875729135220224 msgsize 520 00000100:00100000:1.0:1788838373.269218:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838373.269230:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2f100 x1875729135220224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838398 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.269239:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8498 usecs (9 jiffies) 00000100:00000040:1.0:1788838373.269285:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788838373.269290:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2f800 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.269298:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2f800 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.269306:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135220480:0@lo:400:kworker.0 00000100:00000040:1.0:1788838373.269312:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2f800 x1875729135220480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838373.269321:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff6104d8000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00100000:3.0:1788838373.272622:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135219840 00000100:00100000:3.0:1788838373.272643:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135219840 00000020:00000040:3.0:1788838373.272647:0:26213:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c66 00000100:00100000:3.0:1788838373.272698:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135220224 00000100:00100000:3.0:1788838373.272703:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135220224 00000020:00000040:3.0:1788838373.272705:0:26213:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e82 00000100:00100000:3.0:1788838373.272743:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00000040:3.0:1788838373.272750:0:26213:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff63a649800 : new rpc_count 1 00000100:00000040:3.0:1788838373.272765:0:26213:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61d27dc00 x1875729135219968/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838373.272812:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135219968:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788838373.272847:0:26213:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1875729135219968 00000100:00000040:3.0:1788838373.272861:0:26213:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838373.272868:0:26213:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838373.272936:0:26213:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff5071ce680 x1875729135219968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838373.273034:0:26213:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:3.0:1788838373.273041:0:26213:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61d27dc00 x1875729135219968/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.273046:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763 00000100:00000040:1.0:1788838373.273055:0:26208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff632f51800 : new rpc_count 1 00000100:00100000:3.0:1788838373.273061:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d27dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135219968:12345-0@lo:400:kworker.0 Request processed in 270us (5622us total) trans 0 rc 0/0 00000100:00000040:1.0:1788838373.273067:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2c380 x1875729135220352/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838373.273074:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000100:00000040:3.0:1788838373.273081:0:26213:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a649800 : new rpc_count 0 00000100:00100000:1.0:1788838373.273094:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135220352:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788838373.273109:0:26208:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875729135220352 00000100:00000040:1.0:1788838373.273114:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838373.273118:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:3.0:1788838373.273142:0:26213:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a649800 : new refcount 4 00000100:00000040:1.0:1788838373.273145:0:26208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bd2e680 x1875729135220352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838373.273160:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6071 00000100:00000040:3.0:1788838373.273169:0:26213:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff624ebce00 x1875729135219840/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838393 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.273179:0:26208:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00100000:3.0:1788838373.273182:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3642:x1875729135219840:12345-0@lo:8:kworker.0 00000100:00000040:1.0:1788838373.273188:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2c380 x1875729135220352/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.273199:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135220352:12345-0@lo:400:kworker.0 Request processed in 113us (5318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838373.273205:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763 00000100:00000040:1.0:1788838373.273209:0:26208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff632f51800 : new rpc_count 0 00010000:00020000:3.0:1788838373.273210:0:26213:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000040:1.0:1788838373.273218:0:26208:0:(genops.c:879:class_export_put()) PUTting export ffff8ff632f51800 : new refcount 4 00000100:00000040:3.0:1788838373.273225:0:26213:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838373.273229:0:26213:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00100000:1.0:1788838373.273233:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6072 00000100:00000040:3.0:1788838373.273238:0:26213:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838373.273241:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff624ebdf80 x1875729135220224/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838393 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.273251:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3642:x1875729135220224:12345-0@lo:8:kworker.0 00000100:00000040:3.0:1788838373.273260:0:26213:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8ff5071cf800 x1875729135219840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838398 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00020000:1.0:1788838373.273265:0:26208:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1788838373.273275:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 53 to 0@lo 00000100:00000040:1.0:1788838373.273279:0:26208:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 53 to 0@lo 00000100:00000040:1.0:1788838373.273283:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838373.273289:0:26213:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838373.273301:0:26213:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebce00 x1875729135219840/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838393 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.273304:0:26208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8ff62bd2f100 x1875729135220224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838398 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838373.273326:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3642:x1875729135219840:12345-0@lo:8:kworker.0 Request processed in 144us (4204us total) trans 0 rc -19/-19 00000100:00000040:1.0:1788838373.273334:0:26208:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00100000:3.0:1788838373.273337:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6071 00000100:00000040:1.0:1788838373.273341:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebdf80 x1875729135220224/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838393 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.273352:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3642:x1875729135220224:12345-0@lo:8:kworker.0 Request processed in 100us (4135us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788838373.273359:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6072 00000100:00000040:3.0:1788838373.273425:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff5071cf800 x1875729135219840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838398 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838373.273439:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838373.273444:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1788838373.273449:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071cf800 x1875729135219840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838398 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838373.273457:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135219840:0@lo:8:kworker.0 00000100:00000040:3.0:1788838373.273470:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2f100 x1875729135220224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838398 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838373.273478:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788838373.273481:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1788838373.273485:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2f100 x1875729135220224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838398 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838373.273493:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135220224:0@lo:8:kworker.0 00000100:00000040:3.0:1788838373.273509:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff5071cf800 x1875729135219840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838398 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838373.273530:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff604585000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1788838373.273542:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2f100 x1875729135220224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838398 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838373.273550:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff62c81b000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1788838373.273597:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1788838373.273604:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff5071ce680 x1875729135219968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838373.273614:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071ce680 x1875729135219968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838373.273621:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff5071ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135219968:0@lo:400:kworker.0 00000100:00000040:3.0:1788838373.273627:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff5071ce680 x1875729135219968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838373.273636:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff61942c000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1788838373.273723:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2ed80 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.273734:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135220096:0@lo:400:kworker.0 00000100:00000040:0.0:1788838373.273742:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2ed80 x1875729135220096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838373.273752:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff632feb800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1788838373.275121:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:1.0:1788838373.275141:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2e680 x1875729135220352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.275167:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2e680 x1875729135220352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.275175:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135220352:0@lo:400:kworker.0 00000100:00000040:1.0:1788838373.275183:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2e680 x1875729135220352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838373.275195:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff619428000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788838373.437919:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7e680 x1875729116539392 msgsize 520 00000100:00100000:3.0:1788838373.437943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838373.444520:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116539392 00000100:00100000:0.0:1788838373.444560:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116539392 00000020:00000040:0.0:1788838373.444570:0:26220:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccca1b5 00000100:00100000:0.0:1788838373.444773:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6073 00000100:00000040:0.0:1788838373.444788:0:26210:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7e680 x1875729116539392/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838393 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.444827:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2403:x1875729116539392:12345-192.168.203.30@tcp:8:kworker.0 00010000:00020000:0.0:1788838373.444874:0:26210:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.30@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1788838373.444910:0:26210:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838373.444914:0:26210:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838373.444921:0:26210:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838373.444985:0:26210:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838373.444991:0:26210:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7e680 x1875729116539392/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838393 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.445001:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2403:x1875729116539392:12345-192.168.203.30@tcp:8:kworker.0 Request processed in 176us (7084us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788838373.445010:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6073 00000100:00000040:0.0:1788838373.445100:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff607539450 x1875729116539008 msgsize 224 00000100:00100000:0.0:1788838373.445106:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:0.0:1788838373.445109:0:3637:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838373.445934:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2ed80 x1875729116539264 msgsize 224 00000100:00100000:0.0:1788838373.445945:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:0.0:1788838373.445969:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2f480 x1875729116539136 msgsize 224 00000100:00100000:0.0:1788838373.445973:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:0.0:1788838373.446368:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2e300 x1875729116539520 msgsize 224 00000100:00100000:0.0:1788838373.446375:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838373.446414:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116539008 00000100:00100000:0.0:1788838373.446423:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116539008 00000020:00000040:0.0:1788838373.446426:0:94395:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9da2 00000020:00000040:0.0:1788838373.446432:0:94395:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff61d4bf800 refcount=10 00000100:00000040:0.0:1788838373.446461:0:94395:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788838373.446490:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00000040:0.0:1788838373.446495:0:94395:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff61d4bf800 : new rpc_count 1 00000100:00000040:0.0:1788838373.446513:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff607539450 x1875729116539008/t0(0) o400->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.446545:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff607539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116539008:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:0.0:1788838373.446571:0:94395:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116539008 00000100:00000040:0.0:1788838373.446584:0:94395:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838373.446590:0:94395:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838373.446631:0:94395:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838373.446637:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff607539450 x1875729116539008/t0(0) o400->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.446646:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff607539450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116539008:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 104us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838373.446654:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00000040:0.0:1788838373.446657:0:94395:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff61d4bf800 : new rpc_count 0 00000020:00000040:0.0:1788838373.446674:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff61d4bf800 : new refcount 9 00000100:00100000:0.0:1788838373.446709:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116539264 00000100:00100000:0.0:1788838373.446713:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116539264 00000020:00000040:0.0:1788838373.446715:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc941e 00000020:00000040:0.0:1788838373.446718:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604960800 refcount=11 00000020:00000040:0.0:1788838373.446730:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00000100:00000040:0.0:1788838373.446747:0:66255:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1788838373.446768:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116539136 00000100:00100000:0.0:1788838373.446771:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116539136 00000020:00000040:0.0:1788838373.446773:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e27 00000020:00000040:0.0:1788838373.446776:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609269000 refcount=51 00000020:00000040:0.0:1788838373.446784:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00100000:0.0:1788838373.446834:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1498 00000100:00000040:0.0:1788838373.446837:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604960800 : new rpc_count 1 00000100:00000040:0.0:1788838373.446842:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2ed80 x1875729116539264/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.446869:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116539264:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:0.0:1788838373.446886:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 77309411471, transno 0, xid 1875729116539264 00000100:00000040:0.0:1788838373.446893:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838373.446896:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838373.446911:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838373.446916:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2ed80 x1875729116539264/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.446923:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116539264:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 59us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838373.446929:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1498 00000100:00000040:0.0:1788838373.446932:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604960800 : new rpc_count 0 00000020:00000040:0.0:1788838373.446938:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604960800 : new refcount 10 00000100:00100000:0.0:1788838373.446948:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1499 00000100:00000040:0.0:1788838373.446950:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609269000 : new rpc_count 1 00000100:00000040:0.0:1788838373.446954:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2f480 x1875729116539136/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.446964:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2407:x1875729116539136:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:0.0:1788838373.449446:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 124554051733, transno 0, xid 1875729116539136 00000100:00000040:0.0:1788838373.449496:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838373.449529:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838373.449623:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838373.449636:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2f480 x1875729116539136/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.449660:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2407:x1875729116539136:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2695us (3687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838373.449695:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1499 00000100:00000040:0.0:1788838373.449699:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609269000 : new rpc_count 0 00000020:00000040:0.0:1788838373.449731:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609269000 : new refcount 50 00000100:00100000:0.0:1788838373.449843:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116539520 00000100:00100000:0.0:1788838373.449863:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116539520 00000020:00000040:0.0:1788838373.449866:0:26209:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccca1bc 00000020:00000040:0.0:1788838373.449871:0:26209:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff50443a000 refcount=7 00000020:00000040:0.0:1788838373.449898:0:26209:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:0.0:1788838373.449928:0:26209:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1788838373.450388:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2764 00000100:00000040:2.0:1788838373.450394:0:26206:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff50443a000 : new rpc_count 1 00000100:00000040:2.0:1788838373.450402:0:26206:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2e300 x1875729116539520/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838373.450418:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116539520:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:2.0:1788838373.450449:0:26206:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116539520 00000100:00000040:2.0:1788838373.450466:0:26206:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838373.450470:0:26206:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838373.450509:0:26206:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838373.450515:0:26206:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2e300 x1875729116539520/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:274/0 lens 224/224 e 0 to 0 dl 1788838384 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838373.450525:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116539520:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 111us (4155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838373.450532:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2764 00000100:00000040:2.0:1788838373.450536:0:26206:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff50443a000 : new rpc_count 0 00000020:00000040:2.0:1788838373.450545:0:26206:0:(genops.c:879:class_export_put()) PUTting export ffff8ff50443a000 : new refcount 6 00000100:00080000:0.0:1788838373.451712:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788838373.451724:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00080000:0.0:1788838373.451732:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1788838373.451736:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 14 - evictor 00000100:00080000:0.0:1788838373.451739:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1788838373.451742:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - evictor 00010000:00010000:0.0:1788838373.566586:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788838373.692328:0:96964:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788838373.692334:0:96964:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788838373.692335:0:96964:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788838373.693574:0:96964:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ff50b02b000 00000020:01000004:1.0:1788838373.693599:0:96964:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788838373.694226:0:96964:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788838373.694254:0:96964:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ff608224d28) 00000020:00000040:1.0:1788838373.694265:0:96964:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50b02d000 with handle 0x88da08396cccad5b to hash 00000020:00000040:1.0:1788838373.694275:0:96964:0:(genops.c:879:class_export_put()) PUTting export ffff8ff50b02d000 : new refcount 1 00000020:00000040:1.0:1788838373.695478:0:96964:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osd (ffff8ff608224d28) now 2 - obd_device_list 00000020:00000080:1.0:1788838373.695490:0:96964:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000020:00000040:2.0:1788838373.758290:0:94408:0:(genops.c:1210:class_import_get()) import ffff8ff619428000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788838373.758351:0:94408:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007ad9eaab] to pc [ptlrpcd_00_01+1] req@ffff8ff6329b6300 x1875729135220608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.758450:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:1.0:1788838373.758474:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135220608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838373.758490:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135220608:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1788838373.758542:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135220608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838389 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.758552:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838373.758612:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff624ebfb80 x1875729135220608 msgsize 224 00000100:00100000:1.0:1788838373.758618:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838373.758653:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135220608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838389 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838373.758691:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9280 usecs (10 jiffies) 00000100:00100000:2.0:1788838373.758773:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135220608 00000100:00100000:2.0:1788838373.758785:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135220608 00000020:00000040:2.0:1788838373.758788:0:8464:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e90 00000020:00000040:2.0:1788838373.758794:0:8464:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff632f51800 refcount=5 00000100:00000040:2.0:1788838373.758852:0:8464:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1788838373.758895:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00000040:2.0:1788838373.758900:0:8464:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff632f51800 : new rpc_count 1 00000100:00000040:2.0:1788838373.758906:0:8464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff624ebfb80 x1875729135220608/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:274/0 lens 224/0 e 0 to 0 dl 1788838384 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838373.758920:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135220608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788838373.758961:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:2.0:1788838373.758983:0:8464:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875729135220608 00000100:00000040:2.0:1788838373.758996:0:8464:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838373.759002:0:8464:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838373.759026:0:8464:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff6329b6300 x1875729135220608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838373.759065:0:8464:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838373.759071:0:8464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebfb80 x1875729135220608/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:274/0 lens 224/368 e 0 to 0 dl 1788838384 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838373.759080:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135220608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838373.759087:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00000040:2.0:1788838373.759090:0:8464:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff632f51800 : new rpc_count 0 00000020:00000040:2.0:1788838373.759103:0:8464:0:(genops.c:879:class_export_put()) PUTting export ffff8ff632f51800 : new refcount 4 00000100:00000040:0.0:1788838373.759462:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:0.0:1788838373.759472:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b6300 x1875729135220608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788838373.759484:0:3643:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1788838373.759487:0:3643:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1788838373.759496:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135220608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838373.759513:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135220608:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788838373.759521:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135220608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838373.759533:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff619428000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:0.0:1788838374.589465:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1788838374.781103:0:75689:0:(genops.c:1210:class_import_get()) import ffff8ff61942c000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788838374.781156:0:75689:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000027c9811c] to pc [ptlrpcd_00_02+2] req@ffff8ff624ebc380 x1875729135220736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.781321:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:3.0:1788838374.781344:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff624ebc380 x1875729135220736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.781358:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135220736:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1788838374.781401:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff624ebc380 x1875729135220736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838390 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.781411:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.781469:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7e300 x1875729135220736 msgsize 224 00000100:00100000:3.0:1788838374.781475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.781520:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff624ebc380 x1875729135220736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.781538:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5698 usecs (6 jiffies) 00000100:00100000:1.0:1788838374.781665:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135220736 00000100:00100000:1.0:1788838374.781677:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135220736 00000020:00000040:1.0:1788838374.781681:0:8465:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c82 00000020:00000040:1.0:1788838374.781686:0:8465:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a649800 refcount=5 00000100:00000040:1.0:1788838374.781717:0:8465:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1788838374.781756:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00000040:1.0:1788838374.781761:0:8465:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff63a649800 : new rpc_count 1 00000100:00000040:1.0:1788838374.781767:0:8465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7e300 x1875729135220736/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:275/0 lens 224/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.781780:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135220736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788838374.781840:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1788838374.781854:0:8465:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1875729135220736 00000100:00000040:1.0:1788838374.781867:0:8465:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838374.781873:0:8465:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838374.781907:0:8465:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff624ebc380 x1875729135220736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.781932:0:8465:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838374.781937:0:8465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7e300 x1875729135220736/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:275/0 lens 224/368 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.781946:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875729135220736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 169us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838374.781954:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00000040:1.0:1788838374.781975:0:8465:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a649800 : new rpc_count 0 00000020:00000040:1.0:1788838374.781989:0:8465:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a649800 : new refcount 4 00000100:00000040:1.0:1788838374.782029:0:3646:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:1.0:1788838374.782036:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff624ebc380 x1875729135220736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788838374.782058:0:3646:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:1.0:1788838374.782062:0:3646:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:1.0:1788838374.782071:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebc380 x1875729135220736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.782078:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135220736:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1788838374.782086:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff624ebc380 x1875729135220736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838374.782105:0:3646:0:(genops.c:1223:class_import_put()) import ffff8ff61942c000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000001:00000040:2.0:1788838374.797008:0:96964:0:(osd_compat.c:234:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:2.0:1788838374.807559:0:96964:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788838374.811216:0:96964:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788838374.811285:0:96964:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788838374.811317:0:96964:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788838374.811343:0:96964:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788838374.811368:0:96964:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788838374.811394:0:96964:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788838374.812136:0:96964:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:2.0:1788838374.812431:0:96964:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osd (ffff8ff608224d28) now 3 - setup 00000020:00000080:2.0:1788838374.812439:0:96964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788838374.812455:0:96964:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000040:2.0:1788838374.812464:0:96964:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50d538800 with handle 0x88da08396cccad62 to hash 00000020:00000040:2.0:1788838374.812473:0:96964:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osd (ffff8ff608224d28) now 4 - export 00000020:00000040:2.0:1788838374.812477:0:96964:0:(genops.c:879:class_export_put()) PUTting export ffff8ff50d538800 : new refcount 1 00000020:00000080:2.0:1788838374.812480:0:96964:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88da08396cccad62 00000020:00000040:2.0:1788838374.812484:0:96964:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad62 00000020:00000040:2.0:1788838374.812486:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff50d538800 refcount=2 00000020:01000004:2.0:1788838374.812504:0:96964:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788838374.812545:0:96964:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788838374.812549:0:96964:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788838374.812556:0:96964:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788838374.812596:0:96964:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788838374.812601:0:96964:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:2.0:1788838374.814585:0:96964:0:(genops.c:868:class_export_get()) GET export ffff8ff50b02d000 refcount=2 00000040:00000040:2.0:1788838374.814595:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff508ba4a80 : new refcount 2 00000040:00000040:2.0:1788838374.820355:0:96964:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff508ba4a80 : new refcount 1 00000040:01000000:2.0:1788838374.820366:0:96964:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 10000000:00000040:2.0:1788838374.820371:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff508ba4a80 : new refcount 2 10000000:00000040:2.0:1788838374.820374:0:96964:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff508ba4a80 : new refcount 1 00000020:00000040:2.0:1788838374.820378:0:96964:0:(obd_config.c:995:class_incref()) incref MGC192.168.203.130@tcp (ffff8ff610244d28) now 6 - mgc_fs 00000020:01000004:2.0:1788838374.820424:0:96964:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788838374.820429:0:96964:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788838374.820431:0:96964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788838374.820432:0:96964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838374.820433:0:96964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838374.820435:0:96964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838374.820436:0:96964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838374.820437:0:96964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838374.820439:0:96964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838374.820440:0:96964:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788838374.820445:0:96964:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788838374.820446:0:96964:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788838374.820448:0:96964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788838374.820449:0:96964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838374.820450:0:96964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838374.820451:0:96964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838374.820452:0:96964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838374.820453:0:96964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838374.820454:0:96964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838374.820455:0:96964:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:2.0:1788838374.820465:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 10000000:01000000:2.0:1788838374.820508:0:96964:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:2.0:1788838374.820535:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135220864/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.820564:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135220864:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1788838374.820603:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135220864/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.820612:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.821433:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5034b8850 x1875729135220864 msgsize 4848 00000100:00100000:2.0:1788838374.821443:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.821445:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788838374.821532:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff6329b6300 x1875729135220864/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.821574:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff626ae9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788838374.823770:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135220864 00000100:00100000:1.0:1788838374.823792:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135220864 00000020:00000040:1.0:1788838374.824149:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:1.0:1788838374.824158:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=21 00000100:00000040:1.0:1788838374.824204:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788838374.824288:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:1.0:1788838374.824307:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:1.0:1788838374.824317:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5034b8850 x1875729135220864/t0(0) o253->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 4848/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.824333:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:96964:x1875729135220864:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788838374.824389:0:94398:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788838374.824392:0:94398:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788838374.824403:0:94398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:1.0:1788838374.824942:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135220864 00000100:00000040:1.0:1788838374.825262:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838374.825272:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838374.825359:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff8ff6329b6300 x1875729135220864/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.825470:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838374.825478:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5034b8850 x1875729135220864/t0(0) o253->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 4848/4768 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.825489:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:96964:x1875729135220864:12345-0@lo:253:mount.lustre.0 Request processed in 1158us (4055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838374.825507:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:1.0:1788838374.825511:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:1.0:1788838374.825528:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 20 00000100:00000040:3.0:1788838374.826402:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b6300 x1875729135220864/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.826419:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135220864/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.826445:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135220864:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1788838374.826458:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135220864/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788838374.826472:0:96964:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788838374.826476:0:96964:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788838374.826478:0:96964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788838374.826480:0:96964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838374.826481:0:96964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838374.826483:0:96964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838374.826484:0:96964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838374.826486:0:96964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788838374.826487:0:96964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838374.826499:0:96964:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:3.0:1788838374.826503:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135220864/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.826517:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000020:01000004:3.0:1788838374.826546:0:96964:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ff50b02b000 from lustre-OST0000 10000000:01000000:3.0:1788838374.826593:0:96964:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788838374.826597:0:96964:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:3.0:1788838374.826608:0:96964:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff8ff6104ebc00) refs 5 10000000:01000000:3.0:1788838374.826613:0:96964:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ff610244d28 local copy 00000020:00000040:3.0:1788838374.826619:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff60148f800 refcount=2 00010000:00010000:3.0:1788838374.826630:0:96964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca398 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1788838374.826664:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff6096baf00 : new refcount 2 10000000:00000040:3.0:1788838374.826667:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff508ba4a80 : new refcount 2 10000000:00000040:3.0:1788838374.826670:0:96964:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.130@tcp: copy local log lustre-sptlrpc 00000020:00000040:3.0:1788838374.826732:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.826739:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.826787:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7f800 x1875729135220992/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.826836:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135220992:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788838374.826867:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7f800 x1875729135220992/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.826876:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.826916:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5034bb450 x1875729135220992 msgsize 512 00000100:00100000:3.0:1788838374.826922:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.826924:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.827098:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7f800 x1875729135220992/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.827135:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505aec900 going to sleep for 11 seconds 00000100:00100000:1.0:1788838374.829308:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135220992 00000100:00100000:1.0:1788838374.829329:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135220992 00000020:00000040:1.0:1788838374.829333:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:1.0:1788838374.829340:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=21 00000100:00000040:1.0:1788838374.829383:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788838374.829435:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:1.0:1788838374.829442:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:1.0:1788838374.829451:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5034bb450 x1875729135220992/t0(0) o501->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 512/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.829466:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:96964:x1875729135220992:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1788838374.829511:0:94398:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:1.0:1788838374.829515:0:94398:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:1.0:1788838374.829571:0:94398:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:1.0:1788838374.829577:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135220992 00000100:00000040:1.0:1788838374.829590:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838374.829598:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838374.829678:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8ff611a7f800 x1875729135220992/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.829708:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838374.829713:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5034bb450 x1875729135220992/t0(0) o501->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 512/272 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.829723:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+21:96964:x1875729135220992:12345-0@lo:501:mount.lustre.0 Request processed in 259us (2805us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788838374.829731:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:1.0:1788838374.829734:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:1.0:1788838374.829748:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 20 00000100:00000040:3.0:1788838374.831978:0:96964:0:(client.c:1510:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff8ff611a7f800 x1875729135220992/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.831998:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7f800 x1875729135220992/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.832008:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7f800 x1875729135220992/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.832016:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135220992:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788838374.832027:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7f800 x1875729135220992/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.832043:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.832049:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7f800 x1875729135220992/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.832060:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 10000000:01000000:3.0:1788838374.832075:0:96964:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788838374.832157:0:96964:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:3.0:1788838374.832164:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff60148f800 refcount=3 00010000:00010000:3.0:1788838374.832172:0:96964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca398 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.832184:0:96964:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396ccca398 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838374.832238:0:96964:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ff50b02b000 10000000:01000000:3.0:1788838374.832245:0:96964:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:3.0:1788838374.832251:0:96964:0:(genops.c:868:class_export_get()) GET export ffff8ff605447800 refcount=18 10000000:00000040:3.0:1788838374.832256:0:96964:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff8ff6396df200) refs 4 10000000:01000000:3.0:1788838374.832258:0:96964:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788838374.832262:0:96964:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:3.0:1788838374.832265:0:96964:0:(genops.c:868:class_export_get()) GET export ffff8ff605447800 refcount=19 10000000:01000000:3.0:1788838374.832270:0:96964:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788838374.832273:0:96964:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:3.0:1788838374.832280:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00010000:00000040:3.0:1788838374.832316:0:96964:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff60b5cf200 count: 8 00000020:00000040:3.0:1788838374.832326:0:96964:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50712ce00 with handle 0x88da08396cccad69 to hash 00010000:00010000:3.0:1788838374.832335:0:96964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396cccad69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.832342:0:96964:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396cccad69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.832355:0:96964:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396cccad69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788838374.832375:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7f800 x1875729135221120/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.832400:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221120:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1788838374.832432:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7f800 x1875729135221120/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.832440:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.832506:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5034ba850 x1875729135221120 msgsize 328 00000100:00100000:3.0:1788838374.832511:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.832514:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.832549:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7f800 x1875729135221120/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.832584:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505aec900 going to sleep for 11 seconds 00000100:00100000:2.0:1788838374.832742:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135221120 00000100:00100000:2.0:1788838374.832752:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135221120 00000020:00000040:2.0:1788838374.832755:0:94392:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:2.0:1788838374.832759:0:94392:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=21 00000100:00000040:2.0:1788838374.832787:0:94392:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788838374.832842:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1788838374.832847:0:94392:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:2.0:1788838374.832852:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5034ba850 x1875729135221120/t0(0) o101->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.832865:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+21:96964:x1875729135221120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788838374.832882:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1788838374.832893:0:94392:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff605587e00 count: 10 00000020:00000040:2.0:1788838374.832900:0:94392:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50718ea00 with handle 0x88da08396cccad70 to hash 00010000:00010000:2.0:1788838374.832904:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50718ea00/0x88da08396cccad70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396cccad69 expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788838374.832912:0:94392:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8ff639712000 : new locks_count 16 00000020:00000040:2.0:1788838374.832922:0:94392:0:(genops.c:868:class_export_get()) GET export ffff8ff639712000 refcount=22 00010000:00000040:2.0:1788838374.832948:0:94392:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8ff605587e00) refcount = 10 00010000:00000040:2.0:1788838374.832952:0:94392:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1788838374.832956:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff601529400/0x88da08396ccca398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca391 expref: 22 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788838374.832964:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca367 expref: 22 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788838374.832982:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50f3ef800/0x88da08396ccca360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca359 expref: 22 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788838374.832989:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff60148e400/0x88da08396ccca352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca34b expref: 22 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788838374.832996:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50f3ee200/0x88da08396ccca344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca33d expref: 22 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788838374.833003:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff60148e600/0x88da08396ccca336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca32f expref: 22 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788838374.833010:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca321 expref: 22 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788838374.833021:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50f3eec00/0x88da08396ccca31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d003 expref: 9 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788838374.833027:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50f3ef600/0x88da08396ccca313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cffc expref: 9 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838374.833033:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50718ea00/0x88da08396cccad70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396cccad69 expref: 22 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838374.833046:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50718ea00/0x88da08396cccad70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396cccad69 expref: 22 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838374.833064:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50718ea00, rc 0) 00010000:00000040:2.0:1788838374.833069:0:94392:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135221120 00000100:00000040:2.0:1788838374.833081:0:94392:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838374.833087:0:94392:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.833107:0:94392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8ff611a7f800 x1875729135221120/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.833142:0:94392:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838374.833149:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5034ba850 x1875729135221120/t0(0) o101->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/344 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.833159:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:96964:x1875729135221120:12345-0@lo:101:mount.lustre.0 Request processed in 295us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.833165:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1788838374.833168:0:94392:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:2.0:1788838374.833180:0:94392:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 21 00000100:00000040:3.0:1788838374.833375:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7f800 x1875729135221120/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.833386:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7f800 x1875729135221120/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.833393:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221120:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1788838374.833400:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7f800 x1875729135221120/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.833412:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50712ce00 refcount=4 00010000:00000040:3.0:1788838374.833418:0:96964:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8ff50712ce00, remote cookie: 0x88da08396cccad70, flags: 0x0 00010000:00000040:3.0:1788838374.833423:0:96964:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8ff60b5cf200) refcount = 8 00010000:00000040:3.0:1788838374.833425:0:96964:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1788838374.833428:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca398 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.833436:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff60148e800/0x88da08396ccca367 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca36e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.833454:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff601528800/0x88da08396ccca359 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca360 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.833460:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff601529000/0x88da08396ccca34b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca352 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.833467:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff601529800/0x88da08396ccca33d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca344 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.833473:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee400/0x88da08396ccca32f lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca336 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.833481:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca321 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca328 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.833488:0:96964:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396cccad69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccad70 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.833506:0:96964:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396cccad69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396cccad70 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788838374.833516:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7f800 x1875729135221120/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.833530:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 10000000:00000040:3.0:1788838374.833537:0:96964:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff8ff611fd2000) refs 2 00000020:00000040:3.0:1788838374.833540:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50712ce00 refcount=3 10000000:00000040:3.0:1788838374.833575:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff6096baf00 : new refcount 2 10000000:00000040:3.0:1788838374.833579:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff508ba4a80 : new refcount 2 10000000:00000040:3.0:1788838374.833583:0:96964:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.130@tcp: copy local log lustre-OST0000 00000040:00080000:3.0:1788838374.833843:0:96964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788838374.834632:0:96964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838374.838147:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788838374.838237:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788838374.838265:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788838374.838281:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788838374.838295:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788838374.838310:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788838374.838345:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788838374.838352:0:96964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:3.0:1788838374.838454:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.838465:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.838535:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7f800 x1875729135221248/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.838552:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221248:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788838374.838587:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7f800 x1875729135221248/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.838596:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.838658:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5034ba050 x1875729135221248 msgsize 512 00000100:00100000:3.0:1788838374.838664:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.838667:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.838854:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7f800 x1875729135221248/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.838893:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505aec6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838374.840202:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135221248 00000100:00100000:2.0:1788838374.840222:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135221248 00000020:00000040:2.0:1788838374.840226:0:94393:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:2.0:1788838374.840233:0:94393:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=22 00000100:00000040:2.0:1788838374.840274:0:94393:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788838374.840318:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1788838374.840323:0:94393:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:2.0:1788838374.840332:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5034ba050 x1875729135221248/t0(0) o501->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 512/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.840346:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:96964:x1875729135221248:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1788838374.840379:0:94393:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:2.0:1788838374.840384:0:94393:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:2.0:1788838374.840511:0:94393:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00000020:00000040:2.0:1788838374.840524:0:94393:0:(genops.c:868:class_export_get()) GET export ffff8ff639712000 refcount=23 00000020:00000040:2.0:1788838374.840528:0:94393:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 22 00010000:00000040:2.0:1788838374.840533:0:94393:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135221248 00000100:00000040:2.0:1788838374.840548:0:94393:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838374.840555:0:94393:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.840618:0:94393:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8ff611a7f800 x1875729135221248/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.840665:0:94393:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838374.840670:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5034ba050 x1875729135221248/t0(0) o501->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 512/272 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.840680:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:96964:x1875729135221248:12345-0@lo:501:mount.lustre.0 Request processed in 336us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.840688:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1788838374.840692:0:94393:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:2.0:1788838374.840704:0:94393:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 21 00000100:00000040:0.0:1788838374.840902:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7f800 x1875729135221248/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.840914:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7f800 x1875729135221248/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.840923:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221248:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1788838374.840934:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7f800 x1875729135221248/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838374.840948:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000100:00000040:0.0:1788838374.840954:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7f800 x1875729135221248/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838374.840965:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000020:00000040:0.0:1788838374.840992:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:0.0:1788838374.840999:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:0.0:1788838374.841029:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2d880 x1875729135221376/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.841041:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221376:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1788838374.841083:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2d880 x1875729135221376/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.841092:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.841115:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5034bac50 x1875729135221376 msgsize 272 00000100:00100000:0.0:1788838374.841120:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838374.841122:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838374.841145:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff62bd2d880 x1875729135221376/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.841172:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff504937b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788838374.841316:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135221376 00000100:00100000:2.0:1788838374.841322:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135221376 00000020:00000040:2.0:1788838374.841324:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:2.0:1788838374.841328:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=22 00000100:00000040:2.0:1788838374.841344:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788838374.841372:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:2.0:1788838374.841375:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:2.0:1788838374.841380:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5034bac50 x1875729135221376/t0(0) o503->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.841393:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:96964:x1875729135221376:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1788838374.841421:0:94398:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:2.0:1788838374.841471:0:94398:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:2.0:1788838374.841474:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135221376 00000100:00000040:2.0:1788838374.841488:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838374.841502:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.841525:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff8ff62bd2d880 x1875729135221376/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.841557:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838374.841562:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5034bac50 x1875729135221376/t0(0) o503->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/8416 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.841571:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:96964:x1875729135221376:12345-0@lo:503:mount.lustre.0 Request processed in 180us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.841578:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:2.0:1788838374.841581:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:2.0:1788838374.841587:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 21 00000100:00000040:3.0:1788838374.841667:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2d880 x1875729135221376/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.841678:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2d880 x1875729135221376/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.841685:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221376:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1788838374.841702:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2d880 x1875729135221376/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.841714:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2d880 x1875729135221376/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.841740:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.841747:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000040:00080000:3.0:1788838374.842304:0:96964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1788838374.842379:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.842386:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.842412:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7dc00 x1875729135221504/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.842423:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221504:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788838374.842459:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7dc00 x1875729135221504/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.842467:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.842514:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5034b8050 x1875729135221504 msgsize 272 00000100:00100000:3.0:1788838374.842520:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.842522:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.842544:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7dc00 x1875729135221504/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.842558:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505aec900 going to sleep for 11 seconds 00000100:00100000:2.0:1788838374.842869:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135221504 00000100:00100000:2.0:1788838374.842877:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135221504 00000020:00000040:2.0:1788838374.842880:0:94393:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:2.0:1788838374.842885:0:94393:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=22 00000100:00000040:2.0:1788838374.842903:0:94393:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788838374.842930:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1788838374.842934:0:94393:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:2.0:1788838374.842940:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5034b8050 x1875729135221504/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.842953:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:96964:x1875729135221504:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1788838374.842991:0:94393:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:2.0:1788838374.843552:0:94393:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:2.0:1788838374.843560:0:94393:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135221504 00000100:00000040:2.0:1788838374.843572:0:94393:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838374.843578:0:94393:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.843615:0:94393:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8ff611a7dc00 x1875729135221504/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.843667:0:94393:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838374.843673:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5034b8050 x1875729135221504/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/8472 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.843682:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:96964:x1875729135221504:12345-0@lo:502:mount.lustre.0 Request processed in 731us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.843690:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1788838374.843693:0:94393:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:2.0:1788838374.843705:0:94393:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 21 00000100:00000040:0.0:1788838374.843834:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7dc00 x1875729135221504/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.843847:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7dc00 x1875729135221504/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.843855:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221504:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1788838374.843866:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7dc00 x1875729135221504/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.843880:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7dc00 x1875729135221504/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838374.843909:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:0.0:1788838374.843918:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000040:00080000:0.0:1788838374.844230:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788838374.844267:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788838374.844283:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788838374.844299:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788838374.844314:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788838374.844329:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788838374.844344:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788838374.844359:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788838374.844375:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788838374.844389:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788838374.844403:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788838374.844425:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:0.0:1788838374.844433:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:0.0:1788838374.844439:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:0.0:1788838374.844468:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2ca80 x1875729135221632/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.844482:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221632:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1788838374.844537:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2ca80 x1875729135221632/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.844546:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.844577:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5034bb050 x1875729135221632 msgsize 272 00000100:00100000:0.0:1788838374.844582:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838374.844584:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838374.844609:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff62bd2ca80 x1875729135221632/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.844641:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff5049373c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838374.844832:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135221632 00000100:00100000:2.0:1788838374.844840:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135221632 00000020:00000040:2.0:1788838374.844844:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:2.0:1788838374.844848:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=22 00000100:00000040:2.0:1788838374.844871:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788838374.844894:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:2.0:1788838374.844898:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:2.0:1788838374.844903:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5034bb050 x1875729135221632/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.844916:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:96964:x1875729135221632:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1788838374.844946:0:94398:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:2.0:1788838374.845060:0:94398:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:2.0:1788838374.845065:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135221632 00000100:00000040:2.0:1788838374.845074:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:2.0:1788838374.845078:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.845105:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8ff62bd2ca80 x1875729135221632/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.845141:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:2.0:1788838374.845146:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5034bb050 x1875729135221632/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/8472 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.845161:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:96964:x1875729135221632:12345-0@lo:502:mount.lustre.0 Request processed in 247us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.845168:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:2.0:1788838374.845171:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:2.0:1788838374.845179:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 21 00000100:00000040:1.0:1788838374.845284:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2ca80 x1875729135221632/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.845295:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2ca80 x1875729135221632/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.845303:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221632:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1788838374.845311:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2ca80 x1875729135221632/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.845323:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2ca80 x1875729135221632/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838374.845347:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:1.0:1788838374.845356:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000040:00080000:1.0:1788838374.845407:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788838374.845419:0:96964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:1.0:1788838374.845784:0:96964:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff6096baf00 : new refcount 1 00000020:00000040:1.0:1788838374.845789:0:96964:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:0.0:1788838374.847434:0:96968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788838374.847448:0:96968:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788838374.847456:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788838374.847459:0:96968:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788838374.847467:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788838374.847488:0:96968:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ff503ca0000) 00000020:00000040:0.0:1788838374.847508:0:96968:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff627f98000 with handle 0x88da08396cccad77 to hash 00000020:00000040:0.0:1788838374.847519:0:96968:0:(genops.c:879:class_export_put()) PUTting export ffff8ff627f98000 : new refcount 1 00000020:00000040:0.0:1788838374.847538:0:96968:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 2 - obd_device_list 00000020:00000080:0.0:1788838374.847546:0:96968:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:0.0:1788838374.847554:0:96968:0:(obd_config.c:1949:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:0.0:1788838374.847556:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788838374.847645:0:96968:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff50b02b000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788838374.847654:0:96968:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000040:0.0:1788838374.847658:0:96968:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff627f98800 with handle 0x88da08396cccad7e to hash 00000020:00000040:0.0:1788838374.847662:0:96968:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osd (ffff8ff608224d28) now 5 - export 00000020:00000040:0.0:1788838374.847666:0:96968:0:(genops.c:879:class_export_put()) PUTting export ffff8ff627f98800 : new refcount 1 00000020:00000080:0.0:1788838374.847668:0:96968:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x88da08396cccad7e 00000020:00000040:0.0:1788838374.847671:0:96968:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad7e 00000020:00000040:0.0:1788838374.847673:0:96968:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff627f98800 refcount=2 00010000:00010000:0.0:1788838374.852921:0:96968:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:0.0:1788838374.852942:0:96968:0:(obd_cksum.c:32:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 523, crc32c 4647, adler 575, t10ip512 1859, t10ip4k 2509, t10crc512 355, t10crc4k 739 00002000:00000040:0.0:1788838374.853091:0:96968:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:0.0:1788838374.853194:0:96968:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969455: rc = 0 00000001:00000040:0.0:1788838374.853199:0:96968:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:0.0:1788838374.853208:0:96968:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294969444, last_xid = 1875729134627456, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:0.0:1788838374.853213:0:96968:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294969444 srv lr: 4294969455 lx: 1875729134627456 gen 0 00000020:00000040:0.0:1788838374.853221:0:96968:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff627f9d800 with handle 0x88da08396cccad85 to hash 00000020:00000040:0.0:1788838374.853253:0:96968:0:(genops.c:868:class_export_get()) GET export ffff8ff627f9d800 refcount=3 00000020:00000040:0.0:1788838374.853260:0:96968:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 3 - export 00000001:00000040:0.0:1788838374.853264:0:96968:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:0.0:1788838374.853268:0:96968:0:(genops.c:879:class_export_put()) PUTting export ffff8ff627f9d800 : new refcount 2 00000001:00000040:0.0:1788838374.853273:0:96968:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294969473, last_xid = 1875729135205632, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:0.0:1788838374.853278:0:96968:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294969473 srv lr: 4294969455 lx: 1875729135205632 gen 0 00000020:00000040:0.0:1788838374.853284:0:96968:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff63a64b800 with handle 0x88da08396cccad8c to hash 00000020:00000040:0.0:1788838374.853297:0:96968:0:(genops.c:868:class_export_get()) GET export ffff8ff63a64b800 refcount=3 00000020:00000040:0.0:1788838374.853300:0:96968:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 4 - export 00000001:00000040:0.0:1788838374.853302:0:96968:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:0.0:1788838374.853304:0:96968:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a64b800 : new refcount 2 00000001:00000040:0.0:1788838374.853308:0:96968:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = efc561ba-875e-4857-b79b-9bd7023bd57c, last_transno = 4294969477, last_xid = 1875729116504448, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:0.0:1788838374.853312:0:96968:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: efc561ba-875e-4857-b79b-9bd7023bd57c idx: 2 lr: 4294969477 srv lr: 4294969455 lx: 1875729116504448 gen 0 00000020:00000040:0.0:1788838374.853318:0:96968:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff604961800 with handle 0x88da08396cccad93 to hash 00000020:00000040:0.0:1788838374.853330:0:96968:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=3 00000020:00000040:0.0:1788838374.853332:0:96968:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 5 - export 00000001:00000040:0.0:1788838374.853341:0:96968:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID 'efc561ba-875e-4857-b79b-9bd7023bd57c' added, generation 0 00000020:00000040:0.0:1788838374.853343:0:96968:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 2 00000001:00000040:0.0:1788838374.853349:0:96968:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:0.0:1788838374.853352:0:96968:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:0.0:1788838374.853360:0:96968:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294969477 00000001:00000040:0.0:1788838374.853419:0:96968:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969477: rc = 0 00000001:00000040:0.0:1788838374.853436:0:96968:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969477: rc = 0 00002000:00000040:0.0:1788838374.853453:0:96968:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:0.0:1788838374.853510:0:96968:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:0.0:1788838374.853571:0:96968:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:0.0:1788838374.853580:0:96968:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:0.0:1788838374.853587:0:96968:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:0.0:1788838374.853633:0:96968:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:0.0:1788838374.853643:0:96968:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:0.0:1788838374.853694:0:96968:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:0.0:1788838374.853713:0:96968:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:0.0:1788838374.853764:0:96968:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:0.0:1788838374.854139:0:96968:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:0.0:1788838374.854183:0:96968:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:0.0:1788838374.854445:0:96968:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:0.0:1788838374.854730:0:96968:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:2.0:1788838374.858886:0:96968:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 6 - setup 00000020:00000080:2.0:1788838374.858896:0:96968:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788838374.858918:0:96968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838374.858927:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838374.858930:0:96968:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788838374.858934:0:96968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788838374.858938:0:96968:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788838374.858939:0:96968:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788838374.858941:0:96968:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788838374.858943:0:96968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788838374.858945:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838374.858947:0:96968:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788838374.858949:0:96968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838374.858953:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838374.858954:0:96968:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788838374.858957:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788838374.858959:0:96968:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788838374.858962:0:96968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838374.858964:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838374.858965:0:96968:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788838374.861074:0:96968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838374.861094:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838374.861097:0:96968:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788838374.861109:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788838374.861156:0:96968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838374.861160:0:96968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838374.861162:0:96968:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788838374.861174:0:96968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788838374.861468:0:96964:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788838374.861534:0:96964:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:0.0:1788838374.861561:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50712ce00 refcount=3 00010000:00010000:0.0:1788838374.861571:0:96964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396cccad69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccad70 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.861585:0:96964:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396cccad69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccad70 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788838374.861605:0:96964:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ff50b02b000 from 1 10000000:01000000:0.0:1788838374.861609:0:96964:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:0.0:1788838374.861618:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00010000:00000040:0.0:1788838374.861652:0:96964:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff611e0d500 count: 4 00000020:00000040:0.0:1788838374.861662:0:96964:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff509c6c000 with handle 0x88da08396cccad9a to hash 00010000:00010000:0.0:1788838374.861671:0:96964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c000/0x88da08396cccad9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.861679:0:96964:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c000/0x88da08396cccad9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.861693:0:96964:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c000/0x88da08396cccad9a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788838374.861724:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2ca80 x1875729135221760/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.861741:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221760:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1788838374.861779:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2ca80 x1875729135221760/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.861790:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.861873:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5034b9c50 x1875729135221760 msgsize 328 00000100:00100000:0.0:1788838374.861879:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838374.861882:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838374.861910:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff62bd2ca80 x1875729135221760/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.861945:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788838374.862886:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135221760 00000100:00100000:3.0:1788838374.862901:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135221760 00000020:00000040:3.0:1788838374.862905:0:94393:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:3.0:1788838374.863035:0:94393:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=22 00000100:00000040:3.0:1788838374.863075:0:94393:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838374.863117:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:3.0:1788838374.863122:0:94393:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:3.0:1788838374.863140:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5034b9c50 x1875729135221760/t0(0) o101->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.863155:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+22:96964:x1875729135221760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838374.863174:0:94393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1788838374.863186:0:94393:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff608f3cb00 count: 5 00000020:00000040:3.0:1788838374.863194:0:94393:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50712c600 with handle 0x88da08396cccada1 to hash 00010000:00010000:3.0:1788838374.863200:0:94393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712c600/0x88da08396cccada1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396cccad9a expref: -99 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.863210:0:94393:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8ff639712000 : new locks_count 17 00000020:00000040:3.0:1788838374.863213:0:94393:0:(genops.c:868:class_export_get()) GET export ffff8ff639712000 refcount=23 00010000:00000040:3.0:1788838374.863238:0:94393:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff8ff608f3cb00) refcount = 5 00010000:00000040:3.0:1788838374.863242:0:94393:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1788838374.863246:0:94393:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff504626200/0x88da08396ccc9f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f46 expref: 23 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.863254:0:94393:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff626ab9c00/0x88da08396ccc9f23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9f1c expref: 23 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.863262:0:94393:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50a2e9800/0x88da08396ccc9eac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9ea5 expref: 23 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.863274:0:94393:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff504627e00/0x88da08396ccc9db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cf93 expref: 9 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.863281:0:94393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712c600/0x88da08396cccada1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396cccad9a expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.863294:0:94393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712c600/0x88da08396cccada1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396cccad9a expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.863315:0:94393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c600, rc 0) 00010000:00000040:3.0:1788838374.863320:0:94393:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135221760 00000100:00000040:3.0:1788838374.863331:0:94393:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838374.863337:0:94393:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.863379:0:94393:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8ff62bd2ca80 x1875729135221760/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.863408:0:94393:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:3.0:1788838374.863414:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5034b9c50 x1875729135221760/t0(0) o101->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/344 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.863422:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:96964:x1875729135221760:12345-0@lo:101:mount.lustre.0 Request processed in 270us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838374.863429:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:3.0:1788838374.863433:0:94393:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:3.0:1788838374.863445:0:94393:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 22 00000100:00000040:0.0:1788838374.863866:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2ca80 x1875729135221760/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.863894:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2ca80 x1875729135221760/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.863902:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221760:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1788838374.863913:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2ca80 x1875729135221760/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838374.863926:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff509c6c000 refcount=4 00010000:00000040:0.0:1788838374.863933:0:96964:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8ff509c6c000, remote cookie: 0x88da08396cccada1, flags: 0x0 00010000:00000040:0.0:1788838374.863939:0:96964:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff8ff611e0d500) refcount = 4 00010000:00000040:0.0:1788838374.863942:0:96964:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788838374.863946:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8000/0x88da08396ccc9f46 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f4d expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.863954:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff626ab8e00/0x88da08396ccc9f1c lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9f23 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.863961:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4400/0x88da08396ccc9ea5 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccc9eac expref: -99 pid: 94386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.864330:0:96964:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c000/0x88da08396cccad9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccada1 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.864345:0:96964:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c000/0x88da08396cccad9a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396cccada1 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788838374.864357:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2ca80 x1875729135221760/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838374.864368:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 10000000:00000040:0.0:1788838374.864380:0:96964:0:(mgc_request.c:108:config_log_get()) log params (ffff8ff611fd2e00) refs 2 00000020:00000040:0.0:1788838374.864390:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff509c6c000 refcount=3 10000000:00000040:0.0:1788838374.864432:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff6096baf00 : new refcount 2 10000000:00000040:0.0:1788838374.864436:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff508ba4a80 : new refcount 2 10000000:00000040:0.0:1788838374.864439:0:96964:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.130@tcp: copy local log params 00000040:00080000:0.0:1788838374.864669:0:96964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788838374.866380:0:96964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788838374.866672:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788838374.866701:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788838374.866721:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788838374.866727:0:96964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:0.0:1788838374.866845:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:0.0:1788838374.866856:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:0.0:1788838374.867761:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2ca80 x1875729135221888/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.867784:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221888:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1788838374.868145:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2ca80 x1875729135221888/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.868158:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.868221:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5034b9850 x1875729135221888 msgsize 504 00000100:00100000:0.0:1788838374.868227:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838374.868229:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838374.868260:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff62bd2ca80 x1875729135221888/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.868297:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838374.870174:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135221888 00000100:00100000:3.0:1788838374.870193:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135221888 00000020:00000040:3.0:1788838374.870198:0:94392:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:3.0:1788838374.870206:0:94392:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=23 00000100:00000040:3.0:1788838374.870241:0:94392:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838374.870287:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:3.0:1788838374.870293:0:94392:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:3.0:1788838374.870302:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5034b9850 x1875729135221888/t0(0) o501->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 504/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.870318:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:96964:x1875729135221888:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1788838374.870351:0:94392:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:3.0:1788838374.870355:0:94392:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:3.0:1788838374.870464:0:94392:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:3.0:1788838374.870471:0:94392:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135221888 00000100:00000040:3.0:1788838374.870485:0:94392:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838374.870502:0:94392:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.870568:0:94392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8ff62bd2ca80 x1875729135221888/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.870613:0:94392:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:3.0:1788838374.870619:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5034b9850 x1875729135221888/t0(0) o501->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 504/272 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.870629:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:96964:x1875729135221888:12345-0@lo:501:mount.lustre.0 Request processed in 314us (2406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838374.870639:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:3.0:1788838374.870643:0:94392:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:3.0:1788838374.870656:0:94392:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 22 00000100:00000040:2.0:1788838374.870838:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2ca80 x1875729135221888/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.870851:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2ca80 x1875729135221888/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.870860:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135221888:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788838374.870871:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2ca80 x1875729135221888/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.870886:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000100:00000040:2.0:1788838374.870892:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2ca80 x1875729135221888/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.870903:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000020:00000040:2.0:1788838374.870921:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:2.0:1788838374.870927:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:2.0:1788838374.870955:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135222016/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.871036:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222016:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1788838374.871077:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135222016/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.871086:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.871108:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5034b8450 x1875729135222016 msgsize 272 00000100:00100000:2.0:1788838374.871112:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.871115:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788838374.871132:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff6329b6300 x1875729135222016/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.871160:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60614c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838374.871236:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135222016 00000100:00100000:3.0:1788838374.871242:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135222016 00000020:00000040:3.0:1788838374.871244:0:94393:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:3.0:1788838374.871247:0:94393:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=23 00000100:00000040:3.0:1788838374.871264:0:94393:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838374.871292:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:3.0:1788838374.871296:0:94393:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:3.0:1788838374.871300:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5034b8450 x1875729135222016/t0(0) o503->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.871312:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5034b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:96964:x1875729135222016:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1788838374.871341:0:94393:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:3.0:1788838374.871387:0:94393:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:3.0:1788838374.871392:0:94393:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135222016 00000100:00000040:3.0:1788838374.871399:0:94393:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838374.871411:0:94393:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.871432:0:94393:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff8ff6329b6300 x1875729135222016/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.871450:0:94393:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:3.0:1788838374.871455:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5034b8450 x1875729135222016/t0(0) o503->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/8416 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.871464:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5034b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+23:96964:x1875729135222016:12345-0@lo:503:mount.lustre.0 Request processed in 154us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838374.871472:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:3.0:1788838374.871475:0:94393:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:3.0:1788838374.871482:0:94393:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 22 00000100:00000040:2.0:1788838374.872101:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b6300 x1875729135222016/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.872121:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135222016/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.872130:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222016:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1788838374.872139:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135222016/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.872153:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135222016/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.872168:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:2.0:1788838374.872176:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000040:00080000:2.0:1788838374.872686:0:96964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1788838374.872763:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:2.0:1788838374.872769:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:2.0:1788838374.872827:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135222144/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.872840:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222144:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788838374.872878:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135222144/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.872887:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.872922:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff509ea8850 x1875729135222144 msgsize 272 00000100:00100000:2.0:1788838374.872928:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.872930:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788838374.872955:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff6329b6300 x1875729135222144/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.873151:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135222144 00000100:00100000:3.0:1788838374.873159:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135222144 00000020:00000040:3.0:1788838374.873162:0:94392:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:3.0:1788838374.873167:0:94392:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=23 00000100:00000040:3.0:1788838374.873188:0:94392:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838374.873215:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:3.0:1788838374.873220:0:94392:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:3.0:1788838374.873224:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff509ea8850 x1875729135222144/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.873237:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:96964:x1875729135222144:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1788838374.873267:0:94392:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:3.0:1788838374.873319:0:94392:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:3.0:1788838374.873324:0:94392:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135222144 00000100:00000040:3.0:1788838374.873335:0:94392:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838374.873340:0:94392:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.873363:0:94392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8ff6329b6300 x1875729135222144/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.873393:0:94392:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:3.0:1788838374.873397:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff509ea8850 x1875729135222144/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/8472 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.873405:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509ea8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:96964:x1875729135222144:12345-0@lo:502:mount.lustre.0 Request processed in 170us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838374.873413:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:3.0:1788838374.873416:0:94392:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:3.0:1788838374.873428:0:94392:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 22 00000100:00100000:2.0:1788838374.873759:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60614c540 going to sleep for 11 seconds 00000100:00000040:2.0:1788838374.873785:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b6300 x1875729135222144/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.873839:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135222144/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.873846:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222144:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788838374.873855:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135222144/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.873869:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135222144/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.873884:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:2.0:1788838374.873893:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000040:00080000:2.0:1788838374.874330:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788838374.874368:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788838374.874384:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788838374.874398:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788838374.874412:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:2.0:1788838374.874420:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:2.0:1788838374.874425:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:2.0:1788838374.874455:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135222272/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.874466:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222272:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788838374.874508:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135222272/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.874515:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.874547:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff509ea9050 x1875729135222272 msgsize 272 00000100:00100000:2.0:1788838374.874552:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.874554:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788838374.874580:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff6329b6300 x1875729135222272/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.874602:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff60614c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788838374.874701:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135222272 00000100:00100000:3.0:1788838374.874709:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135222272 00000020:00000040:3.0:1788838374.874712:0:94395:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:3.0:1788838374.874717:0:94395:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=23 00000100:00000040:3.0:1788838374.874740:0:94395:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838374.874770:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:3.0:1788838374.874774:0:94395:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:3.0:1788838374.874780:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff509ea9050 x1875729135222272/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.874792:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:96964:x1875729135222272:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1788838374.874859:0:94395:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:3.0:1788838374.874925:0:94395:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:3.0:1788838374.874930:0:94395:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135222272 00000100:00000040:3.0:1788838374.874940:0:94395:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838374.874946:0:94395:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.875033:0:94395:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8ff6329b6300 x1875729135222272/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.875055:0:94395:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:3.0:1788838374.875061:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff509ea9050 x1875729135222272/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/8472 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.875076:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509ea9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:96964:x1875729135222272:12345-0@lo:502:mount.lustre.0 Request processed in 286us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838374.875084:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:3.0:1788838374.875087:0:94395:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:3.0:1788838374.875098:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 22 00000100:00000040:2.0:1788838374.875354:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b6300 x1875729135222272/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.875364:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135222272/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.875372:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222272:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788838374.875379:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135222272/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.875393:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135222272/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.875409:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:2.0:1788838374.875415:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000040:00080000:2.0:1788838374.875457:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788838374.875470:0:96964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:2.0:1788838374.875876:0:96964:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff6096baf00 : new refcount 1 00000020:00000040:2.0:1788838374.875882:0:96964:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:2.0:1788838374.876662:0:96972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838374.876678:0:96972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838374.876681:0:96972:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788838374.876690:0:96972:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff50b02b000 00000020:00000080:2.0:1788838374.876693:0:96972:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788838374.876706:0:96972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838374.876709:0:96972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838374.876710:0:96972:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788838374.876713:0:96972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788838374.876716:0:96972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838374.876717:0:96972:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788838374.876721:0:96972:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ff50b02b000 00000020:00000080:2.0:1788838374.876732:0:96972:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788838374.877867:0:96972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788838374.877883:0:96972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788838374.877885:0:96972:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788838374.877889:0:96972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:3.0:1788838374.880398:0:96964:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788838374.880464:0:96964:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:3.0:1788838374.880501:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff509c6c000 refcount=3 00010000:00010000:3.0:1788838374.880512:0:96964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c000/0x88da08396cccad9a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccada1 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.880524:0:96964:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff509c6c000/0x88da08396cccad9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccada1 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788838374.880614:0:96964:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788838374.880618:0:96964:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ff50b02b000 10000000:01000000:3.0:1788838374.880622:0:96964:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ff50b02b000 10000000:01000000:3.0:1788838374.880627:0:96964:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:3.0:1788838374.880632:0:96964:0:(genops.c:868:class_export_get()) GET export ffff8ff605447800 refcount=20 10000000:01000000:3.0:1788838374.880638:0:96964:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ff50b02b000 from 1 10000000:01000000:3.0:1788838374.880641:0:96964:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:3.0:1788838374.880650:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00010000:00000040:3.0:1788838374.880681:0:96964:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff60b5cf200 count: 9 00000020:00000040:3.0:1788838374.880692:0:96964:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50712cc00 with handle 0x88da08396cccada8 to hash 00010000:00010000:3.0:1788838374.880701:0:96964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396cccada8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.880710:0:96964:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396cccada8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.880742:0:96964:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396cccada8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788838374.880772:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7ca80 x1875729135222400/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.880790:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222400:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1788838374.880894:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7ca80 x1875729135222400/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.880904:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.880960:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff509eab850 x1875729135222400 msgsize 328 00000100:00100000:3.0:1788838374.880965:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.881042:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.881068:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7ca80 x1875729135222400/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.881105:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135222400 00000100:00100000:3.0:1788838374.881114:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135222400 00000020:00000040:3.0:1788838374.881117:0:94392:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:3.0:1788838374.881121:0:94392:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=23 00000100:00000040:3.0:1788838374.881147:0:94392:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838374.881190:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:3.0:1788838374.881194:0:94392:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:3.0:1788838374.881200:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff509eab850 x1875729135222400/t0(0) o101->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.881214:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:96964:x1875729135222400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788838374.881232:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1788838374.881243:0:94392:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff605587e00 count: 11 00000020:00000040:3.0:1788838374.881249:0:94392:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50712d800 with handle 0x88da08396cccadaf to hash 00010000:00010000:3.0:1788838374.881263:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712d800/0x88da08396cccadaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396cccada8 expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881270:0:94392:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8ff639712000 : new locks_count 18 00000020:00000040:3.0:1788838374.881273:0:94392:0:(genops.c:868:class_export_get()) GET export ffff8ff639712000 refcount=24 00010000:00000040:3.0:1788838374.881298:0:94392:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8ff605587e00) refcount = 11 00010000:00000040:3.0:1788838374.881302:0:94392:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1788838374.881305:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50718ea00/0x88da08396cccad70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396cccad69 expref: 24 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881313:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff601529400/0x88da08396ccca398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca391 expref: 24 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881320:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff509c6c400/0x88da08396ccca36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca367 expref: 24 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881327:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50f3ef800/0x88da08396ccca360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca359 expref: 24 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881335:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff60148e400/0x88da08396ccca352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca34b expref: 24 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881342:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50f3ee200/0x88da08396ccca344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca33d expref: 24 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881349:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff60148e600/0x88da08396ccca336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca32f expref: 24 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881356:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff509c6d000/0x88da08396ccca328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccca321 expref: 24 pid: 94395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881368:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50f3eec00/0x88da08396ccca31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d003 expref: 9 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881387:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50f3ef600/0x88da08396ccca313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cffc expref: 9 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.881394:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712d800/0x88da08396cccadaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396cccada8 expref: 24 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.881408:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712d800/0x88da08396cccadaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396cccada8 expref: 24 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.881418:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d800, rc 0) 00010000:00000040:3.0:1788838374.881423:0:94392:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135222400 00000100:00000040:3.0:1788838374.881437:0:94392:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:3.0:1788838374.881442:0:94392:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.881464:0:94392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8ff611a7ca80 x1875729135222400/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.881481:0:94392:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:3.0:1788838374.881486:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff509eab850 x1875729135222400/t0(0) o101->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/344 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.881507:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135222400:12345-0@lo:101:mount.lustre.0 Request processed in 293us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838374.881514:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:3.0:1788838374.881518:0:94392:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:3.0:1788838374.881530:0:94392:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00100000:3.0:1788838374.881576:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8aa80 going to sleep for 11 seconds 00000100:00000040:3.0:1788838374.881604:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7ca80 x1875729135222400/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.881614:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7ca80 x1875729135222400/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.881628:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222400:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1788838374.881638:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7ca80 x1875729135222400/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.881650:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50712cc00 refcount=4 00010000:00000040:3.0:1788838374.881656:0:96964:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8ff50712cc00, remote cookie: 0x88da08396cccadaf, flags: 0x0 00010000:00000040:3.0:1788838374.881660:0:96964:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8ff60b5cf200) refcount = 9 00010000:00000040:3.0:1788838374.881663:0:96964:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1788838374.881665:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff50712ce00/0x88da08396cccad69 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396cccad70 expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881673:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff60148f800/0x88da08396ccca391 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca398 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881680:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff60148e800/0x88da08396ccca367 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca36e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881687:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff601528800/0x88da08396ccca359 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca360 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881693:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff601529000/0x88da08396ccca34b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca352 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881699:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff601529800/0x88da08396ccca33d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca344 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881705:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff50f3ee400/0x88da08396ccca32f lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca336 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838374.881712:0:96964:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff60148f600/0x88da08396ccca321 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396ccca328 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.881725:0:96964:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396cccada8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccadaf expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838374.881735:0:96964:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396cccada8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396cccadaf expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788838374.881745:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7ca80 x1875729135222400/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.881757:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 10000000:00000040:3.0:1788838374.881769:0:96964:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff8ff50a680c00) refs 2 00000020:00000040:3.0:1788838374.881772:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50712cc00 refcount=3 10000000:00000040:3.0:1788838374.881835:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff6096baf00 : new refcount 2 10000000:00000040:3.0:1788838374.881840:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff508ba4a80 : new refcount 2 10000000:00000040:3.0:1788838374.881843:0:96964:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.203.130@tcp: copy local log lustre-client 00000040:00080000:3.0:1788838374.882706:0:96964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788838374.883148:0:96964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788838374.883367:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788838374.883396:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788838374.883411:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788838374.883425:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788838374.883440:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788838374.883456:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788838374.883470:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788838374.883484:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788838374.883525:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788838374.883542:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788838374.883556:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788838374.883568:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788838374.883580:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788838374.883591:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788838374.883611:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788838374.883623:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788838374.883634:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788838374.883644:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788838374.883656:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788838374.883667:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788838374.883680:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788838374.883692:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788838374.883704:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788838374.883716:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788838374.883727:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788838374.883738:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788838374.883756:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788838374.883770:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788838374.883783:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788838374.883829:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788838374.883847:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788838374.883860:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788838374.883872:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788838374.883886:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788838374.883900:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788838374.883913:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788838374.883925:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788838374.883946:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788838374.883952:0:96964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:3.0:1788838374.884183:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.884193:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.884245:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7ca80 x1875729135222528/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.884261:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222528:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788838374.884294:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7ca80 x1875729135222528/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.884310:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.884362:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff509eabc50 x1875729135222528 msgsize 512 00000100:00100000:3.0:1788838374.884367:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.884370:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.884447:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7ca80 x1875729135222528/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.884485:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838374.884915:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135222528 00000100:00100000:1.0:1788838374.884927:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135222528 00000020:00000040:1.0:1788838374.884938:0:94395:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:1.0:1788838374.884943:0:94395:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=24 00000100:00000040:1.0:1788838374.885036:0:94395:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788838374.885126:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:1.0:1788838374.885131:0:94395:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:1.0:1788838374.885136:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff509eabc50 x1875729135222528/t0(0) o501->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 512/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.885151:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135222528:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1788838374.885178:0:94395:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:1.0:1788838374.885182:0:94395:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:1.0:1788838374.885271:0:94395:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00000020:00000040:1.0:1788838374.885285:0:94395:0:(genops.c:868:class_export_get()) GET export ffff8ff639712000 refcount=25 00000020:00000040:1.0:1788838374.885289:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 24 00010000:00000040:1.0:1788838374.885296:0:94395:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135222528 00000100:00000040:1.0:1788838374.885311:0:94395:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838374.885316:0:94395:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838374.885357:0:94395:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8ff611a7ca80 x1875729135222528/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.885386:0:94395:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838374.885391:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff509eabc50 x1875729135222528/t0(0) o501->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 512/272 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.885400:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135222528:12345-0@lo:501:mount.lustre.0 Request processed in 251us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838374.885407:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:1.0:1788838374.885411:0:94395:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:1.0:1788838374.885422:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00000040:3.0:1788838374.887141:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7ca80 x1875729135222528/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.887160:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7ca80 x1875729135222528/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.887167:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222528:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788838374.887179:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7ca80 x1875729135222528/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.887195:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.887200:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7ca80 x1875729135222528/t0(0) o501->MGC192.168.203.130@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.887209:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.887226:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.887231:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.887260:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7ca80 x1875729135222656/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.887273:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222656:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1788838374.887318:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7ca80 x1875729135222656/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.887340:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.887385:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff627fe1050 x1875729135222656 msgsize 272 00000100:00100000:3.0:1788838374.887390:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.887393:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.887429:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7ca80 x1875729135222656/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.887460:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788838374.887623:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135222656 00000100:00100000:1.0:1788838374.887631:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135222656 00000020:00000040:1.0:1788838374.887641:0:94395:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:1.0:1788838374.887646:0:94395:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=24 00000100:00000040:1.0:1788838374.887673:0:94395:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788838374.887708:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00000040:1.0:1788838374.887713:0:94395:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:1.0:1788838374.887854:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff627fe1050 x1875729135222656/t0(0) o503->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.887989:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135222656:12345-0@lo:503:mount.lustre.0 00000040:00000040:1.0:1788838374.888031:0:94395:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:1.0:1788838374.888108:0:94395:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:1.0:1788838374.888113:0:94395:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135222656 00000100:00000040:1.0:1788838374.888125:0:94395:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838374.888130:0:94395:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838374.888162:0:94395:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff8ff611a7ca80 x1875729135222656/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.888194:0:94395:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:1.0:1788838374.888199:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff627fe1050 x1875729135222656/t0(0) o503->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/8416 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.888206:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135222656:12345-0@lo:503:mount.lustre.0 Request processed in 341us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838374.888213:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00000040:1.0:1788838374.888216:0:94395:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:1.0:1788838374.888227:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00000040:3.0:1788838374.888558:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7ca80 x1875729135222656/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.888569:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7ca80 x1875729135222656/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.888576:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222656:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1788838374.888585:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7ca80 x1875729135222656/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.888597:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7ca80 x1875729135222656/t0(0) o503->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.888612:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.888618:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000040:00080000:3.0:1788838374.889279:0:96964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1788838374.889354:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.889360:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.889390:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7ca80 x1875729135222784/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.889403:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222784:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788838374.889440:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7ca80 x1875729135222784/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.889458:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.889508:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff509eaa850 x1875729135222784 msgsize 272 00000100:00100000:3.0:1788838374.889513:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.889515:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.889547:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7ca80 x1875729135222784/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.889575:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838374.889712:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135222784 00000100:00100000:0.0:1788838374.889720:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135222784 00000020:00000040:0.0:1788838374.889724:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:0.0:1788838374.889730:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=24 00000100:00000040:0.0:1788838374.889750:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788838374.889784:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00000040:0.0:1788838374.889821:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:0.0:1788838374.889828:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff509eaa850 x1875729135222784/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.889842:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff509eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135222784:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1788838374.889873:0:94398:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:0.0:1788838374.889929:0:94398:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:0.0:1788838374.889935:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135222784 00000100:00000040:0.0:1788838374.889946:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:0.0:1788838374.889951:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.889987:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8ff611a7ca80 x1875729135222784/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.890009:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:0.0:1788838374.890015:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff509eaa850 x1875729135222784/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/8472 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.890024:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff509eaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135222784:12345-0@lo:502:mount.lustre.0 Request processed in 185us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838374.890032:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00000040:0.0:1788838374.890036:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:0.0:1788838374.890050:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00000040:3.0:1788838374.890303:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7ca80 x1875729135222784/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.890315:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7ca80 x1875729135222784/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.890322:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222784:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788838374.890330:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7ca80 x1875729135222784/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.890344:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7ca80 x1875729135222784/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.890358:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.890367:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000040:00080000:3.0:1788838374.890580:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788838374.890612:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788838374.890627:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788838374.890642:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788838374.890655:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788838374.890669:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788838374.890681:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788838374.890694:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788838374.890707:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788838374.890720:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788838374.890746:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788838374.890761:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788838374.890777:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788838374.890791:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788838374.890843:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788838374.890859:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788838374.890873:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788838374.890887:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788838374.890902:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788838374.890914:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788838374.890927:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788838374.890943:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788838374.890958:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788838374.891043:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788838374.891061:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788838374.891076:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788838374.891089:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788838374.891103:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788838374.891114:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788838374.891127:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788838374.891140:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788838374.891153:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788838374.891167:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788838374.891180:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788838374.891196:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788838374.891211:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788838374.891225:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788838374.891237:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788838374.891249:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788838374.891263:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788838374.891276:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788838374.891290:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788838374.891304:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788838374.891331:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788838374.891346:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788838374.891359:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788838374.891376:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788838374.891389:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:3.0:1788838374.891407:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.891414:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.891447:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7ca80 x1875729135222912/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.891460:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222912:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788838374.891510:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7ca80 x1875729135222912/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.891520:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.891562:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff627fe0450 x1875729135222912 msgsize 272 00000100:00100000:3.0:1788838374.891567:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.891569:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.891602:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7ca80 x1875729135222912/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.891642:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838374.892094:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135222912 00000100:00100000:0.0:1788838374.892109:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135222912 00000020:00000040:0.0:1788838374.892112:0:94395:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:0.0:1788838374.892117:0:94395:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=24 00000100:00000040:0.0:1788838374.892145:0:94395:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788838374.892189:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00000040:0.0:1788838374.892194:0:94395:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:0.0:1788838374.892200:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff627fe0450 x1875729135222912/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.892228:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135222912:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1788838374.892261:0:94395:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:0.0:1788838374.892328:0:94395:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:0.0:1788838374.892333:0:94395:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135222912 00000100:00000040:0.0:1788838374.892345:0:94395:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:0.0:1788838374.892351:0:94395:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.892384:0:94395:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8ff611a7ca80 x1875729135222912/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.892418:0:94395:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:0.0:1788838374.892423:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff627fe0450 x1875729135222912/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/8472 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.892433:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135222912:12345-0@lo:502:mount.lustre.0 Request processed in 208us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838374.892440:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00000040:0.0:1788838374.892444:0:94395:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:0.0:1788838374.892458:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00000040:3.0:1788838374.892663:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7ca80 x1875729135222912/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.892675:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7ca80 x1875729135222912/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.892682:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135222912:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788838374.892691:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7ca80 x1875729135222912/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.892706:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7ca80 x1875729135222912/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.892729:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.892737:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000040:00080000:3.0:1788838374.895156:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788838374.895235:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:3.0:1788838374.895268:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788838374.895591:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:3.0:1788838374.895618:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:3.0:1788838374.895633:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:3.0:1788838374.895648:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:3.0:1788838374.895666:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:3.0:1788838374.895682:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:3.0:1788838374.895697:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:3.0:1788838374.895712:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:3.0:1788838374.895727:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:3.0:1788838374.895741:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:3.0:1788838374.895770:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:3.0:1788838374.895784:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.895794:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.896159:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7ca80 x1875729135223040/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.896179:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135223040:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788838374.896231:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7ca80 x1875729135223040/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.896252:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.896505:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff627fe3450 x1875729135223040 msgsize 272 00000100:00100000:3.0:1788838374.896511:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.896513:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.896552:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7ca80 x1875729135223040/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.896606:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788838374.896724:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135223040 00000100:00100000:0.0:1788838374.896735:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135223040 00000020:00000040:0.0:1788838374.896739:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:0.0:1788838374.897067:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=24 00000100:00000040:0.0:1788838374.897101:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788838374.897150:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00000040:0.0:1788838374.897156:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:0.0:1788838374.897162:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff627fe3450 x1875729135223040/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.897175:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135223040:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1788838374.897218:0:94398:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff50a2c7540 : new refcount 2 00000040:00000040:0.0:1788838374.897593:0:94398:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff50a2c7540 : new refcount 1 00010000:00000040:0.0:1788838374.897600:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135223040 00000100:00000040:0.0:1788838374.897613:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:0.0:1788838374.897619:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.897663:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8ff611a7ca80 x1875729135223040/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.897738:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 51 to 0@lo 00000100:00000040:0.0:1788838374.897744:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff627fe3450 x1875729135223040/t0(0) o502->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 272/8472 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.897755:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135223040:12345-0@lo:502:mount.lustre.0 Request processed in 581us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838374.897763:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00000040:0.0:1788838374.897767:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:0.0:1788838374.897783:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00000040:3.0:1788838374.898725:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7ca80 x1875729135223040/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.898997:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7ca80 x1875729135223040/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.899007:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135223040:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788838374.899019:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7ca80 x1875729135223040/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.899039:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7ca80 x1875729135223040/t0(0) o502->MGC192.168.203.130@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838374.899058:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:3.0:1788838374.899069:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000040:00080000:3.0:1788838374.899146:0:96964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:3.0:1788838374.899162:0:96964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:3.0:1788838374.899664:0:96964:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff6096baf00 : new refcount 1 00000020:00000040:3.0:1788838374.899671:0:96964:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:1.0:1788838374.901148:0:96975:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.203.130@tcp 192.168.203.130@tcp cnt=1 00000020:01000004:1.0:1788838374.901182:0:96975:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788838374.901205:0:96975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ff624ff0000) 00000020:00000040:1.0:1788838374.901213:0:96975:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50b02f800 with handle 0x88da08396cccadb6 to hash 00000020:00000040:1.0:1788838374.901227:0:96975:0:(genops.c:879:class_export_put()) PUTting export ffff8ff50b02f800 : new refcount 1 00000020:00000040:1.0:1788838374.901386:0:96975:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8ff624ff0000) now 2 - obd_device_list 00000020:00000080:1.0:1788838374.901395:0:96975:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788838374.901512:0:96975:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff50b02b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788838374.901517:0:96975:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff50b02b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788838374.901520:0:96975:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff50b02b000 3 00000020:00000040:1.0:1788838374.901544:0:96975:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8ff624ff0000) now 3 - import 00000020:00000040:1.0:1788838374.901551:0:96975:0:(genops.c:1223:class_import_put()) import ffff8ff627d5d800 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1788838374.901566:0:96975:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838374.901570:0:96975:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 52 to 0@lo 00000100:00000040:1.0:1788838374.901572:0:96975:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.130@tcp -> ffff8ff611edf540 00010000:00080000:1.0:1788838374.901577:0:96975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff627d5d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1788838374.905219:0:96975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:1.0:1788838374.905620:0:96975:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8ff624ff0000) now 4 - setup 00000020:00000080:1.0:1788838374.905627:0:96975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788838374.905693:0:96975:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000040:1.0:1788838374.905705:0:96975:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff509c66800 with handle 0x88da08396cccadbd to hash 00000020:00000040:1.0:1788838374.905714:0:96975:0:(genops.c:868:class_export_get()) GET export ffff8ff509c66800 refcount=3 00000020:00000040:1.0:1788838374.905721:0:96975:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8ff624ff0000) now 5 - export 00000020:00000040:1.0:1788838374.905725:0:96975:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c66800 : new refcount 2 00000020:00000080:1.0:1788838374.905728:0:96975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x88da08396cccadbd 00000020:00000040:1.0:1788838374.905733:0:96975:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadbd 00000020:00000040:1.0:1788838374.905736:0:96975:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff509c66800 refcount=3 00000100:00080000:1.0:1788838374.905845:0:96975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:1.0:1788838374.905852:0:96975:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 53 to 0@lo 00000020:00000040:1.0:1788838374.905855:0:96975:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadbd 00000020:00000040:1.0:1788838374.905857:0:96975:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff509c66800 refcount=4 00000100:00000040:1.0:1788838374.905860:0:96975:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 54 to 0@lo 00000020:00000040:1.0:1788838374.905862:0:96975:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c66800 : new refcount 3 00000100:00080000:1.0:1788838374.906043:0:96975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ff627d5d800 using connection 192.168.203.130@tcp/0@lo 00000020:00000040:1.0:1788838374.906064:0:96975:0:(genops.c:1210:class_import_get()) import ffff8ff627d5d800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:1.0:1788838374.906110:0:96975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff624ebc380 x1875729135223168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838374.906128:0:96975:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000027c9811c] to pc [ptlrpcd_rcv+-1] req@ffff8ff624ebc380 x1875729135223168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838374.906154:0:96975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:1.0:1788838374.906158:0:96975:0:(genops.c:1210:class_import_get()) import ffff8ff627d5d800 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1788838374.906185:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff624ebc380 x1875729135223168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.906202:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135223168:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1788838374.906246:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff624ebc380 x1875729135223168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.906256:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.906309:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7ca80 x1875729135223168 msgsize 520 00000100:00100000:3.0:1788838374.906315:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.906347:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff624ebc380 x1875729135223168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.906378:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00100000:1.0:1788838374.906389:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135223168 00000100:00100000:1.0:1788838374.906398:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135223168 00000020:00000040:1.0:1788838374.906400:0:75504:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000100:00000040:2.0:1788838374.906456:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838374.906469:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff501ab3000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788838374.906482:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8ff6329b6300 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838374.906505:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007ad9eaab] to pc [ptlrpcd_00_03+3] req@ffff8ff6329b6300 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.906531:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838374.906540:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff5031c5000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788838374.906548:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8ff62bd6dc00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838374.906556:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e438d42f] to pc [ptlrpcd_00_00+0] req@ffff8ff62bd6dc00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.906576:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838374.906581:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff6061da800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788838374.906588:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8ff62bd6e680 x1875729135223552/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838374.906596:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003581862a] to pc [ptlrpcd_00_01+1] req@ffff8ff62bd6e680 x1875729135223552/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838374.906604:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838374.906608:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788838374.906617:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838374.906622:0:27607:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3767 00000100:00080000:2.0:1788838374.906625:0:27607:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:2.0:1788838374.906629:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 53 to 0@lo 00000100:00000040:2.0:1788838374.906632:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 54 to 0@lo 00000020:00000040:2.0:1788838374.906634:0:27607:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c5f 00000020:00000040:2.0:1788838374.906637:0:27607:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604967800 refcount=4 00000100:00000040:2.0:1788838374.906640:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 53 to 0@lo 00000100:00000040:2.0:1788838374.906642:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 54 to 0@lo 00000020:00000040:2.0:1788838374.906645:0:27607:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604967800 : new refcount 3 00000100:00080000:2.0:1788838374.906648:0:27607:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ff604585000 using connection 192.168.203.130@tcp/0@lo 00000020:00000040:2.0:1788838374.906657:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff604585000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1788838374.906669:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bc73800 x1875729135223680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838374.906669:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589 00000100:00000040:2.0:1788838374.906679:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bca5b3d6] to pc [ptlrpcd_rcv+-1] req@ffff8ff62bc73800 x1875729135223680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.906679:0:75504:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7ca80 x1875729135223168/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1788838394 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.906692:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875729135223168:12345-0@lo:38:llog_process_th.0 00000100:00000040:2.0:1788838374.906693:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838374.906698:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff632feb800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788838374.906704:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8ff62bc70a80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1788838374.906710:0:75504:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 14 - find 00000100:00000040:2.0:1788838374.906713:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d265e88a] to pc [ptlrpcd_00_02+2] req@ffff8ff62bc70a80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.906720:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00000040:1.0:1788838374.906723:0:75504:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00000020:00000040:2.0:1788838374.906724:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff6271d7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788838374.906731:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff8ff62bc73100 x1875729135223936/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:1.0:1788838374.906731:0:75504:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3768 last 0 00000020:00000040:1.0:1788838374.906742:0:75504:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff509c64000 with handle 0x88da08396cccadc4 to hash 00000100:00000040:2.0:1788838374.906751:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f98af772] to pc [ptlrpcd_00_03+3] req@ffff8ff62bc73100 x1875729135223936/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838374.906758:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838374.906761:0:27607:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788838374.906763:0:27607:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788838374.906767:0:27607:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3767 00000100:00080000:2.0:1788838374.906769:0:27607:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00000040:2.0:1788838374.906772:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 53 to 0@lo 00000100:00000040:2.0:1788838374.906774:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 54 to 0@lo 00000020:00000040:2.0:1788838374.906776:0:27607:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e6d 00000020:00000040:2.0:1788838374.906779:0:27607:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff602d1e800 refcount=4 00000020:00000040:1.0:1788838374.906779:0:75504:0:(genops.c:868:class_export_get()) GET export ffff8ff509c64000 refcount=3 00000100:00000040:2.0:1788838374.906782:0:27607:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 53 to 0@lo 00000020:00000040:1.0:1788838374.906782:0:75504:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 15 - export 00000100:00000040:2.0:1788838374.906784:0:27607:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 54 to 0@lo 00000020:00000040:1.0:1788838374.906785:0:75504:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c64000 : new refcount 2 00000020:00000040:2.0:1788838374.906787:0:27607:0:(genops.c:879:class_export_put()) PUTting export ffff8ff602d1e800 : new refcount 3 00000020:00000080:1.0:1788838374.906787:0:75504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x88da08396cccadc4 00000100:00080000:2.0:1788838374.906789:0:27607:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff62c81b000 using connection 192.168.203.130@tcp/0@lo 00000020:00000040:1.0:1788838374.906790:0:75504:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadc4 00000020:00000040:1.0:1788838374.906791:0:75504:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff509c64000 refcount=3 00000020:00000040:2.0:1788838374.906818:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff62c81b000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1788838374.906830:0:27607:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bc71f80 x1875729135224064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838374.906838:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b1f4dc4a] to pc [ptlrpcd_rcv+-1] req@ffff8ff62bc71f80 x1875729135224064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000001:00000040:1.0:1788838374.906838:0:75504:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.203.130@tcp 00000001:00000040:1.0:1788838374.906843:0:75504:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8ff62749bc00) : new refcount 17 00000100:00000040:2.0:1788838374.906844:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1788838374.906847:0:75504:0:(genops.c:868:class_export_get()) GET export ffff8ff509c64000 refcount=4 00000020:00000040:2.0:1788838374.906849:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff619428000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000001:00000040:1.0:1788838374.906850:0:75504:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8ff62749bc00) : new refcount 18 00000001:00000040:1.0:1788838374.906854:0:75504:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8ff62749bc00) : new refcount 17 00000100:00000040:2.0:1788838374.906858:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff62bc73b80 x1875729135224192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00100000:1.0:1788838374.906864:0:75504:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00000040:2.0:1788838374.906866:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000dc4109d6] to pc [ptlrpcd_00_00+0] req@ffff8ff62bc73b80 x1875729135224192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.906879:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838374.906884:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff6104d8000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788838374.906903:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8ff62bc72300 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838374.906913:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f28b093d] to pc [ptlrpcd_00_01+1] req@ffff8ff62bc72300 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.906926:0:27607:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3773) 00000100:00000040:2.0:1788838374.906946:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.906957:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135223296:0@lo:400:kworker.0 00000100:00000040:2.0:1788838374.907043:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907053:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.907073:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc70e00 x1875729135223296 msgsize 224 00000100:00100000:2.0:1788838374.907078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.907100:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907113:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8042 usecs (9 jiffies) 00000020:00000040:1.0:1788838374.907113:0:75504:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats ffff8ff63a2aa720 for nid 0@lo - ref 6 00000100:00000040:2.0:1788838374.907120:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc73100 x1875729135223936/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838374.907124:0:75504:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 16 - import 00000100:00100000:2.0:1788838374.907129:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135223936:0@lo:400:kworker.0 00000020:00000040:1.0:1788838374.907130:0:75504:0:(genops.c:1223:class_import_put()) import ffff8ff509c67800 refcount=1 obd=lustre-MDT0000 00000020:00000040:1.0:1788838374.907139:0:75504:0:(genops.c:868:class_export_get()) GET export ffff8ff509c64000 refcount=5 00000100:00000040:1.0:1788838374.907142:0:75504:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff8ff509c64000 : new rpc_count 1 00000100:00000040:2.0:1788838374.907144:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc73100 x1875729135223936/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.907147:0:75504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 55 to 0@lo 00000100:00000040:1.0:1788838374.907150:0:75504:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 55 to 0@lo 00000100:00000040:2.0:1788838374.907152:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1788838374.907154:0:75504:0:(genops.c:868:class_export_get()) GET export ffff8ff509c64000 refcount=6 00000100:00000040:1.0:1788838374.907161:0:75504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 56 to 0@lo 00000100:00000040:2.0:1788838374.907169:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc72d80 x1875729135223936 msgsize 224 00000100:00080000:1.0:1788838374.907171:0:75504:0:(import.c:65:import_set_state_nolock()) ffff8ff509c67800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1788838374.907176:0:75504:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c64000 : new refcount 5 00000100:00100000:2.0:1788838374.907178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:1.0:1788838374.907179:0:75504:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 16 - find 00000100:00000040:2.0:1788838374.907196:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc73100 x1875729135223936/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1788838374.907199:0:75504:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135223168 00000100:00000040:2.0:1788838374.907207:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5333 usecs (6 jiffies) 00000100:00000040:1.0:1788838374.907211:0:75504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:1.0:1788838374.907217:0:75504:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1788838374.907223:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:2.0:1788838374.907228:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc70a80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.907236:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135223808:0@lo:400:kworker.0 00000100:00000040:1.0:1788838374.907237:0:75504:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8ff624ebc380 x1875729135223168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907258:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc70a80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907265:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.907278:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff8ff639c5df80 x1875729135223808 msgsize 224 00000100:00100000:2.0:1788838374.907282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.907296:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc70a80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907306:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 135001 usecs (136 jiffies) 00000100:00000040:2.0:1788838374.907334:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd6dc00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.907344:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135223424:0@lo:400:kworker.0 00000100:00000040:2.0:1788838374.907357:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd6dc00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907365:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.907378:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff637f8ce00 x1875729135223424 msgsize 224 00000100:00100000:2.0:1788838374.907382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.907398:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd6dc00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907407:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7413 usecs (8 jiffies) 00000100:00000040:2.0:1788838374.907414:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc73b80 x1875729135224192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.907444:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135224192:0@lo:400:kworker.0 00000100:00000040:2.0:1788838374.907462:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc73b80 x1875729135224192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907469:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.907485:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff637f8e300 x1875729135224192 msgsize 224 00000100:00100000:2.0:1788838374.907488:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.907516:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc73b80 x1875729135224192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907525:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9032 usecs (10 jiffies) 00000100:00100000:2.0:1788838374.907534:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:2.0:1788838374.907539:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd6e680 x1875729135223552/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.907547:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135223552:0@lo:400:kworker.0 00000100:00000040:2.0:1788838374.907561:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd6e680 x1875729135223552/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907567:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.907582:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff50719e300 x1875729135223552 msgsize 224 00000100:00100000:2.0:1788838374.907585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.907600:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd6e680 x1875729135223552/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907608:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1487266 usecs (1488 jiffies) 00000100:00000040:2.0:1788838374.907614:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc72300 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.907622:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135224320:0@lo:400:kworker.0 00000100:00000040:2.0:1788838374.907635:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc72300 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907653:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.907668:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff50719dc00 x1875729135224320 msgsize 224 00000100:00100000:2.0:1788838374.907671:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.907685:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc72300 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907694:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 5897 usecs (6 jiffies) 00000100:00100000:2.0:1788838374.907719:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135223296 00000100:00100000:2.0:1788838374.907725:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135223296 00000020:00000040:2.0:1788838374.907728:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fa8 00000020:00000040:2.0:1788838374.907732:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639656800 refcount=5 00000100:00000040:2.0:1788838374.907760:0:66255:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788838374.907777:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135223808 00000100:00100000:2.0:1788838374.907780:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135223808 00000020:00000040:2.0:1788838374.907782:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9faf 00000020:00000040:2.0:1788838374.907784:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609254800 refcount=5 00000100:00100000:2.0:1788838374.907823:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135223424 00000100:00100000:2.0:1788838374.907827:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135223424 00000100:00000040:1.0:1788838374.907827:0:75504:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 56 to 0@lo 00000020:00000040:2.0:1788838374.907829:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3d07 00000020:00000040:2.0:1788838374.907831:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d2000 refcount=5 00000100:00000040:1.0:1788838374.907834:0:75504:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7ca80 x1875729135223168/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788838394 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.907843:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135224320 00000100:00100000:1.0:1788838374.907844:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875729135223168:12345-0@lo:38:llog_process_th.0 Request processed in 1153us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.907845:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135224320 00000020:00000040:2.0:1788838374.907847:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fb6 00000020:00000040:2.0:1788838374.907849:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609257000 refcount=5 00000100:00100000:1.0:1788838374.907852:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00000100:00000040:1.0:1788838374.907856:0:75504:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff509c64000 : new rpc_count 0 00000100:00100000:2.0:1788838374.907861:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00000040:2.0:1788838374.907865:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639656800 : new rpc_count 1 00000100:00000040:2.0:1788838374.907871:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc70e00 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:275/0 lens 224/0 e 0 to 0 dl 1788838385 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.907882:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135223296:12345-0@lo:400:kworker.0 00000020:00000040:1.0:1788838374.907883:0:75504:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c64000 : new refcount 4 00010000:00000040:2.0:1788838374.907901:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135223296 00000100:00000040:2.0:1788838374.907906:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:2.0:1788838374.907916:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.907935:0:66255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6329b6300 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.907955:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 56 to 0@lo 00000100:00000040:2.0:1788838374.907960:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc70e00 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:275/0 lens 224/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.908050:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00000040:1.0:1788838374.908053:0:75504:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609254800 : new rpc_count 1 00000100:00000040:1.0:1788838374.908057:0:75504:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff639c5df80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:275/0 lens 224/0 e 0 to 0 dl 1788838385 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.908076:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135223808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838374.908079:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00000040:3.0:1788838374.908083:0:66253:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d2000 : new rpc_count 1 00010000:00000040:1.0:1788838374.908088:0:75504:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135223808 00000100:00000040:3.0:1788838374.908089:0:66253:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff637f8ce00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:275/0 lens 224/0 e 0 to 0 dl 1788838385 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.908093:0:75504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:1.0:1788838374.908096:0:75504:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1788838374.908103:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135223424:12345-0@lo:400:kworker.0 00000100:00000040:1.0:1788838374.908111:0:75504:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc70a80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788838374.908113:0:66253:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135223424 00000100:00000040:3.0:1788838374.908117:0:66253:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 58 to 0@lo 00000100:00000040:3.0:1788838374.908120:0:66253:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838374.908125:0:75504:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:1.0:1788838374.908129:0:75504:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff639c5df80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:275/0 lens 224/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.908137:0:66253:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bd6dc00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.908138:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff639c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875729135223808:12345-0@lo:400:kworker.0 Request processed in 66us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838374.908145:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00000040:1.0:1788838374.908148:0:75504:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609254800 : new rpc_count 0 00000100:00000040:3.0:1788838374.908154:0:66253:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 56 to 0@lo 00000100:00000040:3.0:1788838374.908158:0:66253:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff637f8ce00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:275/0 lens 224/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838374.908158:0:75504:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609254800 : new refcount 4 00000100:00100000:1.0:1788838374.908166:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1788838374.908167:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135223424:12345-0@lo:400:kworker.0 Request processed in 67us (786us total) trans 0 rc 0/0 00000100:00000040:1.0:1788838374.908168:0:75504:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609257000 : new rpc_count 1 00000100:00000040:1.0:1788838374.908172:0:75504:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff50719dc00 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:275/0 lens 224/0 e 0 to 0 dl 1788838385 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.908173:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00000040:3.0:1788838374.908175:0:66253:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d2000 : new rpc_count 0 00000020:00000040:3.0:1788838374.908182:0:66253:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d2000 : new refcount 4 00000100:00100000:1.0:1788838374.908182:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135224320:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788838374.908192:0:75504:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135224320 00000100:00000040:1.0:1788838374.908195:0:75504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:1.0:1788838374.908198:0:75504:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838374.908212:0:75504:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc72300 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.908224:0:75504:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 56 to 0@lo 00000100:00000040:1.0:1788838374.908250:0:75504:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff50719dc00 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:275/0 lens 224/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.908258:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135224320:12345-0@lo:400:kworker.0 Request processed in 77us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838374.908263:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00000040:1.0:1788838374.908266:0:75504:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609257000 : new rpc_count 0 00000020:00000040:1.0:1788838374.908271:0:75504:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609257000 : new refcount 4 00000100:00100000:2.0:1788838374.908413:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875729135223296:12345-0@lo:400:kworker.0 Request processed in 88us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.908420:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00000040:2.0:1788838374.908423:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639656800 : new rpc_count 0 00000020:00000040:2.0:1788838374.908434:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639656800 : new refcount 4 00000100:00100000:2.0:1788838374.908454:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135223936 00000100:00100000:2.0:1788838374.908459:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135223936 00000020:00000040:2.0:1788838374.908461:0:37907:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e66 00000020:00000040:2.0:1788838374.908464:0:37907:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff624a94800 refcount=5 00000100:00000040:2.0:1788838374.908476:0:37907:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788838374.908511:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135223552 00000100:00100000:2.0:1788838374.908515:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135223552 00000020:00000040:2.0:1788838374.908516:0:37907:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e20 00000020:00000040:2.0:1788838374.908519:0:37907:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d6800 refcount=7 00000100:00100000:3.0:1788838374.908526:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4299 00000100:00000040:3.0:1788838374.908530:0:23765:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff624a94800 : new rpc_count 1 00000100:00000040:3.0:1788838374.908535:0:23765:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc72d80 x1875729135223936/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:275/0 lens 224/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.908539:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4300 00000100:00000040:2.0:1788838374.908541:0:37907:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d6800 : new rpc_count 1 00000100:00000040:2.0:1788838374.908546:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff50719e300 x1875729135223552/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:275/0 lens 224/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.908548:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135223936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838374.908556:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135223552:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788838374.908562:0:23765:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135223936 00010000:00000040:2.0:1788838374.908563:0:37907:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875729135223552 00000100:00000040:2.0:1788838374.908567:0:37907:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:2.0:1788838374.908571:0:37907:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.908572:0:23765:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 58 to 0@lo 00000100:00000040:3.0:1788838374.908575:0:23765:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.908589:0:37907:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bd6e680 x1875729135223552/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.908590:0:23765:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc73100 x1875729135223936/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.908605:0:23765:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:2.0:1788838374.908606:0:37907:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 56 to 0@lo 00000100:00000040:3.0:1788838374.908609:0:23765:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc72d80 x1875729135223936/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:275/0 lens 224/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.908610:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff50719e300 x1875729135223552/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:275/0 lens 224/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.908618:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135223936:12345-0@lo:400:kworker.0 Request processed in 72us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.908619:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135223552:12345-0@lo:400:kworker.0 Request processed in 63us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.908625:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4300 00000100:00000040:2.0:1788838374.908627:0:37907:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d6800 : new rpc_count 0 00000020:00000040:2.0:1788838374.908632:0:37907:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d6800 : new refcount 6 00000100:00100000:2.0:1788838374.908659:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135224192 00000100:00100000:2.0:1788838374.908663:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135224192 00000020:00000040:2.0:1788838374.908665:0:26215:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e90 00000020:00000040:2.0:1788838374.908668:0:26215:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff632f51800 refcount=5 00000100:00000040:2.0:1788838374.908689:0:26215:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1788838374.908710:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00000040:2.0:1788838374.908713:0:26215:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff632f51800 : new rpc_count 1 00000100:00000040:2.0:1788838374.908717:0:26215:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff637f8e300 x1875729135224192/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:275/0 lens 224/0 e 0 to 0 dl 1788838385 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.908727:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff637f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135224192:12345-0@lo:400:kworker.0 00000020:00000040:1.0:1788838374.908730:0:96975:0:(genops.c:868:class_export_get()) GET export ffff8ff509c66800 refcount=4 00000020:00000040:1.0:1788838374.908737:0:96975:0:(genops.c:868:class_export_get()) GET export ffff8ff509c66800 refcount=5 00010000:00000040:2.0:1788838374.908739:0:26215:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875729135224192 00000100:00000040:2.0:1788838374.908754:0:26215:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:2.0:1788838374.908757:0:26215:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.908774:0:26215:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff62bc73b80 x1875729135224192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.908786:0:26215:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 56 to 0@lo 00000100:00000040:2.0:1788838374.908790:0:26215:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff637f8e300 x1875729135224192/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:275/0 lens 224/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.909060:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff637f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135224192:12345-0@lo:400:kworker.0 Request processed in 333us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.909074:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000100:00000040:2.0:1788838374.909076:0:26215:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff632f51800 : new rpc_count 0 00000020:00000040:2.0:1788838374.909083:0:26215:0:(genops.c:879:class_export_put()) PUTting export ffff8ff632f51800 : new refcount 4 00000100:00000040:2.0:1788838374.909121:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc73800 x1875729135223680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.909134:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135223680:0@lo:8:kworker.0 00000100:00000040:2.0:1788838374.909158:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc73800 x1875729135223680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838399 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.909165:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.909186:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff50719ca80 x1875729135223680 msgsize 520 00000100:00100000:2.0:1788838374.909191:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.909210:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc73800 x1875729135223680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838399 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.909223:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5816 usecs (6 jiffies) 00000100:00000040:2.0:1788838374.909232:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc71f80 x1875729135224064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.909252:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135224064:0@lo:8:kworker.0 00000100:00000040:2.0:1788838374.909265:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc71f80 x1875729135224064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838399 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.909272:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.909292:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff50719d500 x1875729135224064 msgsize 520 00000100:00100000:2.0:1788838374.909297:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.909312:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc71f80 x1875729135224064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838399 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.909322:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8453 usecs (9 jiffies) 00000100:00100000:2.0:1788838374.909357:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:2.0:1788838374.909365:0:3642:0:(client.c:3235:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:2.0:1788838374.909371:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff624ebc380 x1875729135223168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838374.909386:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000020:00000040:2.0:1788838374.909390:0:3642:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadbd 00000020:00000040:2.0:1788838374.909392:0:3642:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff509c66800 refcount=6 00000100:00080000:2.0:1788838374.909400:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:2.0:1788838374.909403:0:3642:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c66800 : new refcount 5 00000100:00080000:2.0:1788838374.909407:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788838374.909411:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff627d5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:2.0:1788838374.909420:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebc380 x1875729135223168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.909428:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875729135223168:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1788838374.909435:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff624ebc380 x1875729135223168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.909447:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff627d5d800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:2.0:1788838374.909477:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135223680 00000100:00100000:2.0:1788838374.909481:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135223680 00000020:00000040:2.0:1788838374.909483:0:8657:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c66 00000100:00100000:2.0:1788838374.909516:0:8657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135224064 00000100:00100000:2.0:1788838374.909519:0:8657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135224064 00000020:00000040:2.0:1788838374.909520:0:8657:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e82 00000100:00100000:2.0:1788838374.909536:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6074 00000100:00000040:2.0:1788838374.909541:0:8657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff50719ca80 x1875729135223680/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838394 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.909550:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1875729135223680:12345-0@lo:8:kworker.0 00000020:00000040:2.0:1788838374.909572:0:8657:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 7 - find 00010000:00000040:2.0:1788838374.909581:0:8657:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:2.0:1788838374.909585:0:8657:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8ff503ca0000) now 7 - find 00000100:00000040:2.0:1788838374.909597:0:8657:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:2.0:1788838374.909600:0:8657:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:2.0:1788838374.909604:0:8657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.909623:0:8657:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8ff62bc73800 x1875729135223680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838399 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.909642:0:8657:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 56 to 0@lo 00000100:00000040:2.0:1788838374.909646:0:8657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff50719ca80 x1875729135223680/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838394 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.909655:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1875729135223680:12345-0@lo:8:kworker.0 Request processed in 105us (467us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788838374.909662:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6074 00000100:00100000:2.0:1788838374.909673:0:8657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6075 00000100:00000040:2.0:1788838374.909678:0:8657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff50719d500 x1875729135224064/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838394 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.909685:0:8657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1875729135224064:12345-0@lo:8:kworker.0 00000020:00000040:2.0:1788838374.909693:0:8657:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 7 - find 00010000:00000040:2.0:1788838374.909696:0:8657:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:2.0:1788838374.909699:0:8657:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8ff503ca0000) now 7 - find 00000100:00000040:2.0:1788838374.909705:0:8657:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:2.0:1788838374.909707:0:8657:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:2.0:1788838374.909710:0:8657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.909722:0:8657:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8ff62bc71f80 x1875729135224064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838399 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.909734:0:8657:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 56 to 0@lo 00000100:00000040:2.0:1788838374.909738:0:8657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff50719d500 x1875729135224064/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788838394 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.909767:0:8657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1875729135224064:12345-0@lo:8:kworker.0 Request processed in 80us (472us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788838374.909773:0:8657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6075 00000100:00000040:2.0:1788838374.909841:0:3646:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838374.909846:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc70a80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.909856:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc70a80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.909862:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875729135223808:0@lo:400:kworker.0 00000100:00000040:2.0:1788838374.910448:0:3646:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838374.910456:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b6300 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.910465:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.910472:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875729135223296:0@lo:400:kworker.0 00000100:00000040:2.0:1788838374.911093:0:3646:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838374.911161:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc73100 x1875729135223936/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.911171:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc73100 x1875729135223936/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.911179:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135223936:0@lo:400:kworker.0 00000100:00000040:2.0:1788838374.911195:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc70a80 x1875729135223808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.911222:0:3646:0:(genops.c:1223:class_import_put()) import ffff8ff632feb800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788838374.911234:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135223296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.911362:0:3646:0:(genops.c:1223:class_import_put()) import ffff8ff501ab3000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788838374.911370:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc73100 x1875729135223936/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.911377:0:3646:0:(genops.c:1223:class_import_put()) import ffff8ff6271d7800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788838374.911417:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1788838374.911423:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd6e680 x1875729135223552/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.911432:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd6e680 x1875729135223552/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.911438:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135223552:0@lo:400:kworker.0 00000100:00000040:1.0:1788838374.911445:0:96975:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.203.130@tcp 192.168.203.130@tcp cnt=1 00000100:00000040:2.0:1788838374.911454:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838374.911460:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc72300 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.911466:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc72300 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.911473:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135224320:0@lo:400:kworker.0 00000020:01000004:1.0:1788838374.911479:0:96975:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000100:00000040:2.0:1788838374.911486:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838374.911501:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd6dc00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.911510:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd6dc00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1788838374.911514:0:96975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ff624ff4d28) 00000020:00000040:1.0:1788838374.911523:0:96975:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff509c61000 with handle 0x88da08396cccadcb to hash 00000100:00100000:2.0:1788838374.911529:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135223424:0@lo:400:kworker.0 00000020:00000040:1.0:1788838374.911532:0:96975:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c61000 : new refcount 1 00000100:00000040:2.0:1788838374.911548:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000020:00000040:1.0:1788838374.911549:0:96975:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8ff624ff4d28) now 2 - obd_device_list 00000100:00000040:2.0:1788838374.911553:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc73b80 x1875729135224192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1788838374.911557:0:96975:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00000040:2.0:1788838374.911559:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc73b80 x1875729135224192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.911565:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135224192:0@lo:400:kworker.0 00000100:00000040:2.0:1788838374.911570:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd6e680 x1875729135223552/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.911578:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff6061da800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788838374.911586:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc72300 x1875729135224320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.911595:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff6104d8000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788838374.911601:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd6dc00 x1875729135223424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.911608:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff5031c5000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788838374.911615:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc73b80 x1875729135224192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.911620:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff619428000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788838374.911651:0:3642:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969444 00000100:00000040:2.0:1788838374.911656:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc73800 x1875729135223680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838399 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838374.911670:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838374.911676:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:2.0:1788838374.911686:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc73800 x1875729135223680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838399 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.911693:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135223680:0@lo:8:kworker.0 00000020:01000004:1.0:1788838374.911698:0:96975:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ff50b02b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788838374.911702:0:96975:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ff50b02b000 from lustre-OST0000, refs=3 00000100:00000040:2.0:1788838374.911705:0:3642:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294969456 00000020:01000004:1.0:1788838374.911705:0:96975:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ff50b02b000 3 00000100:00000040:2.0:1788838374.911711:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc71f80 x1875729135224064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838399 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838374.911718:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788838374.911721:0:3642:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:2.0:1788838374.911725:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc71f80 x1875729135224064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838399 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838374.911726:0:96975:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8ff624ff4d28) now 3 - import 00000100:00100000:2.0:1788838374.911731:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135224064:0@lo:8:kworker.0 00000020:00000040:1.0:1788838374.911732:0:96975:0:(genops.c:1223:class_import_put()) import ffff8ff50d494800 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1788838374.911736:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc73800 x1875729135223680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838399 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.911744:0:96975:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:1.0:1788838374.911747:0:96975:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 57 to 0@lo 00000100:00000040:1.0:1788838374.911749:0:96975:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.130@tcp -> ffff8ff611edf540 00010000:00080000:1.0:1788838374.911755:0:96975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ff50d494800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.130@tcp at head 00000020:00000040:2.0:1788838374.911829:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff604585000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1788838374.911839:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc71f80 x1875729135224064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788838399 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.911848:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff62c81b000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1788838374.912430:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4299 00000100:00000040:3.0:1788838374.912436:0:23765:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff624a94800 : new rpc_count 0 00000020:00000040:3.0:1788838374.912455:0:23765:0:(genops.c:879:class_export_put()) PUTting export ffff8ff624a94800 : new refcount 4 00000020:00000040:2.0:1788838374.913003:0:96976:0:(genops.c:868:class_export_get()) GET export ffff8ff509c66800 refcount=6 00000020:00000040:2.0:1788838374.913010:0:96976:0:(genops.c:868:class_export_get()) GET export ffff8ff509c66800 refcount=7 00000020:00000040:2.0:1788838374.913015:0:96976:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c66800 : new refcount 6 00010000:00010000:1.0:1788838374.917286:0:96975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:1.0:1788838374.918404:0:96975:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8ff624ff4d28) now 4 - setup 00000020:00000080:1.0:1788838374.918414:0:96975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788838374.930997:0:96975:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000040:1.0:1788838374.931210:0:96975:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff640eeb800 with handle 0x88da08396cccadd2 to hash 00000020:00000040:1.0:1788838374.931223:0:96975:0:(genops.c:868:class_export_get()) GET export ffff8ff640eeb800 refcount=3 00000020:00000040:1.0:1788838374.931231:0:96975:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8ff624ff4d28) now 5 - export 00000020:00000040:1.0:1788838374.931234:0:96975:0:(genops.c:879:class_export_put()) PUTting export ffff8ff640eeb800 : new refcount 2 00000020:00000080:1.0:1788838374.931237:0:96975:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x88da08396cccadd2 00000020:00000040:1.0:1788838374.931241:0:96975:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadd2 00000020:00000040:1.0:1788838374.931243:0:96975:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff640eeb800 refcount=3 00000100:00080000:1.0:1788838374.931258:0:96975:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:1.0:1788838374.931263:0:96975:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 58 to 0@lo 00000020:00000040:1.0:1788838374.931266:0:96975:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadd2 00000020:00000040:1.0:1788838374.931268:0:96975:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff640eeb800 refcount=4 00000100:00000040:1.0:1788838374.931271:0:96975:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 59 to 0@lo 00000020:00000040:1.0:1788838374.931273:0:96975:0:(genops.c:879:class_export_put()) PUTting export ffff8ff640eeb800 : new refcount 3 00000100:00080000:1.0:1788838374.931275:0:96975:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ff50d494800 using connection 192.168.203.130@tcp/0@lo 00000020:00000040:1.0:1788838374.931293:0:96975:0:(genops.c:1210:class_import_get()) import ffff8ff50d494800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:1.0:1788838374.931325:0:96975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff624ebe300 x1875729135224448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838374.931448:0:96975:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008986f04a] to pc [ptlrpcd_rcv+-1] req@ffff8ff624ebe300 x1875729135224448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788838374.931474:0:96975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:1.0:1788838374.931478:0:96975:0:(genops.c:1210:class_import_get()) import ffff8ff50d494800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1788838374.931530:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff624ebe300 x1875729135224448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.931549:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875729135224448:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1788838374.931582:0:27607:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3773) 00000100:00000040:2.0:1788838374.931595:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff624ebe300 x1875729135224448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788838384 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.931619:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.931679:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd6dc00 x1875729135224448 msgsize 520 00000100:00100000:2.0:1788838374.931684:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838374.932012:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff624ebe300 x1875729135224448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788838384 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.932032:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000020:00000040:2.0:1788838374.933273:0:96975:0:(genops.c:868:class_export_get()) GET export ffff8ff640eeb800 refcount=4 00000020:00000040:2.0:1788838374.933291:0:96975:0:(genops.c:868:class_export_get()) GET export ffff8ff640eeb800 refcount=5 00000020:00000040:0.0:1788838374.933369:0:96979:0:(genops.c:879:class_export_put()) PUTting export ffff8ff640eeb800 : new refcount 4 00000040:00080000:2.0:1788838374.933420:0:96975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000100:00100000:1.0:1788838374.933618:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135224448 00000020:01000000:3.0:1788838374.933622:0:96964:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 00000100:00100000:1.0:1788838374.933631:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135224448 00000020:00000040:1.0:1788838374.933636:0:66253:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 10000000:01000000:3.0:1788838374.933680:0:96964:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:1.0:1788838374.933693:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000020:00000040:3.0:1788838374.933702:0:96964:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50712cc00 refcount=3 00000100:00000040:1.0:1788838374.933706:0:66253:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd6dc00 x1875729135224448/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1788838394 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788838374.933712:0:96964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396cccada8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccadaf expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838374.933729:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875729135224448:12345-0@lo:38:llog_process_th.0 00010000:00010000:3.0:1788838374.933733:0:96964:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50712cc00/0x88da08396cccada8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccadaf expref: -99 pid: 96964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788838374.933748:0:66253:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 10 - find 00010000:00000040:1.0:1788838374.933783:0:66253:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1788838374.933792:0:66253:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3768 last 0 00000020:00000040:1.0:1788838374.933826:0:66253:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff509c76000 with handle 0x88da08396cccadd9 to hash 00000020:00000040:1.0:1788838374.933860:0:66253:0:(genops.c:868:class_export_get()) GET export ffff8ff509c76000 refcount=3 00000020:00000040:1.0:1788838374.933865:0:66253:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 11 - export 00000020:00000040:1.0:1788838374.933869:0:66253:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c76000 : new refcount 2 00000020:00000080:1.0:1788838374.933873:0:66253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x88da08396cccadd9 00000020:00000040:1.0:1788838374.933875:0:66253:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadd9 00000020:00000040:1.0:1788838374.933877:0:66253:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff509c76000 refcount=3 00000001:00000040:1.0:1788838374.933889:0:66253:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.203.130@tcp 00000001:00000040:1.0:1788838374.933895:0:66253:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8ff62749bc00) : new refcount 18 00000020:00000040:1.0:1788838374.933900:0:66253:0:(genops.c:868:class_export_get()) GET export ffff8ff509c76000 refcount=4 00000001:00000040:1.0:1788838374.933902:0:66253:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8ff62749bc00) : new refcount 19 00000001:00000040:1.0:1788838374.933907:0:66253:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8ff62749bc00) : new refcount 18 00000004:00100000:1.0:1788838374.933914:0:66253:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:1.0:1788838374.933926:0:66253:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats ffff8ff504f60ba0 for nid 0@lo - ref 4 00000020:00000040:1.0:1788838374.933935:0:66253:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 12 - import 00000020:00000040:1.0:1788838374.933942:0:66253:0:(genops.c:1223:class_import_put()) import ffff8ff509c75000 refcount=1 obd=lustre-MDT0001 00000020:00000040:1.0:1788838374.933950:0:66253:0:(genops.c:868:class_export_get()) GET export ffff8ff509c76000 refcount=5 00000100:00000040:1.0:1788838374.933953:0:66253:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff8ff509c76000 : new rpc_count 1 00000100:00000040:1.0:1788838374.933959:0:66253:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 60 to 0@lo 00000100:00000040:1.0:1788838374.933963:0:66253:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 60 to 0@lo 00000020:00000040:1.0:1788838374.933966:0:66253:0:(genops.c:868:class_export_get()) GET export ffff8ff509c76000 refcount=6 00000100:00000040:1.0:1788838374.933975:0:66253:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 61 to 0@lo 00000100:00080000:1.0:1788838374.933986:0:66253:0:(import.c:65:import_set_state_nolock()) ffff8ff509c75000 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1788838374.933991:0:66253:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c76000 : new refcount 5 00000020:00000040:1.0:1788838374.933994:0:66253:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 12 - find 00010000:00000040:1.0:1788838374.934011:0:66253:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135224448 00000100:00000040:1.0:1788838374.934029:0:66253:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:1.0:1788838374.934037:0:66253:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838374.934144:0:66253:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8ff624ebe300 x1875729135224448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.934487:0:66253:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 61 to 0@lo 00000100:00000040:1.0:1788838374.934506:0:66253:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd6dc00 x1875729135224448/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788838394 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.934515:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875729135224448:12345-0@lo:38:llog_process_th.0 Request processed in 789us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838374.934524:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00000040:1.0:1788838374.934528:0:66253:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff509c76000 : new rpc_count 0 00000020:00000040:1.0:1788838374.934536:0:66253:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c76000 : new refcount 4 00000020:01000004:3.0:1788838374.934734:0:96964:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788838374.934738:0:96964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788838374.934740:0:96964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838374.934741:0:96964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838374.934875:0:96964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838374.934877:0:96964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838374.934878:0:96964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788838374.934881:0:96964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:2.0:1788838374.934982:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:2.0:1788838374.934988:0:3642:0:(client.c:3235:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:2.0:1788838374.934997:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff624ebe300 x1875729135224448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838374.935012:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 18 00000020:00000040:2.0:1788838374.935015:0:3642:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadd2 00000020:00000040:2.0:1788838374.935018:0:3642:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff640eeb800 refcount=5 00000100:00080000:2.0:1788838374.935025:0:3642:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:2.0:1788838374.935028:0:3642:0:(genops.c:879:class_export_put()) PUTting export ffff8ff640eeb800 : new refcount 4 00000100:00080000:2.0:1788838374.935032:0:3642:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788838374.935035:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff50d494800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:2.0:1788838374.935044:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebe300 x1875729135224448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838384 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.935052:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875729135224448:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1788838374.935061:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff624ebe300 x1875729135224448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788838384 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.935075:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff50d494800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000020:01000004:3.0:1788838374.935107:0:96964:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788838374.935114:0:96964:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788838374.935117:0:96964:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788838374.935125:0:96964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788838374.935126:0:96964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788838374.935127:0:96964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788838374.935129:0:96964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788838374.935130:0:96964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788838374.935131:0:96964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788838374.935132:0:96964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788838374.935132:0:96964:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:3.0:1788838374.935140:0:96964:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 10000000:01000000:3.0:1788838374.935165:0:96964:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:3.0:1788838374.935182:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff611a7d180 x1875729135224576/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.935195:0:96964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff611a7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135224576:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1788838374.935230:0:96964:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff611a7d180 x1875729135224576/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838374.935237:0:96964:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838374.935268:0:96964:0:(events.c:337:request_in_callback()) incoming req@ffff8ff627fe2450 x1875729135224576 msgsize 4848 00000100:00100000:3.0:1788838374.935273:0:96964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838374.935276:0:96964:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838374.935530:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff611a7d180 x1875729135224576/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838374.935575:0:96964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff632f8a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788838374.938059:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135224576 00000100:00100000:0.0:1788838374.938079:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135224576 00000020:00000040:0.0:1788838374.938083:0:94395:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:0.0:1788838374.938089:0:94395:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=24 00000100:00000040:0.0:1788838374.938129:0:94395:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788838374.938216:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00000040:0.0:1788838374.938222:0:94395:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:0.0:1788838374.938231:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff627fe2450 x1875729135224576/t0(0) o253->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 4848/0 e 0 to 0 dl 1788838385 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.938258:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff627fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135224576:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788838374.938302:0:94395:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788838374.938334:0:94395:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788838374.946469:0:94395:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788838374.946499:0:94395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788838374.946514:0:94396:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788838374.946522:0:94396:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:0.0:1788838374.946538:0:94396:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff608f3c600 count: 4 00000020:00000040:0.0:1788838374.946554:0:94396:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff509c6d600 with handle 0x88da08396cccade0 to hash 00010000:00010000:0.0:1788838374.946564:0:94396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.946588:0:94396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9ed6 expref: 24 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.946597:0:94396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396ccc9ef2 expref: 24 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.946609:0:94396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa1 expref: 9 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.946617:0:94396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.946624:0:94396:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8ff608f3c600) refcount = 4 00010000:00000040:0.0:1788838374.946628:0:94396:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788838374.946632:0:94396:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa1 expref: 9 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.946639:0:94396:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x88da08396ccc9ef2 expref: 24 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.946645:0:94396:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x88da08396ccc9ed6 expref: 24 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.946652:0:94396:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:0.0:1788838374.946668:0:94396:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788838374.946696:0:94396:0:(genops.c:1210:class_import_get()) import ffff8ff61d4bb800 refcount=2 obd=MGS 00010000:00010000:0.0:1788838374.946723:0:94396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa1 expref: 9 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.946740:0:94396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa1 expref: 9 pid: 94393 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788838374.946761:0:94396:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2d880 x1875729135224704/t0(0) o104->MGS@192.168.203.30@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838374.946777:0:94396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94396:1875729135224704:192.168.203.30@tcp:104: 00010000:00000040:1.0:1788838374.946823:0:94395:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135224576 00000100:00000040:0.0:1788838374.946839:0:94396:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff8ff62bd2d880 x1875729135224704/t0(0) o104->MGS@192.168.203.30@tcp:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838374.946840:0:94395:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:1.0:1788838374.946851:0:94395:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.946855:0:94396:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000020:00000040:0.0:1788838374.947186:0:94396:0:(genops.c:1210:class_import_get()) import ffff8ff632fea800 refcount=2 obd=MGS 00010000:00010000:0.0:1788838374.947199:0:94396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9ef2 expref: 24 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.947209:0:94396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9ef2 expref: 24 pid: 94392 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788838374.947221:0:94396:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2e680 x1875729135224832/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838374.947231:0:94396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94396:1875729135224832:0@lo:104: 00000100:00000040:1.0:1788838374.958114:0:94395:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff8ff611a7d180 x1875729135224576/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838374.958202:0:94395:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 61 to 0@lo 00000100:00000040:1.0:1788838374.958216:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff627fe2450 x1875729135224576/t0(0) o253->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 4848/4768 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.958228:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff627fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+24:96964:x1875729135224576:12345-0@lo:253:mount.lustre.0 Request processed in 19974us (22956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838374.958242:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00000040:1.0:1788838374.958246:0:94395:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:1.0:1788838374.958272:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00000040:2.0:1788838374.958300:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff611a7d180 x1875729135224576/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838374.958317:0:96964:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7d180 x1875729135224576/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838374.958327:0:96964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff611a7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57943c9a-ca27-46d8-8845-5d2bce640e45:96964:1875729135224576:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1788838374.958339:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff611a7d180 x1875729135224576/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788838374.958356:0:96964:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788838374.958361:0:96964:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788838374.958363:0:96964:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788838374.958364:0:96964:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788838374.958366:0:96964:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788838374.958367:0:96964:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788838374.958369:0:96964:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788838374.958370:0:96964:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788838374.958373:0:96964:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788838374.958374:0:96964:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:2.0:1788838374.958378:0:96964:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff611a7d180 x1875729135224576/t0(0) o253->MGC192.168.203.130@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838374.958391:0:96964:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000100:00000040:3.0:1788838374.958638:0:3636:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2d880 x1875729135224704/t0(0) o104->MGS@192.168.203.30@tcp:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788838374.958714:0:3636:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff8ff62bd2d880 x1875729135224704/t0(0) o104->MGS@192.168.203.30@tcp:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788838374.958745:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7c700 x1875729116539648 msgsize 328 00000100:00100000:3.0:1788838374.958751:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838374.958846:0:10364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116539648 00000100:00100000:1.0:1788838374.958855:0:10364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116539648 00000020:00000040:1.0:1788838374.958858:0:10364:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9da2 00000020:00000040:1.0:1788838374.958878:0:10364:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff61d4bf800 refcount=10 00000100:00000040:1.0:1788838374.958907:0:10364:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:1.0:1788838374.958919:0:10364:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50a2e8000 refcount=5 00010000:00010000:1.0:1788838374.958928:0:10364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa1 expref: 10 pid: 94393 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788838374.958983:0:10364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2603 00000100:00000040:1.0:1788838374.958988:0:10364:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff61d4bf800 : new rpc_count 1 00000100:00000040:1.0:1788838374.958993:0:10364:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7c700 x1875729116539648/t0(0) o103->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:275/0 lens 328/0 e 0 to 0 dl 1788838385 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.959007:0:10364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116539648:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788838374.959029:0:10364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1788838374.959031:0:10364:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50a2e8000 refcount=5 00010000:00000040:1.0:1788838374.959036:0:10364:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff608f3c600 count: 5 00010000:00010000:1.0:1788838374.959042:0:10364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa1 expref: 10 pid: 94393 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838374.959056:0:10364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa1 expref: 10 pid: 94393 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788838374.959082:0:10364:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8ff50a2e8000 with handle 0x88da08396ccc9f9a from hash 00010000:00000040:1.0:1788838374.959090:0:10364:0:(ldlm_lock.c:1986:ldlm_reprocess_queue()) Reprocessing lock ffff8ff509c6d600 00010000:00010000:1.0:1788838374.959098:0:10364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:1.0:1788838374.959111:0:10364:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838374.959118:0:10364:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838374.959173:0:10364:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838374.959178:0:10364:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7c700 x1875729116539648/t0(0) o103->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:275/0 lens 328/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838374.959187:0:10364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116539648:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 183us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838374.959201:0:10364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2603 00000100:00000040:1.0:1788838374.959204:0:10364:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff61d4bf800 : new rpc_count 0 00000020:00000040:1.0:1788838374.959214:0:10364:0:(genops.c:879:class_export_put()) PUTting export ffff8ff61d4bf800 : new refcount 9 00000020:02000000:2.0:1788838374.959694:0:96964:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00002000:00000040:2.0:1788838374.959919:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:2.0:1788838374.959937:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:2.0:1788838374.959990:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:2.0:1788838374.960037:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:2.0:1788838374.960083:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:2.0:1788838374.960127:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:2.0:1788838374.960155:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:2.0:1788838374.960179:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:2.0:1788838374.960219:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:2.0:1788838374.960350:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00000100:00000040:0.0:1788838374.961510:0:94396:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff8ff62bd2e680 x1875729135224832/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838374.961528:0:94396:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.961587:0:94396:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2f100 x1875729135224832 msgsize 328 00000100:00100000:0.0:1788838374.961599:0:94396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838374.961637:0:94396:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2e680 x1875729135224832/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1788838374.961693:0:94396:0:(genops.c:1210:class_import_get()) import ffff8ff632fea800 refcount=3 obd=MGS 00010000:00010000:0.0:1788838374.961723:0:94396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x88da08396ccc9ed6 expref: 23 pid: 94393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.961745:0:94396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x88da08396ccc9ed6 expref: 23 pid: 94393 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788838374.961760:0:94396:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2f800 x1875729135224960/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838374.961772:0:94396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94396:1875729135224960:0@lo:104: 00000100:00000040:0.0:1788838374.961813:0:94396:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff8ff62bd2f800 x1875729135224960/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838374.961821:0:94396:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.961836:0:94396:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2ca80 x1875729135224960 msgsize 328 00000100:00100000:0.0:1788838374.961841:0:94396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838374.961859:0:94396:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2f800 x1875729135224960/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838374.962017:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135224832 00000100:00100000:1.0:1788838374.962028:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135224832 00000020:00000040:1.0:1788838374.962031:0:6530:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cc7cf31 00000020:00000040:1.0:1788838374.962036:0:6530:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609256800 refcount=3 00000100:00000040:1.0:1788838374.962066:0:6530:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:1.0:1788838374.962096:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135224960 00000100:00100000:1.0:1788838374.962099:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135224960 00000020:00000040:1.0:1788838374.962100:0:6530:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cc7cf31 00000020:00000040:1.0:1788838374.962102:0:6530:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609256800 refcount=4 00000100:00100000:1.0:1788838374.962119:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00000040:1.0:1788838374.962124:0:6530:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609256800 : new rpc_count 1 00000100:00000040:1.0:1788838374.962129:0:6530:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2f100 x1875729135224832/t0(0) o104->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/0 e 0 to 0 dl 1788838385 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838374.962142:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+4:94396:x1875729135224832:12345-0@lo:104: 00000020:00000040:1.0:1788838374.962152:0:6530:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff5059a4a00 refcount=2 00010000:00010000:1.0:1788838374.962161:0:6530:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1788838374.962185:0:6530:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:1.0:1788838374.962191:0:6530:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838374.962211:0:6530:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff8ff62bd2e680 x1875729135224832/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788838374.962228:0:6530:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 61 to 0@lo 00000100:00100000:0.0:1788838374.962310:0:94396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee7cc0 going to sleep for 11 seconds 00000100:00000040:0.0:1788838374.962346:0:94396:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2d880 x1875729135224704/t0(0) o104->MGS@192.168.203.30@tcp:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1788838374.962360:0:94396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff50a2e8000/0x88da08396ccc9f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0x782fa01ef005cfa1 expref: 9 pid: 94393 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.962369:0:94396:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff8ff61d4bf800 : new locks_count 3 00000020:00000040:0.0:1788838374.962372:0:94396:0:(genops.c:879:class_export_put()) PUTting export ffff8ff61d4bf800 : new refcount 8 00000100:00000040:0.0:1788838374.962383:0:94396:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2d880 x1875729135224704/t0(0) o104->MGS@192.168.203.30@tcp:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838374.962567:0:10414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00000040:2.0:1788838374.962571:0:10414:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609256800 : new rpc_count 2 00000100:00000040:2.0:1788838374.962577:0:10414:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2ca80 x1875729135224960/t0(0) o104->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/0 e 0 to 0 dl 1788838385 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838374.962593:0:10414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+4:94396:x1875729135224960:12345-0@lo:104: 00000020:00000040:2.0:1788838374.962601:0:10414:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50a2e8e00 refcount=2 00010000:00010000:2.0:1788838374.962606:0:10414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788838374.962620:0:10414:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:2.0:1788838374.962624:0:10414:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838374.962647:0:10414:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff8ff62bd2f800 x1875729135224960/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838374.962668:0:10414:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 61 to 0@lo 00000100:00100000:0.0:1788838374.962711:0:94396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94396:1875729135224704:192.168.203.30@tcp:104: 00000100:00000040:0.0:1788838374.962728:0:94396:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2e680 x1875729135224832/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838374.962737:0:94396:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2e680 x1875729135224832/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838374.962743:0:94396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94396:1875729135224832:0@lo:104: 00000100:00000040:0.0:1788838374.962752:0:94396:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2f800 x1875729135224960/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838374.962760:0:94396:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2f800 x1875729135224960/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788838374.962767:0:94396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94396:1875729135224960:0@lo:104: 00000100:00000040:0.0:1788838374.962776:0:94396:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2d880 x1875729135224704/t0(0) o104->MGS@192.168.203.30@tcp:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1788838374.962789:0:94396:0:(genops.c:1223:class_import_put()) import ffff8ff61d4bb800 refcount=1 obd=MGS 00000100:00000040:0.0:1788838374.962818:0:94396:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2e680 x1875729135224832/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1788838374.962827:0:94396:0:(genops.c:1223:class_import_put()) import ffff8ff632fea800 refcount=2 obd=MGS 00000100:00000040:0.0:1788838374.962833:0:94396:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2f800 x1875729135224960/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1788838374.962840:0:94396:0:(genops.c:1223:class_import_put()) import ffff8ff632fea800 refcount=1 obd=MGS 00010000:00010000:0.0:1788838374.962855:0:94396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838374.962967:0:6530:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00000040:1.0:1788838374.962975:0:6530:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2f100 x1875729135224832/t0(0) o104->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788838374.963002:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57943c9a-ca27-46d8-8845-5d2bce640e45+4:94396:x1875729135224832:12345-0@lo:104: Request processed in 861us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838374.963011:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00000040:1.0:1788838374.963015:0:6530:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609256800 : new rpc_count 1 00000020:00000040:1.0:1788838374.963029:0:6530:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609256800 : new refcount 3 00002000:00000040:3.0:1788838374.965414:0:96964:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:3.0:1788838374.965632:0:96964:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294969477 00010000:00010000:1.0:1788838374.965930:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788838374.965944:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838374.965957:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff5059a4a00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838374.965964:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788838374.965986:0:6534:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff5059a4a00 refcount=3 00010000:00010000:1.0:1788838374.965991:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838374.966000:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838374.966007:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:1.0:1788838374.966013:0:6534:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:1.0:1788838374.966015:0:6534:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:1.0:1788838374.966035:0:6534:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8ff608f32600) refs 2 00000020:00000040:1.0:1788838374.966046:0:6534:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8ff5059a4a00 with handle 0x88da08396ccc9ef2 from hash 00000020:00000040:1.0:1788838374.966063:0:6534:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00010000:00010000:1.0:1788838374.966092:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838374.966122:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:1.0:1788838374.966144:0:6534:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004122f33f] to pc [ptlrpcd_00_02+2] req@ffff8ff624ebe680 x1875729135225088/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788838374.966179:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838374.966187:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff5059a4a00/0x88da08396ccc9ef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9ef9 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838374.966204:0:6534:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788838374.966208:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838374.966215:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff50a2e8e00 already unused, calling callback (ffffffffc13dbc20) 10000000:00010000:1.0:1788838374.966217:0:6534:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788838374.966224:0:6534:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50a2e8e00 refcount=3 00010000:00010000:1.0:1788838374.966227:0:6534:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788838374.966233:0:6534:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788838374.966238:0:6534:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:1.0:1788838374.966241:0:6534:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:1.0:1788838374.966242:0:6534:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:1.0:1788838374.966247:0:6534:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8ff5048cdc00) refs 2 00000020:00000040:1.0:1788838374.966251:0:6534:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8ff50a2e8e00 with handle 0x88da08396ccc9ed6 from hash 00000020:00000040:1.0:1788838374.966263:0:6534:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00010000:00010000:1.0:1788838374.966272:0:6534:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838374.966278:0:6534:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:1.0:1788838374.966285:0:6534:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000569027c8] to pc [ptlrpcd_00_03+3] req@ffff8ff624ebed80 x1875729135225216/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788838374.966296:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788838374.966302:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff8ff50a2e8e00/0x88da08396ccc9ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x88da08396ccc9edd expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788838374.966308:0:6534:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff8ff60b5cff00 count: 0 00010000:00010000:1.0:1788838374.966323:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788838374.966326:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1788838374.966329:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff624ebe680 x1875729135225088/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788838374.966330:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838374.966361:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135225088:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1788838374.966599:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff624ebe680 x1875729135225088/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.966610:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.966666:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62ce53850 x1875729135225088 msgsize 328 00000100:00100000:0.0:1788838374.966671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838374.966673:0:3645:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838374.966698:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff624ebe680 x1875729135225088/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.966741:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1788838374.966747:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff624ebed80 x1875729135225216/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.966755:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135225216:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1788838374.966769:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff624ebed80 x1875729135225216/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.966776:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.966790:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2f800 x1875729135225216 msgsize 328 00000100:00100000:0.0:1788838374.966794:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838374.966833:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff624ebed80 x1875729135225216/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.966864:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135225088 00000100:00100000:0.0:1788838374.966938:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135225088 00000020:00000040:0.0:1788838374.966943:0:7497:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:0.0:1788838374.966946:0:7497:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=24 00000100:00000040:0.0:1788838374.966972:0:7497:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00010000:00080000:1.0:1788838374.966978:0:96981:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 96981 00000020:00000040:0.0:1788838374.966982:0:7497:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff626ab8400 refcount=4 00010000:02000000:1.0:1788838374.966990:0:96981:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00010000:0.0:1788838374.966991:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9ef2 expref: 24 pid: 94392 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838374.967041:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135225216 00000100:00100000:0.0:1788838374.967046:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135225216 00000020:00000040:0.0:1788838374.967048:0:7497:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:0.0:1788838374.967050:0:7497:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=25 00000020:01000004:1.0:1788838374.967054:0:96964:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:1.0:1788838374.967062:0:96964:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8ff508ba4a80 : new refcount 2 00000020:00000040:0.0:1788838374.967064:0:7497:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff504627c00 refcount=4 00000040:00000040:1.0:1788838374.967068:0:96964:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8ff508ba4a80 : new refcount 1 00010000:00010000:0.0:1788838374.967071:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9ed6 expref: 25 pid: 94393 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788838374.967099:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00000040:0.0:1788838374.967104:0:7497:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:0.0:1788838374.967111:0:7497:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62ce53850 x1875729135225088/t0(0) o103->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/0 e 0 to 0 dl 1788838385 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838374.967114:0:96964:0:(genops.c:879:class_export_put()) PUTting export ffff8ff50b02d000 : new refcount 1 00000100:00100000:0.0:1788838374.967130:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62ce53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+25:3645:x1875729135225088:12345-0@lo:103:ldlm_bl.0 00000020:00000040:1.0:1788838374.967133:0:96964:0:(obd_config.c:1023:class_decref()) Decref MGC192.168.203.130@tcp (ffff8ff610244d28) now 6 - mgc_fs 10000000:01000000:1.0:1788838374.967139:0:96964:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00010000:00010000:0.0:1788838374.967146:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1788838374.967150:0:7497:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff626ab8400 refcount=4 00010000:00000040:0.0:1788838374.967154:0:7497:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff608f3c600 count: 4 00010000:00010000:0.0:1788838374.967159:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9ef2 expref: 25 pid: 94392 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788838374.967162:0:96964:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00010000:00010000:0.0:1788838374.967175:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9ef2 expref: 25 pid: 94392 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788838374.967191:0:7497:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8ff626ab8400 with handle 0x88da08396ccc9ef9 from hash 00000080:00000004:1.0:1788838374.967197:0:96964:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00010000:00010000:0.0:1788838374.967197:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff626ab8400/0x88da08396ccc9ef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9ef2 expref: 25 pid: 94392 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.967205:0:7497:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff8ff639712000 : new locks_count 17 00000020:00000040:0.0:1788838374.967208:0:7497:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 24 00010000:00000040:0.0:1788838374.967223:0:7497:0:(ldlm_lock.c:1986:ldlm_reprocess_queue()) Reprocessing lock ffff8ff509c6d600 00010000:00010000:0.0:1788838374.967229:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1788838374.967306:0:7497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:0.0:1788838374.967314:0:7497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.967338:0:7497:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff624ebe680 x1875729135225088/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.967363:0:7497:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 61 to 0@lo 00000100:00000040:0.0:1788838374.967369:0:7497:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62ce53850 x1875729135225088/t0(0) o103->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.967380:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62ce53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135225088:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838374.967389:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00000040:0.0:1788838374.967394:0:7497:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:0.0:1788838374.967656:0:7497:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00100000:0.0:1788838374.967723:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00000040:0.0:1788838374.967727:0:7497:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:0.0:1788838374.967732:0:7497:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2f800 x1875729135225216/t0(0) o103->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/0 e 0 to 0 dl 1788838385 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.967993:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+23:3645:x1875729135225216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788838374.968007:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1788838374.968011:0:7497:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff504627c00 refcount=4 00010000:00000040:0.0:1788838374.968014:0:7497:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff608f3c600 count: 3 00010000:00010000:0.0:1788838374.968020:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x88da08396ccc9ed6 expref: 23 pid: 94393 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.968033:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x88da08396ccc9ed6 expref: 23 pid: 94393 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788838374.968047:0:7497:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8ff504627c00 with handle 0x88da08396ccc9edd from hash 00010000:00010000:0.0:1788838374.968060:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff504627c00/0x88da08396ccc9edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x88da08396ccc9ed6 expref: 23 pid: 94393 timeout: 3868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.968071:0:7497:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff8ff639712000 : new locks_count 16 00000020:00000040:0.0:1788838374.968073:0:7497:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 22 00010000:00000040:0.0:1788838374.968077:0:7497:0:(ldlm_lock.c:1986:ldlm_reprocess_queue()) Reprocessing lock ffff8ff509c6d600 00010000:00010000:0.0:1788838374.968084:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.968092:0:7497:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8ff608f3c600) refcount = 2 00010000:00010000:0.0:1788838374.968097:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788838374.968117:0:7497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.021596606s 00000020:00000040:0.0:1788838374.968123:0:7497:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff509c6d600 refcount=5 00010000:00010000:0.0:1788838374.968128:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.968137:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.968145:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.968155:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.968162:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ff509c6d600 already unused, calling callback (ffffffffc0dd5350) 00010000:00010000:0.0:1788838374.968173:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788838374.968180:0:7497:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff509c6d600 refcount=6 00010000:00010000:0.0:1788838374.968191:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788838374.968206:0:7497:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8ff509c6d600 with handle 0x88da08396cccade0 from hash 00010000:00010000:0.0:1788838374.968212:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.968226:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1788838374.968235:0:7497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:0.0:1788838374.968240:0:7497:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838374.968271:0:7497:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff624ebed80 x1875729135225216/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000004:1.0:1788838374.968281:0:96964:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788838374.968586:0:96964:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00000040:0.0:1788838374.968845:0:7497:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 61 to 0@lo 00000100:00000040:0.0:1788838374.968853:0:7497:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2f800 x1875729135225216/t0(0) o103->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.968864:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:57943c9a-ca27-46d8-8845-5d2bce640e45+22:3645:x1875729135225216:12345-0@lo:103:ldlm_bl.0 Request processed in 1120us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838374.968874:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00000040:0.0:1788838374.968877:0:7497:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:0.0:1788838374.968891:0:7497:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 21 00000100:00000040:0.0:1788838374.968984:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff624ebed80 x1875729135225216/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.969000:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebed80 x1875729135225216/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.969015:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135225216:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1788838374.969030:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff624ebe680 x1875729135225088/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838374.969043:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebe680 x1875729135225088/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838374.969064:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff624ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135225088:0@lo:103:ldlm_bl.0 00000100:00000040:0.0:1788838374.969076:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff624ebed80 x1875729135225216/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838374.969091:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000100:00000040:0.0:1788838374.969106:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff624ebe680 x1875729135225088/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788838390 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838374.969118:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00010000:00010000:0.0:1788838374.969147:0:94396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.969161:0:94396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838374.969172:0:94396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ff509c6d600/0x88da08396cccade0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838374.969184:0:94396:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff8ff608f3c600 count: 0 00010000:00010000:3.0:1788838374.971100:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838374.971773:0:10414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00080000:3.0:1788838374.971861:0:96981:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1788838374.971867:0:96981:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:2.0:1788838374.971898:0:10414:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2ca80 x1875729135224960/t0(0) o104->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:275/0 lens 328/224 e 0 to 0 dl 1788838385 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788838374.971913:0:10414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:57943c9a-ca27-46d8-8845-5d2bce640e45+3:94396:x1875729135224960:12345-0@lo:104: Request processed in 9323us (10073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838374.971924:0:10414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00000040:2.0:1788838374.971929:0:10414:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609256800 : new rpc_count 0 00000020:00000040:2.0:1788838374.971949:0:10414:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609256800 : new refcount 2 00010000:00010000:0.0:1788838375.614180:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:1.0:1788838376.065921:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff632f1e850 x1875729116539776 msgsize 328 00000100:00100000:1.0:1788838376.065943:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:1.0:1788838376.066499:0:3636:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1788838376.067778:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116539776 00000100:00100000:3.0:1788838376.067827:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116539776 00000020:00000040:3.0:1788838376.067832:0:94392:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9da2 00000020:00000040:3.0:1788838376.067840:0:94392:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff61d4bf800 refcount=9 00000100:00000040:3.0:1788838376.067878:0:94392:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838376.067922:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 211 00000100:00000040:3.0:1788838376.067928:0:94392:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff61d4bf800 : new rpc_count 1 00000100:00000040:3.0:1788838376.067938:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff632f1e850 x1875729116539776/t0(0) o101->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.067967:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+9:70927:x1875729116539776:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838376.067989:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:3.0:1788838376.068014:0:94392:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50712d000 with handle 0x88da08396cccade7 to hash 00010000:00010000:3.0:1788838376.068021:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712d000/0x88da08396cccade7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x782fa01ef005d305 expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838376.068031:0:94392:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8ff61d4bf800 : new locks_count 4 00000020:00000040:3.0:1788838376.068034:0:94392:0:(genops.c:868:class_export_get()) GET export ffff8ff61d4bf800 refcount=10 00010000:00000040:3.0:1788838376.068059:0:94392:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8ff50514dd00) refcount = 1 00010000:00010000:3.0:1788838376.068066:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712d000/0x88da08396cccade7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d305 expref: 10 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838376.068079:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712d000/0x88da08396cccade7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d305 expref: 10 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838376.068090:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712d000, rc 0) 00010000:00000040:3.0:1788838376.068096:0:94392:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116539776 00000100:00000040:3.0:1788838376.068111:0:94392:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.068128:0:94392:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.068204:0:94392:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.068211:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff632f1e850 x1875729116539776/t0(0) o101->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:277/0 lens 328/344 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.068220:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116539776:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 256us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838376.068229:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 211 00000100:00000040:3.0:1788838376.068233:0:94392:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff61d4bf800 : new rpc_count 0 00000020:00000040:3.0:1788838376.068246:0:94392:0:(genops.c:879:class_export_put()) PUTting export ffff8ff61d4bf800 : new refcount 9 00000100:00000040:1.0:1788838376.074968:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff632f1e050 x1875729116539904 msgsize 304 00000100:00100000:1.0:1788838376.074991:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:1.0:1788838376.074994:0:3638:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1788838376.075746:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116539904 00000100:00100000:2.0:1788838376.075763:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116539904 00000020:00000040:2.0:1788838376.075768:0:94393:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9da2 00000020:00000040:2.0:1788838376.075775:0:94393:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff61d4bf800 refcount=10 00000100:00000040:2.0:1788838376.075838:0:94393:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788838376.075885:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 212 00000100:00000040:2.0:1788838376.075891:0:94393:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff61d4bf800 : new rpc_count 1 00000100:00000040:2.0:1788838376.075925:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff632f1e050 x1875729116539904/t0(0) o256->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:277/0 lens 304/0 e 0 to 0 dl 1788838387 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.076478:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116539904:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788838376.076658:0:94393:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:2.0:1788838376.076679:0:94393:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1788838376.076687:0:94393:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788838376.076690:0:94393:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 130 00000020:00000040:2.0:1788838376.076704:0:94393:0:(genops.c:868:class_export_get()) GET export ffff8ff61d4bf800 refcount=11 00000020:00000040:2.0:1788838376.079514:0:94393:0:(genops.c:879:class_export_put()) PUTting export ffff8ff61d4bf800 : new refcount 10 00010000:00000040:2.0:1788838376.081112:0:94393:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116539904 00000100:00000040:2.0:1788838376.081136:0:94393:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838376.081148:0:94393:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838376.081227:0:94393:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 8 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838376.081242:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff632f1e050 x1875729116539904/t0(0) o256->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:277/0 lens 304/240 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.081257:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2af93169-6705-472b-b7ff-fd7cc5c04782+10:70927:x1875729116539904:12345-192.168.203.30@tcp:256:ll_cfg_requeue.0 Request processed in 5318us (6296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838376.081270:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 212 00000100:00000040:2.0:1788838376.081275:0:94393:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff61d4bf800 : new rpc_count 0 00000020:00000040:2.0:1788838376.081291:0:94393:0:(genops.c:879:class_export_put()) PUTting export ffff8ff61d4bf800 : new refcount 9 00000100:00000040:3.0:1788838376.088222:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7c700 x1875729116540032 msgsize 520 00000100:00100000:3.0:1788838376.088249:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.089449:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116540032 00000100:00100000:1.0:1788838376.089466:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116540032 00000020:00000040:1.0:1788838376.089470:0:26207:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccca1b5 00000100:00100000:1.0:1788838376.089734:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6076 00000100:00000040:1.0:1788838376.089747:0:26207:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7c700 x1875729116540032/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838396 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838376.089761:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2403:x1875729116540032:12345-192.168.203.30@tcp:8:ll_cfg_requeue.0 00000020:00000040:1.0:1788838376.089790:0:26207:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 7 - find 00010000:00000040:1.0:1788838376.089843:0:26207:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1788838376.089855:0:26207:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'efc561ba-875e-4857-b79b-9bd7023bd57c' at ffff8ff604961800, cookie 0x88da08396cccad93 00010000:00080000:1.0:1788838376.089863:0:26207:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp recovering/t4294969457 exp ffff8ff604961800 cur 3770 last 1788838374 00010000:02000400:1.0:1788838376.089875:0:26207:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:1.0:1788838376.089884:0:26207:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:1.0:1788838376.089899:0:26207:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8ff62749bc00) : new refcount 19 00000020:00000040:1.0:1788838376.089904:0:26207:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=4 00000001:00000040:1.0:1788838376.089906:0:26207:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8ff62749bc00) : new refcount 20 00000001:00000040:1.0:1788838376.089910:0:26207:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8ff62749bc00) : new refcount 19 00002000:00100000:1.0:1788838376.089915:0:26207:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli efc561ba-875e-4857-b79b-9bd7023bd57c/ffff8ff604961800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788838376.089938:0:26207:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:1.0:1788838376.089963:0:26207:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats ffff8ff624f1dba0 for nid 192.168.203.30@tcp - ref 2 00000020:00000040:1.0:1788838376.090266:0:26207:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 8 - import 00000020:00000040:1.0:1788838376.090276:0:26207:0:(genops.c:1223:class_import_put()) import ffff8ff627f2d800 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1788838376.090298:0:26207:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=5 00000100:00000040:1.0:1788838376.090301:0:26207:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.090320:0:26207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.090325:0:26207:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff633208380 refcount 9 to 192.168.203.30@tcp 00000020:00000040:1.0:1788838376.090328:0:26207:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=6 00000100:00000040:1.0:1788838376.090335:0:26207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00000100:00080000:1.0:1788838376.090347:0:26207:0:(import.c:65:import_set_state_nolock()) ffff8ff627f2d800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1788838376.090367:0:26207:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 5 00000020:00000040:1.0:1788838376.090370:0:26207:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8ff503ca0000) now 8 - find 00010000:00000040:1.0:1788838376.090389:0:26207:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 0, xid 1875729116540032 00000100:00000040:1.0:1788838376.090399:0:26207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.090407:0:26207:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.090477:0:26207:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.090494:0:26207:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7c700 x1875729116540032/t0(0) o8->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:0/0 lens 520/416 e 0 to 0 dl 1788838396 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838376.090508:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116540032:12345-192.168.203.30@tcp:8:ll_cfg_requeue.0 Request processed in 746us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838376.090519:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6076 00000100:00000040:1.0:1788838376.090524:0:26207:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.090539:0:26207:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 4 00000100:00000040:2.0:1788838376.125064:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd6e680 x1875729116509440 msgsize 440 00000100:00100000:2.0:1788838376.125083:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.132702:0:24889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116509440 00000100:00100000:3.0:1788838376.132726:0:24889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116509440 00000020:00000040:3.0:1788838376.132730:0:24889:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.132738:0:24889:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=5 00000100:00000040:3.0:1788838376.132785:0:24889:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.132871:0:24889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1048 00000100:00000040:3.0:1788838376.132877:0:24889:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.132888:0:24889:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd6e680 x1875729116509440/t0(4294969478) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.132907:0:24889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116509440:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:3.0:1788838376.132922:0:24889:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bd6e680 x1875729116509440/t0(4294969478) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.132932:0:24889:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969478, current: 4294969478, replaying 00010000:00000040:3.0:1788838376.132937:0:24889:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.133850:0:24889:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd6e680 x1875729116509440/t0(4294969478) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.133884:0:24889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116509440:12345-192.168.203.30@tcp:10:dd.0 Request processed in 981us (8821us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.133892:0:24889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1048 00000100:00000040:3.0:1788838376.133895:0:24889:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.135568:0:96981:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:00000004:0.0:1788838376.390116:0:97030:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788838376.390598:0:97030:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:00000040:2.0:1788838376.510691:0:6544:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8ff5048cdc00) refs 2 10000000:01000000:2.0:1788838376.510707:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788838376.510712:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff50a9bc000 from 130 10000000:01000000:2.0:1788838376.510718:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:2.0:1788838376.510736:0:6544:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:2.0:1788838376.510792:0:6544:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50718f600 with handle 0x88da08396cccadee to hash 00010000:00010000:2.0:1788838376.510916:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396cccadee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838376.510928:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396cccadee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838376.510944:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396cccadee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788838376.511453:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135225344/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.511473:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135225344:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1788838376.511526:0:6544:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135225344/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.511536:0:6544:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838376.511600:0:6544:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61211e050 x1875729135225344 msgsize 328 00000100:00100000:2.0:1788838376.511606:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838376.511608:0:6544:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788838376.511648:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff6329b6300 x1875729135225344/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.511687:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838376.511949:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135225344 00000100:00100000:3.0:1788838376.512029:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135225344 00000020:00000040:3.0:1788838376.512034:0:94392:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:3.0:1788838376.512040:0:94392:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=22 00000100:00000040:3.0:1788838376.512074:0:94392:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838376.512111:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00000040:3.0:1788838376.512117:0:94392:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:3.0:1788838376.512123:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61211e050 x1875729135225344/t0(0) o101->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.512138:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+22:6544:x1875729135225344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788838376.512159:0:94392:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1788838376.512173:0:94392:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff50514dd00 count: 2 00000020:00000040:3.0:1788838376.512181:0:94392:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff50712c800 with handle 0x88da08396cccadf5 to hash 00010000:00010000:3.0:1788838376.512188:0:94392:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff50712c800/0x88da08396cccadf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396cccadee expref: -99 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788838376.512197:0:94392:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8ff639712000 : new locks_count 17 00000020:00000040:3.0:1788838376.512200:0:94392:0:(genops.c:868:class_export_get()) GET export ffff8ff639712000 refcount=23 00010000:00000040:3.0:1788838376.512225:0:94392:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8ff50514dd00) refcount = 2 00010000:00000040:3.0:1788838376.512229:0:94392:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1788838376.512237:0:94392:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50712d000/0x88da08396cccade7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d305 expref: 9 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838376.512246:0:94392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff50712c800/0x88da08396cccadf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396cccadee expref: 23 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838376.512270:0:94392:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff50712c800/0x88da08396cccadf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396cccadee expref: 23 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788838376.512282:0:94392:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff50712c800, rc 0) 00010000:00000040:3.0:1788838376.512286:0:94392:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135225344 00000100:00000040:3.0:1788838376.512298:0:94392:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:3.0:1788838376.512303:0:94392:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838376.512330:0:94392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8ff6329b6300 x1875729135225344/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838376.513490:0:94392:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 61 to 0@lo 00000100:00000040:3.0:1788838376.513503:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61211e050 x1875729135225344/t0(0) o101->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:277/0 lens 328/344 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.513508:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6329b6300 x1875729135225344/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.513514:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135225344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1379us (1912us total) trans 0 rc 0/0 00000100:00000040:2.0:1788838376.513520:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135225344/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.513524:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00000040:3.0:1788838376.513529:0:94392:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000100:00100000:2.0:1788838376.513530:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135225344:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1788838376.513540:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135225344/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838376.513545:0:94392:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 22 00000020:00000040:2.0:1788838376.513566:0:6544:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50718f600 refcount=4 00010000:00000040:2.0:1788838376.513572:0:6544:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8ff50718f600, remote cookie: 0x88da08396cccadf5, flags: 0x0 00010000:00000040:2.0:1788838376.513580:0:6544:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8ff60574c200) refcount = 1 00010000:00010000:2.0:1788838376.513585:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396cccadee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccadf5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838376.513598:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396cccadee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396cccadf5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788838376.513608:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135225344/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838376.513619:0:6544:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 10000000:00000040:2.0:1788838376.513632:0:6544:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8ff5048cdc00) refs 3 00000020:00000040:2.0:1788838376.513636:0:6544:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50718f600 refcount=3 00000020:00000040:2.0:1788838376.513656:0:6544:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:2.0:1788838376.513679:0:6544:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:2.0:1788838376.513697:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6329b6300 x1875729135225472/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.513708:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135225472:0@lo:256:ll_cfg_requeue.0 00000100:00000040:2.0:1788838376.513736:0:6544:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6329b6300 x1875729135225472/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.513744:0:6544:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838376.513777:0:6544:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61211fc50 x1875729135225472 msgsize 304 00000100:00100000:2.0:1788838376.513782:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838376.513784:0:6544:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788838376.513829:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff6329b6300 x1875729135225472/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.513858:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff505a5e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788838376.514052:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135225472 00000100:00100000:3.0:1788838376.514061:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135225472 00000020:00000040:3.0:1788838376.514064:0:94395:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:3.0:1788838376.514068:0:94395:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=23 00000100:00000040:3.0:1788838376.514091:0:94395:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838376.514125:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00000040:3.0:1788838376.514130:0:94395:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:3.0:1788838376.514136:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61211fc50 x1875729135225472/t0(0) o256->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:277/0 lens 304/0 e 0 to 0 dl 1788838387 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.514149:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135225472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788838376.514179:0:94395:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:3.0:1788838376.514191:0:94395:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1788838376.514199:0:94395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788838376.514202:0:94395:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 130 00000020:00000040:3.0:1788838376.514209:0:94395:0:(genops.c:868:class_export_get()) GET export ffff8ff639712000 refcount=24 00000020:00000040:3.0:1788838376.514945:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00010000:00000040:3.0:1788838376.515186:0:94395:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135225472 00000100:00000040:3.0:1788838376.515200:0:94395:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:3.0:1788838376.515207:0:94395:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838376.515229:0:94395:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff8ff6329b6300 x1875729135225472/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838376.515251:0:94395:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 61 to 0@lo 00000100:00000040:3.0:1788838376.515258:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61211fc50 x1875729135225472/t0(0) o256->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:277/0 lens 304/240 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.515269:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135225472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1122us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838376.515278:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00000040:3.0:1788838376.515282:0:94395:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:3.0:1788838376.515294:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 22 00000100:00000040:0.0:1788838376.515395:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff8ff6329b6300 x1875729135225472/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838376.515409:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff8ff6329b6300 x1875729135225472/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838376.515419:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135225472/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838376.515427:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6329b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135225472:0@lo:256:ll_cfg_requeue.0 00000100:00000040:0.0:1788838376.515445:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6329b6300 x1875729135225472/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:0.0:1788838376.515458:0:6544:0:(mgc_request.c:1600:mgc_process_recover_log()) Latest version 130, more 0. 10000000:00000040:0.0:1788838376.515473:0:6544:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1788838376.515502:0:6544:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.203.130@tcp has 192.168.203.130@tcp. 10000000:00000040:0.0:1788838376.515523:0:6544:0:(mgc_request.c:1470:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:0.0:1788838376.515528:0:6544:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8ff62c81b000 already not connected (conn 7, was 0): DISCONN 00000100:00000040:0.0:1788838376.515540:0:6544:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:0.0:1788838376.515543:0:6544:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:0.0:1788838376.515546:0:6544:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.130@tcp -> ffff8ff611edf540 00010000:00080000:0.0:1788838376.515550:0:6544:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8ff62c81b000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.130@tcp, moved to head 00010000:00000040:0.0:1788838376.515554:0:6544:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 61 to 0@lo 00000100:00080000:0.0:1788838376.515560:0:6544:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:0.0:1788838376.515566:0:6544:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 60 to 0@lo 00000100:00000040:0.0:1788838376.515569:0:6544:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 61 to 0@lo 00000020:00000040:0.0:1788838376.515571:0:6544:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e6d 00000020:00000040:0.0:1788838376.515576:0:6544:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff602d1e800 refcount=4 00000100:00000040:0.0:1788838376.515579:0:6544:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 60 to 0@lo 00000100:00000040:0.0:1788838376.515582:0:6544:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 61 to 0@lo 00000020:00000040:0.0:1788838376.515585:0:6544:0:(genops.c:879:class_export_put()) PUTting export ffff8ff602d1e800 : new refcount 3 00000100:00080000:0.0:1788838376.515588:0:6544:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ff62c81b000 using connection 192.168.203.130@tcp/0@lo 00000020:00000040:0.0:1788838376.515607:0:6544:0:(genops.c:1210:class_import_get()) import ffff8ff62c81b000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1788838376.515632:0:6544:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bd2dc00 x1875729135225600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788838376.515649:0:6544:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000719ec315] to pc [ptlrpcd_rcv+-1] req@ffff8ff62bd2dc00 x1875729135225600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:0.0:1788838376.515676:0:6544:0:(mgc_request.c:1487:mgc_apply_recover_logs()) ir apply logs 130/130 for lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1788838376.515693:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6329b6300 x1875729135225472/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838376.515704:0:6544:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:0.0:1788838376.515708:0:6544:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 10000000:01000000:0.0:1788838376.515747:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:0.0:1788838376.515755:0:6544:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff50718f600 refcount=3 00010000:00010000:0.0:1788838376.515764:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396cccadee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccadf5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838376.515778:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396cccadee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccadf5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:0.0:1788838376.515791:0:6544:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8ff608f32600) refs 2 10000000:00000040:0.0:1788838376.515794:0:6544:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8ff5048cdc00) refs 3 00000100:00000040:2.0:1788838376.516062:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2dc00 x1875729135225600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.516077:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135225600:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1788838376.516104:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2dc00 x1875729135225600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838401 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.516113:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838376.516144:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6329b6300 x1875729135225600 msgsize 520 00000100:00100000:2.0:1788838376.516148:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838376.516166:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2dc00 x1875729135225600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838401 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.516183:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8376 usecs (9 jiffies) 00000100:00100000:3.0:1788838376.516448:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135225600 00000100:00100000:3.0:1788838376.516457:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135225600 00000020:00000040:3.0:1788838376.516460:0:8463:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e82 00000100:00100000:3.0:1788838376.516559:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6077 00000100:00000040:3.0:1788838376.516567:0:8463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6329b6300 x1875729135225600/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838396 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.516580:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6329b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875729135225600:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:3.0:1788838376.516605:0:8463:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 8 - find 00010000:00000040:3.0:1788838376.516623:0:8463:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1788838376.516640:0:8463:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8ff63a64b800, cookie 0x88da08396cccad8c 00010000:00080000:3.0:1788838376.516646:0:8463:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294969473 exp ffff8ff63a64b800 cur 3770 last 1788838374 00000001:00000040:3.0:1788838376.516671:0:8463:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.203.130@tcp 00000001:00000040:3.0:1788838376.516678:0:8463:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8ff62749bc00) : new refcount 20 00000020:00000040:3.0:1788838376.516683:0:8463:0:(genops.c:868:class_export_get()) GET export ffff8ff63a64b800 refcount=4 00000001:00000040:3.0:1788838376.516686:0:8463:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8ff62749bc00) : new refcount 21 00000001:00000040:3.0:1788838376.516691:0:8463:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8ff62749bc00) : new refcount 20 00002000:00100000:3.0:1788838376.516695:0:8463:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ff63a64b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788838376.516700:0:8463:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788838376.516705:0:8463:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:3.0:1788838376.516719:0:8463:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats ffff8ff610de82a0 for nid 0@lo - ref 2 00000020:00000040:3.0:1788838376.516900:0:8463:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 9 - import 00000020:00000040:3.0:1788838376.516908:0:8463:0:(genops.c:1223:class_import_put()) import ffff8ff5021a3800 refcount=1 obd=lustre-OST0000 00000020:00000040:3.0:1788838376.516918:0:8463:0:(genops.c:868:class_export_get()) GET export ffff8ff63a64b800 refcount=5 00000100:00000040:3.0:1788838376.516921:0:8463:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff8ff63a64b800 : new rpc_count 1 00000100:00000040:3.0:1788838376.516927:0:8463:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:3.0:1788838376.516930:0:8463:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 62 to 0@lo 00000020:00000040:3.0:1788838376.516933:0:8463:0:(genops.c:868:class_export_get()) GET export ffff8ff63a64b800 refcount=6 00000100:00000040:3.0:1788838376.516939:0:8463:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 63 to 0@lo 00000100:00080000:3.0:1788838376.516951:0:8463:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a3800 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1788838376.516963:0:8463:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a64b800 : new refcount 5 00000020:00000040:3.0:1788838376.516967:0:8463:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8ff503ca0000) now 9 - find 00010000:00000040:3.0:1788838376.516985:0:8463:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969473, transno 0, xid 1875729135225600 00000100:00000040:3.0:1788838376.516994:0:8463:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 64 to 0@lo 00000100:00000040:3.0:1788838376.517001:0:8463:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838376.517032:0:8463:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8ff62bd2dc00 x1875729135225600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838401 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838376.517063:0:8463:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 63 to 0@lo 00000100:00000040:3.0:1788838376.517074:0:8463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6329b6300 x1875729135225600/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788838396 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.517085:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6329b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135225600:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 505us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838376.517094:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6077 00000100:00000040:3.0:1788838376.517097:0:8463:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a64b800 : new rpc_count 0 00000020:00000040:3.0:1788838376.517107:0:8463:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a64b800 : new refcount 4 10000000:01000000:0.0:1788838376.517174:0:6544:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788838376.517179:0:6544:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ff503592800 from 130 10000000:01000000:0.0:1788838376.517183:0:6544:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:0.0:1788838376.517190:0:6544:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00010000:00000040:0.0:1788838376.517215:0:6544:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff60574c200 count: 2 00000020:00000040:0.0:1788838376.517225:0:6544:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff509c6d800 with handle 0x88da08396cccadfc to hash 00010000:00010000:0.0:1788838376.517237:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396cccadfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838376.517246:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396cccadfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838376.517257:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396cccadfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788838376.517277:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2df80 x1875729135225728/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838376.517302:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135225728:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1788838376.517325:0:6544:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2df80 x1875729135225728/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838376.517332:0:6544:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838376.517367:0:6544:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61211c450 x1875729135225728 msgsize 328 00000100:00100000:0.0:1788838376.517373:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838376.517375:0:6544:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838376.517391:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff62bd2df80 x1875729135225728/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838376.517418:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788838376.517443:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135225728 00000100:00100000:0.0:1788838376.517448:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135225728 00000020:00000040:0.0:1788838376.517451:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:0.0:1788838376.517455:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=23 00000100:00000040:0.0:1788838376.517477:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788838376.517510:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00000040:0.0:1788838376.517514:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:0.0:1788838376.517519:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61211c450 x1875729135225728/t0(0) o101->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838376.517531:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+23:6544:x1875729135225728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788838376.517543:0:94398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1788838376.517554:0:94398:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8ff50514dd00 count: 3 00000020:00000040:0.0:1788838376.517560:0:94398:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8ff509c6de00 with handle 0x88da08396cccae03 to hash 00010000:00010000:0.0:1788838376.517565:0:94398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ff509c6de00/0x88da08396cccae03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x88da08396cccadfc expref: -99 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838376.517573:0:94398:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8ff639712000 : new locks_count 18 00000020:00000040:0.0:1788838376.517583:0:94398:0:(genops.c:868:class_export_get()) GET export ffff8ff639712000 refcount=24 00010000:00000040:0.0:1788838376.517605:0:94398:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8ff50514dd00) refcount = 3 00010000:00000040:0.0:1788838376.517609:0:94398:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788838376.517612:0:94398:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50712c800/0x88da08396cccadf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396cccadee expref: 24 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788838376.517622:0:94398:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8ff50712d000/0x88da08396cccade7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0x782fa01ef005d305 expref: 9 pid: 94392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838376.517629:0:94398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ff509c6de00/0x88da08396cccae03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x88da08396cccadfc expref: 24 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838376.517641:0:94398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ff509c6de00/0x88da08396cccae03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x88da08396cccadfc expref: 24 pid: 94398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838376.517653:0:94398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ff509c6de00, rc 0) 00010000:00000040:0.0:1788838376.517656:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135225728 00000100:00000040:0.0:1788838376.517661:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 64 to 0@lo 00000100:00000040:0.0:1788838376.517665:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838376.517682:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8ff62bd2df80 x1875729135225728/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838376.517707:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 63 to 0@lo 00000100:00000040:0.0:1788838376.517712:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61211c450 x1875729135225728/t0(0) o101->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:277/0 lens 328/344 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838376.517718:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135225728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838376.517724:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00000040:0.0:1788838376.517726:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:0.0:1788838376.517736:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00000040:0.0:1788838376.517778:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2df80 x1875729135225728/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838376.517793:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2df80 x1875729135225728/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838376.517814:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135225728:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1788838376.517821:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2df80 x1875729135225728/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838376.517833:0:6544:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff509c6d800 refcount=4 00010000:00000040:0.0:1788838376.517838:0:6544:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8ff509c6d800, remote cookie: 0x88da08396cccae03, flags: 0x0 00010000:00000040:0.0:1788838376.517843:0:6544:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8ff60574c200) refcount = 2 00010000:00000040:0.0:1788838376.517846:0:6544:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788838376.517848:0:6544:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.203.130@tcp lock: ffff8ff50718f600/0x88da08396cccadee lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396cccadf5 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838376.517855:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396cccadfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccae03 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788838376.517864:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396cccadfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x88da08396cccae03 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788838376.517873:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2df80 x1875729135225728/t0(0) o101->MGC192.168.203.130@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788838392 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838376.517884:0:6544:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 10000000:00000040:0.0:1788838376.517893:0:6544:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8ff608f32600) refs 3 00000020:00000040:0.0:1788838376.517896:0:6544:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff509c6d800 refcount=3 00000020:00000040:0.0:1788838376.517914:0:6544:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:0.0:1788838376.517928:0:6544:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=5 obd=MGC192.168.203.130@tcp 00000100:00000040:0.0:1788838376.517938:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bd2df80 x1875729135225856/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838376.517955:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bd2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135225856:0@lo:256:ll_cfg_requeue.0 00000100:00000040:0.0:1788838376.517973:0:6544:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bd2df80 x1875729135225856/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838376.517979:0:6544:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838376.517997:0:6544:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61211e850 x1875729135225856 msgsize 304 00000100:00100000:0.0:1788838376.518001:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838376.518003:0:6544:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838376.518020:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8ff62bd2df80 x1875729135225856/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838376.518030:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ff640ee70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788838376.518463:0:94393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135225856 00000100:00100000:2.0:1788838376.518470:0:94393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135225856 00000020:00000040:2.0:1788838376.518473:0:94393:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:2.0:1788838376.518476:0:94393:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=24 00000100:00000040:2.0:1788838376.518509:0:94393:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788838376.518529:0:94393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00000040:2.0:1788838376.518532:0:94393:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:2.0:1788838376.518537:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61211e850 x1875729135225856/t0(0) o256->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:277/0 lens 304/0 e 0 to 0 dl 1788838387 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.518550:0:94393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135225856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788838376.518570:0:94393:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:2.0:1788838376.518583:0:94393:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1788838376.518590:0:94393:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788838376.518593:0:94393:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 130 00000020:00000040:2.0:1788838376.518602:0:94393:0:(genops.c:868:class_export_get()) GET export ffff8ff639712000 refcount=25 00000020:00000040:2.0:1788838376.518658:0:94393:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 24 00010000:00000040:2.0:1788838376.518671:0:94393:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135225856 00000100:00000040:2.0:1788838376.518678:0:94393:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 64 to 0@lo 00000100:00000040:2.0:1788838376.518686:0:94393:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838376.518699:0:94393:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff8ff62bd2df80 x1875729135225856/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.518710:0:94393:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 63 to 0@lo 00000100:00000040:2.0:1788838376.518714:0:94393:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61211e850 x1875729135225856/t0(0) o256->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:277/0 lens 304/240 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.518723:0:94393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57943c9a-ca27-46d8-8845-5d2bce640e45+24:6544:x1875729135225856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 175us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838376.518730:0:94393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00000040:2.0:1788838376.518732:0:94393:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:2.0:1788838376.518740:0:94393:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00000040:2.0:1788838376.518776:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff8ff62bd2df80 x1875729135225856/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.518785:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff8ff62bd2df80 x1875729135225856/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.518792:0:6544:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2df80 x1875729135225856/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.518816:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57943c9a-ca27-46d8-8845-5d2bce640e45:6544:1875729135225856:0@lo:256:ll_cfg_requeue.0 00000100:00000040:2.0:1788838376.518836:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bd2df80 x1875729135225856/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:2.0:1788838376.518846:0:6544:0:(mgc_request.c:1600:mgc_process_recover_log()) Latest version 130, more 0. 10000000:00000040:2.0:1788838376.518859:0:6544:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1788838376.518872:0:6544:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.203.130@tcp has 192.168.203.130@tcp. 10000000:00000040:2.0:1788838376.518896:0:6544:0:(mgc_request.c:1470:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:2.0:1788838376.518902:0:6544:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8ff604585000 already not connected (conn 7, was 0): DISCONN 00000100:00000040:2.0:1788838376.518915:0:6544:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 64 to 0@lo 00000100:00000040:2.0:1788838376.518925:0:6544:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 64 to 0@lo 00000100:00000040:2.0:1788838376.518927:0:6544:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.130@tcp -> ffff8ff611edf540 00010000:00080000:2.0:1788838376.518931:0:6544:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8ff604585000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.130@tcp, moved to head 00010000:00000040:2.0:1788838376.518935:0:6544:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 63 to 0@lo 00000100:00080000:2.0:1788838376.518939:0:6544:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:2.0:1788838376.518943:0:6544:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:2.0:1788838376.518946:0:6544:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 63 to 0@lo 00000020:00000040:2.0:1788838376.518948:0:6544:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c5f 00000020:00000040:2.0:1788838376.518951:0:6544:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604967800 refcount=4 00000100:00000040:2.0:1788838376.518954:0:6544:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 62 to 0@lo 00000100:00000040:2.0:1788838376.519059:0:6544:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 63 to 0@lo 00000020:00000040:2.0:1788838376.519062:0:6544:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604967800 : new refcount 3 00000100:00080000:2.0:1788838376.519065:0:6544:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ff604585000 using connection 192.168.203.130@tcp/0@lo 00000020:00000040:2.0:1788838376.519082:0:6544:0:(genops.c:1210:class_import_get()) import ffff8ff604585000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1788838376.519100:0:6544:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ff62bc71f80 x1875729135225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838376.519114:0:6544:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b1f4dc4a] to pc [ptlrpcd_rcv+-1] req@ffff8ff62bc71f80 x1875729135225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:2.0:1788838376.519128:0:6544:0:(mgc_request.c:1487:mgc_apply_recover_logs()) ir apply logs 130/130 for lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1788838376.519135:0:6544:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2df80 x1875729135225856/t0(0) o256->MGC192.168.203.130@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788838392 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838376.519145:0:6544:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000020:00000040:2.0:1788838376.519148:0:6544:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 10000000:01000000:2.0:1788838376.519166:0:6544:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:2.0:1788838376.519173:0:6544:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8ff509c6d800 refcount=3 00010000:00010000:2.0:1788838376.519180:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396cccadfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccae03 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788838376.519189:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff8ff509c6d800/0x88da08396cccadfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x88da08396cccae03 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:2.0:1788838376.519207:0:6544:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8ff608f32600) refs 3 00000100:00000040:3.0:1788838376.519246:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc71f80 x1875729135225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.519258:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135225984:0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1788838376.519279:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff62bc71f80 x1875729135225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838401 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838376.519287:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838376.519308:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7d180 x1875729135225984 msgsize 520 00000100:00100000:3.0:1788838376.519313:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838376.519335:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc71f80 x1875729135225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838401 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838376.519348:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5816 usecs (6 jiffies) 00010000:00080000:3.0:1788838376.519421:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff62bd2dc00 x1875729135225600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.519431:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969473 gen 2 00000100:00000040:3.0:1788838376.519438:0:3642:0:(client.c:3181:ptlrpc_free_committed()) @@@ commit (last_committed 4294969473) req@ffff8ff63a361f80 x1875729135205632/t4294969473(4294969473) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788838357 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838376.519447:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff63a361f80 x1875729135205632/t4294969473(4294969473) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788838357 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838376.519455:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff62c81b000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1788838376.519469:0:3642:0:(client.c:3235:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=1 replay=1/1 committed=0/0 00000100:00000040:3.0:1788838376.519474:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bd2dc00 x1875729135225600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838376.519499:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:3.0:1788838376.519502:0:3642:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e6d 00000020:00000040:3.0:1788838376.519505:0:3642:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff602d1e800 refcount=4 00000020:00000040:3.0:1788838376.519514:0:3642:0:(genops.c:879:class_export_put()) PUTting export ffff8ff602d1e800 : new refcount 3 00000100:00080000:3.0:1788838376.519520:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788838376.519526:0:3642:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788838376.519529:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969473 gen 2 00000100:00000040:3.0:1788838376.519531:0:3642:0:(client.c:3235:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:3.0:1788838376.519535:0:3642:0:(recover.c:53:ptlrpc_replay_next()) import ffff8ff62c81b000 from lustre-OST0000_UUID committed 4294969473 last 0 00000100:00080000:3.0:1788838376.519539:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:3.0:1788838376.519541:0:3642:0:(genops.c:1210:class_import_get()) import ffff8ff62c81b000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1788838376.519578:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135225984 00000100:00100000:3.0:1788838376.519584:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135225984 00000020:00000040:3.0:1788838376.519586:0:26214:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c66 00000100:00100000:3.0:1788838376.519622:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6078 00000100:00000040:3.0:1788838376.519628:0:26214:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7d180 x1875729135225984/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788838396 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.519638:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3642:x1875729135225984:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:3.0:1788838376.519654:0:26214:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 9 - find 00010000:00000040:3.0:1788838376.519665:0:26214:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1788838376.519672:0:26214:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8ff627f9d800, cookie 0x88da08396cccad85 00010000:00080000:3.0:1788838376.519676:0:26214:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8ff627f9d800 cur 3770 last 1788838374 00000001:00000040:3.0:1788838376.519689:0:26214:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.203.130@tcp 00000001:00000040:3.0:1788838376.519695:0:26214:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8ff62749bc00) : new refcount 21 00000020:00000040:3.0:1788838376.519705:0:26214:0:(genops.c:868:class_export_get()) GET export ffff8ff627f9d800 refcount=4 00000001:00000040:3.0:1788838376.519707:0:26214:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8ff62749bc00) : new refcount 22 00000001:00000040:3.0:1788838376.519712:0:26214:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8ff62749bc00) : new refcount 21 00002000:00100000:3.0:1788838376.519717:0:26214:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ff627f9d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788838376.519721:0:26214:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788838376.519724:0:26214:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:3.0:1788838376.519734:0:26214:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats ffff8ff610de82a0 for nid 0@lo - ref 3 00000020:00000040:3.0:1788838376.519744:0:26214:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 10 - import 00000020:00000040:3.0:1788838376.519749:0:26214:0:(genops.c:1223:class_import_put()) import ffff8ff5021a1800 refcount=1 obd=lustre-OST0000 00000020:00000040:3.0:1788838376.519758:0:26214:0:(genops.c:868:class_export_get()) GET export ffff8ff627f9d800 refcount=5 00000100:00000040:3.0:1788838376.519760:0:26214:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff8ff627f9d800 : new rpc_count 1 00000100:00000040:3.0:1788838376.519764:0:26214:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 64 to 0@lo 00000100:00000040:3.0:1788838376.519766:0:26214:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8ff611edf540 refcount 64 to 0@lo 00000020:00000040:3.0:1788838376.519769:0:26214:0:(genops.c:868:class_export_get()) GET export ffff8ff627f9d800 refcount=6 00000100:00000040:3.0:1788838376.519774:0:26214:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00080000:3.0:1788838376.519783:0:26214:0:(import.c:65:import_set_state_nolock()) ffff8ff5021a1800 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1788838376.519823:0:26214:0:(genops.c:879:class_export_put()) PUTting export ffff8ff627f9d800 : new refcount 5 00000020:00000040:3.0:1788838376.519826:0:26214:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8ff503ca0000) now 10 - find 00010000:00000040:3.0:1788838376.519838:0:26214:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969444, transno 0, xid 1875729135225984 00000100:00000040:3.0:1788838376.519845:0:26214:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:3.0:1788838376.519850:0:26214:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838376.519870:0:26214:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8ff62bc71f80 x1875729135225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788838401 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838376.519890:0:26214:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:3.0:1788838376.519894:0:26214:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7d180 x1875729135225984/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788838396 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.519902:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3642:x1875729135225984:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 265us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838376.519910:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6078 00000100:00000040:3.0:1788838376.519921:0:26214:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff627f9d800 : new rpc_count 0 00000020:00000040:3.0:1788838376.519928:0:26214:0:(genops.c:879:class_export_put()) PUTting export ffff8ff627f9d800 : new refcount 4 00010000:00080000:3.0:1788838376.519949:0:96981:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:3.0:1788838376.519955:0:96981:0:(ldlm_lib.c:2900:target_recovery_thread()) 1: request replay stage - 3 clients from t4294969478 00010000:00080000:3.0:1788838376.519958:0:96981:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 4294969478 00010000:00080000:3.0:1788838376.519963:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 0, queue_len: 1, req_transno: 4294969478, next_transno: 4294969478 00010000:00080000:3.0:1788838376.519967:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969478) 00010000:00080000:3.0:1788838376.519976:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116509440 t4294969478 from 192.168.203.30@tcp req@ffff8ff62bd6e680 x1875729116509440/t0(4294969478) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.519996:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bd6e680 x1875729116509440/t0(4294969478) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788838376.520029:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x382:0x0] 00000100:00000040:2.0:1788838376.520930:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2dc00 x1875729135225600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838401 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.520944:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bd2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135225600:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1788838376.520953:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bd2dc00 x1875729135225600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838401 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838376.521144:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff62c81b000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:2.0:1788838376.521196:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ff62bc71f80 x1875729135225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.521206:0:3642:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969444 00000100:00000040:2.0:1788838376.521210:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff62bc71f80 x1875729135225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838376.521221:0:3642:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:2.0:1788838376.521224:0:3642:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c5f 00000020:00000040:2.0:1788838376.521228:0:3642:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604967800 refcount=4 00000020:00000040:2.0:1788838376.521236:0:3642:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604967800 : new refcount 3 00000100:00080000:2.0:1788838376.521241:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000001:00000040:3.0:1788838376.521242:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 1 00000020:00000040:3.0:1788838376.521246:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=6 00000100:00080000:2.0:1788838376.521246:0:3642:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788838376.521248:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969444 gen 2 00000100:00000040:2.0:1788838376.521251:0:3642:0:(client.c:3235:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:2.0:1788838376.521253:0:3642:0:(recover.c:53:ptlrpc_replay_next()) import ffff8ff604585000 from lustre-OST0000_UUID committed 4294969444 last 0 00000100:00080000:2.0:1788838376.521256:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:2.0:1788838376.521259:0:3642:0:(genops.c:1210:class_import_get()) import ffff8ff604585000 refcount=5 obd=lustre-OST0000-osc-MDT0001 00010000:00000040:3.0:1788838376.521311:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969478, xid 1875729116509440 00000100:00000040:3.0:1788838376.521323:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.521330:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.521384:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.521400:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:3.0:1788838376.521409:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.521421:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 5 00010000:00080000:3.0:1788838376.521426:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 0, queue_len: 0, req_transno: 0, next_transno: 4294969479 00010000:00080000:3.0:1788838376.521430:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 0, queue_len: 0, req_transno: 0, next_transno: 4294969479 00000100:00000040:1.0:1788838376.521695:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc71f80 x1875729135225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838401 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838376.521704:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff62bc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135225984:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1788838376.521711:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff62bc71f80 x1875729135225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788838401 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838376.521721:0:3642:0:(genops.c:1223:class_import_put()) import ffff8ff604585000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:2.0:1788838376.521768:0:97037:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1788838376.521777:0:97037:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1788838376.521784:0:97037:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00010000:00080000:1.0:1788838376.521922:0:97035:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:1.0:1788838376.521926:0:97035:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:1.0:1788838376.521930:0:97035:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:1.0:1788838376.521986:0:97035:0:(import.c:65:import_set_state_nolock()) ffff8ff62c81b000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:1.0:1788838376.521994:0:97035:0:(genops.c:1210:class_import_get()) import ffff8ff62c81b000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788838376.522022:0:97035:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b083882f] to pc [ptlrpcd_rcv+-1] req@ffff8ff624ebf100 x1875729135226112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838376.522038:0:97035:0:(genops.c:1223:class_import_put()) import ffff8ff62c81b000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788838376.522048:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff624ebf100 x1875729135226112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838376.522059:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff624ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875729135226112:0@lo:400:ldlm_lock_repla.0 00000100:00080000:2.0:1788838376.522190:0:97037:0:(import.c:65:import_set_state_nolock()) ffff8ff604585000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1788838376.522196:0:97037:0:(genops.c:1210:class_import_get()) import ffff8ff604585000 refcount=5 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1788838376.522207:0:97037:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bca5b3d6] to pc [ptlrpcd_rcv+-1] req@ffff8ff62bc73800 x1875729135226240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838376.522215:0:97037:0:(genops.c:1223:class_import_put()) import ffff8ff604585000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1788838376.522315:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff8ff624ebf100 x1875729135226112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838392 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838376.522324:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838376.522691:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff624ebdc00 x1875729135226112 msgsize 224 00000100:00100000:1.0:1788838376.522697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838376.523170:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff624ebf100 x1875729135226112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838392 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838376.523190:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 8261 usecs (9 jiffies) 00000100:00000040:1.0:1788838376.523215:0:3642:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff62bc73800 x1875729135226240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838376.523228:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff62bc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875729135226240:0@lo:400:ldlm_lock_repla.0 00000100:00000040:1.0:1788838376.523248:0:3642:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff8ff62bc73800 x1875729135226240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838392 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838376.523256:0:3642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838376.523285:0:3642:0:(events.c:337:request_in_callback()) incoming req@ffff8ff624ebe680 x1875729135226240 msgsize 224 00000100:00100000:1.0:1788838376.523290:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788838376.523315:0:3642:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff62bc73800 x1875729135226240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838392 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788838376.523325:0:3642:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5807 usecs (6 jiffies) 00000100:00100000:3.0:1788838376.523339:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135226112 00000100:00100000:3.0:1788838376.523349:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135226112 00000020:00000040:3.0:1788838376.523353:0:26218:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad8c 00000020:00000040:3.0:1788838376.523357:0:26218:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a64b800 refcount=5 00000100:00100000:2.0:1788838376.523552:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135226240 00000100:00100000:2.0:1788838376.523557:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135226240 00000020:00000040:2.0:1788838376.523559:0:8462:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad85 00000020:00000040:2.0:1788838376.523562:0:8462:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff627f9d800 refcount=5 00000100:00000040:2.0:1788838376.523590:0:8462:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1788838376.523630:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766 00000100:00000040:2.0:1788838376.523635:0:8462:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff627f9d800 : new rpc_count 1 00000100:00000040:2.0:1788838376.523641:0:8462:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff624ebe680 x1875729135226240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:277/0 lens 224/0 e 0 to 0 dl 1788838387 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.523653:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875729135226240:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1788838376.523670:0:8462:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff624ebe680 x1875729135226240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:277/0 lens 224/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788838376.523681:0:8462:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff627f9d800 : new rpc_count 2 00010000:00080000:2.0:1788838376.523685:0:8462:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff624ebe680 x1875729135226240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:277/0 lens 224/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.523704:0:8462:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebe680 x1875729135226240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:277/0 lens 224/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.523713:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875729135226240:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 61us (426us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.523729:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766 00000100:00000040:2.0:1788838376.523732:0:8462:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff627f9d800 : new rpc_count 1 00010000:00080000:2.0:1788838376.523750:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969479 00000100:00100000:3.0:1788838376.524504:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767 00000100:00000040:3.0:1788838376.524509:0:26218:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff63a64b800 : new rpc_count 1 00000100:00000040:3.0:1788838376.524520:0:26218:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff624ebdc00 x1875729135226112/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:277/0 lens 224/0 e 0 to 0 dl 1788838387 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.524533:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135226112:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:3.0:1788838376.524545:0:26218:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff624ebdc00 x1875729135226112/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:277/0 lens 224/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788838376.524554:0:26218:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff63a64b800 : new rpc_count 2 00010000:00080000:3.0:1788838376.524557:0:26218:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8ff624ebdc00 x1875729135226112/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:277/0 lens 224/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838376.524570:0:26218:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebdc00 x1875729135226112/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:277/0 lens 224/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838376.524578:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3642:x1875729135226112:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 48us (1887us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.524585:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767 00000100:00000040:3.0:1788838376.524588:0:26218:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a64b800 : new rpc_count 1 00010000:00080000:3.0:1788838376.524606:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969479 00000100:00000040:0.0:1788838376.531566:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2e680 x1875729116510080 msgsize 440 00000100:00100000:0.0:1788838376.531586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.531705:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116510080 00000100:00100000:1.0:1788838376.531718:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116510080 00000020:00000040:1.0:1788838376.531722:0:8468:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.531729:0:8468:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=6 00000100:00000040:1.0:1788838376.531763:0:8468:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.531955:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1049 00000100:00000040:1.0:1788838376.531961:0:8468:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.531971:0:8468:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2e680 x1875729116510080/t0(4294969479) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.531987:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116510080:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:1.0:1788838376.532002:0:8468:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bd2e680 x1875729116510080/t0(4294969479) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.532013:0:8468:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969479, current: 4294969479, replaying 00010000:00000040:1.0:1788838376.532017:0:8468:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.532065:0:8468:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2e680 x1875729116510080/t0(4294969479) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.532240:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116510080:12345-192.168.203.30@tcp:10:dd.0 Request processed in 255us (676us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.532249:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1049 00000100:00000040:1.0:1788838376.532253:0:8468:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:2.0:1788838376.532293:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969479, next_transno: 4294969479 00010000:00080000:2.0:1788838376.532299:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969479) 00010000:00080000:2.0:1788838376.532310:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116510080 t4294969479 from 192.168.203.30@tcp req@ffff8ff62bd2e680 x1875729116510080/t0(4294969479) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.532330:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bd2e680 x1875729116510080/t0(4294969479) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788838376.532443:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x383:0x0] 00000001:00000040:2.0:1788838376.532670:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 2 00000020:00000040:2.0:1788838376.532675:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=7 00010000:00000040:2.0:1788838376.532722:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969479, xid 1875729116510080 00000100:00000040:2.0:1788838376.532734:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838376.532742:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838376.532953:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:2.0:1788838376.532966:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788838376.532973:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:2.0:1788838376.532986:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 6 00010000:00080000:2.0:1788838376.532991:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969480 00010000:00080000:2.0:1788838376.532995:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969480 00000100:00000040:2.0:1788838376.536454:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc73b80 x1875729116511616 msgsize 1512 00000100:00100000:2.0:1788838376.536476:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.539947:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116511616 00000100:00100000:1.0:1788838376.539969:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116511616 00000020:00000040:1.0:1788838376.539981:0:24890:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.539988:0:24890:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=7 00000100:00000040:1.0:1788838376.540024:0:24890:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.540249:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1050 00000100:00000040:1.0:1788838376.540255:0:24890:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.540266:0:24890:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc73b80 x1875729116511616/t0(4294969480) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.540284:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116511616:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:1.0:1788838376.540300:0:24890:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bc73b80 x1875729116511616/t0(4294969480) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.540311:0:24890:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969480, current: 4294969480, replaying 00010000:00000040:1.0:1788838376.540314:0:24890:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.540330:0:24890:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc73b80 x1875729116511616/t0(4294969480) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.540339:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116511616:12345-192.168.203.30@tcp:4:dd.0 Request processed in 59us (3887us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.540349:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1050 00000100:00000040:1.0:1788838376.540364:0:24890:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.541784:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969480, next_transno: 4294969480 00010000:00080000:1.0:1788838376.541793:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969480) 00010000:00080000:1.0:1788838376.541836:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116511616 t4294969480 from 192.168.203.30@tcp req@ffff8ff62bc73b80 x1875729116511616/t0(4294969480) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.541865:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bc73b80 x1875729116511616/t0(4294969480) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788838376.541922:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:1.0:1788838376.542193:0:96981:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:1.0:1788838376.542279:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788838376.542318:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:1.0:1788838376.542322:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788838376.543673:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 3 00000020:00000040:1.0:1788838376.543681:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=8 00010000:00000040:1.0:1788838376.543728:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969480, xid 1875729116511616 00000100:00000040:1.0:1788838376.543746:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.543755:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.543837:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.543852:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.543863:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.543877:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 7 00010000:00080000:1.0:1788838376.543884:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00010000:00080000:1.0:1788838376.543888:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00000100:00000040:1.0:1788838376.548695:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff624ebed80 x1875729116512384 msgsize 440 00000100:00100000:1.0:1788838376.548721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.548864:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116512384 00000100:00100000:3.0:1788838376.548877:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116512384 00000020:00000040:3.0:1788838376.548881:0:26090:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.548887:0:26090:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=8 00000100:00000040:3.0:1788838376.548919:0:26090:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.549072:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1051 00000100:00000040:3.0:1788838376.549078:0:26090:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.549088:0:26090:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff624ebed80 x1875729116512384/t0(4294969481) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.549103:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2403:x1875729116512384:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:3.0:1788838376.549128:0:26090:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff624ebed80 x1875729116512384/t0(4294969481) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.549139:0:26090:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969481, current: 4294969481, replaying 00010000:00000040:3.0:1788838376.549143:0:26090:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.549158:0:26090:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebed80 x1875729116512384/t0(4294969481) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.549167:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+8:2403:x1875729116512384:12345-192.168.203.30@tcp:10:dd.0 Request processed in 66us (476us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.549174:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1051 00000100:00000040:3.0:1788838376.549178:0:26090:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.549222:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969481, next_transno: 4294969481 00010000:00080000:1.0:1788838376.549227:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969481) 00010000:00080000:1.0:1788838376.549237:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116512384 t4294969481 from 192.168.203.30@tcp req@ffff8ff624ebed80 x1875729116512384/t0(4294969481) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.549255:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff624ebed80 x1875729116512384/t0(4294969481) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788838376.549294:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x388:0x0] 00000001:00000040:1.0:1788838376.549564:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 4 00000020:00000040:1.0:1788838376.549568:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=9 00010000:00000040:1.0:1788838376.549613:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969481, xid 1875729116512384 00000100:00000040:1.0:1788838376.549626:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.549638:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.549696:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.549707:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.549713:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.549725:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 8 00010000:00080000:1.0:1788838376.549729:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00010000:00080000:1.0:1788838376.549733:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00000100:00000040:1.0:1788838376.552295:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff624ebe300 x1875729116513024 msgsize 1512 00000100:00100000:1.0:1788838376.552318:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.552526:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116513024 00000100:00100000:3.0:1788838376.552539:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116513024 00000020:00000040:3.0:1788838376.552543:0:24879:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.552549:0:24879:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=9 00000100:00000040:3.0:1788838376.552581:0:24879:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.552676:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1052 00000100:00000040:3.0:1788838376.552682:0:24879:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.552692:0:24879:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff624ebe300 x1875729116513024/t0(4294969482) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.552709:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2403:x1875729116513024:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:3.0:1788838376.552724:0:24879:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff624ebe300 x1875729116513024/t0(4294969482) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.552735:0:24879:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969482, current: 4294969482, replaying 00010000:00000040:3.0:1788838376.552740:0:24879:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.552755:0:24879:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebe300 x1875729116513024/t0(4294969482) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.552776:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+9:2403:x1875729116513024:12345-192.168.203.30@tcp:4:dd.0 Request processed in 70us (482us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.552785:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1052 00000100:00000040:3.0:1788838376.552789:0:24879:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.552870:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969482, next_transno: 4294969482 00010000:00080000:1.0:1788838376.552876:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969482) 00010000:00080000:1.0:1788838376.552885:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116513024 t4294969482 from 192.168.203.30@tcp req@ffff8ff624ebe300 x1875729116513024/t0(4294969482) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.552904:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff624ebe300 x1875729116513024/t0(4294969482) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.553088:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788838376.553124:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:1.0:1788838376.553129:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1788838376.554646:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 5 00000020:00000040:0.0:1788838376.554657:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=10 00010000:00000040:0.0:1788838376.554715:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969482, xid 1875729116513024 00000100:00000040:0.0:1788838376.554830:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838376.554839:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838376.554905:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:0.0:1788838376.554920:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788838376.554933:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:0.0:1788838376.554947:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 9 00010000:00080000:0.0:1788838376.554954:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00010000:00080000:0.0:1788838376.554959:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00000100:00000040:3.0:1788838376.559639:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7dc00 x1875729116514432 msgsize 440 00000100:00100000:3.0:1788838376.559665:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.561395:0:24888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116514432 00000100:00100000:1.0:1788838376.561529:0:24888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116514432 00000020:00000040:1.0:1788838376.561534:0:24888:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.561541:0:24888:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=10 00000100:00000040:1.0:1788838376.561581:0:24888:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.561877:0:24888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1053 00000100:00000040:1.0:1788838376.561887:0:24888:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.561902:0:24888:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7dc00 x1875729116514432/t0(4294969483) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.561931:0:24888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2403:x1875729116514432:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:1.0:1788838376.561976:0:24888:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff611a7dc00 x1875729116514432/t0(4294969483) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.561987:0:24888:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969483, current: 4294969483, replaying 00010000:00000040:1.0:1788838376.561991:0:24888:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.562016:0:24888:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7dc00 x1875729116514432/t0(4294969483) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.562026:0:24888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+10:2403:x1875729116514432:12345-192.168.203.30@tcp:10:dd.0 Request processed in 111us (2389us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.562036:0:24888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1053 00000100:00000040:1.0:1788838376.562041:0:24888:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.562045:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969483, next_transno: 4294969483 00010000:00080000:3.0:1788838376.562053:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969483) 00010000:00080000:3.0:1788838376.562070:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116514432 t4294969483 from 192.168.203.30@tcp req@ffff8ff611a7dc00 x1875729116514432/t0(4294969483) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.562099:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff611a7dc00 x1875729116514432/t0(4294969483) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788838376.562143:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x384:0x0] 00000001:00000040:3.0:1788838376.564342:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 6 00000020:00000040:3.0:1788838376.564436:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=11 00010000:00000040:3.0:1788838376.564516:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969483, xid 1875729116514432 00000100:00000040:3.0:1788838376.564536:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.564546:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.564626:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.564643:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788838376.564656:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.564673:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 10 00010000:00080000:3.0:1788838376.564681:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00010000:00080000:3.0:1788838376.564687:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00000100:00000040:2.0:1788838376.569611:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc72300 x1875729116515328 msgsize 440 00000100:00100000:2.0:1788838376.569632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.569689:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116515328 00000100:00100000:2.0:1788838376.569710:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116515328 00000020:00000040:2.0:1788838376.569714:0:24876:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.569721:0:24876:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=11 00000100:00000040:2.0:1788838376.569751:0:24876:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788838376.569818:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1054 00000100:00000040:2.0:1788838376.570477:0:24876:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:2.0:1788838376.570501:0:24876:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc72300 x1875729116515328/t0(4294969484) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.570525:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2403:x1875729116515328:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:2.0:1788838376.570544:0:24876:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bc72300 x1875729116515328/t0(4294969484) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788838376.570554:0:24876:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969484, current: 4294969484, replaying 00010000:00000040:2.0:1788838376.570559:0:24876:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:2.0:1788838376.570577:0:24876:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc72300 x1875729116515328/t0(4294969484) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.570586:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2403:x1875729116515328:12345-192.168.203.30@tcp:10:dd.0 Request processed in 70us (977us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.570594:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1054 00000100:00000040:2.0:1788838376.570598:0:24876:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:2.0:1788838376.570631:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969484, next_transno: 4294969484 00010000:00080000:2.0:1788838376.570636:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969484) 00010000:00080000:2.0:1788838376.570646:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116515328 t4294969484 from 192.168.203.30@tcp req@ffff8ff62bc72300 x1875729116515328/t0(4294969484) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.570667:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bc72300 x1875729116515328/t0(4294969484) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788838376.570708:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x387:0x0] 00000001:00000040:2.0:1788838376.571041:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 7 00000020:00000040:2.0:1788838376.571047:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=12 00010000:00000040:2.0:1788838376.571094:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969484, xid 1875729116515328 00000100:00000040:2.0:1788838376.571109:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838376.571120:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838376.571190:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:2.0:1788838376.571203:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788838376.571212:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:2.0:1788838376.571228:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 11 00010000:00080000:2.0:1788838376.571233:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00010000:00080000:2.0:1788838376.571239:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00000100:00000040:1.0:1788838376.579739:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff624ebc380 x1875729116516096 msgsize 440 00000100:00100000:1.0:1788838376.579762:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.580255:0:24889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116516096 00000100:00100000:3.0:1788838376.580270:0:24889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116516096 00000020:00000040:3.0:1788838376.580286:0:24889:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.580293:0:24889:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=12 00000100:00000040:3.0:1788838376.580325:0:24889:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.580399:0:24889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1055 00000100:00000040:3.0:1788838376.580404:0:24889:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.580416:0:24889:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff624ebc380 x1875729116516096/t0(4294969485) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.580432:0:24889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff624ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2403:x1875729116516096:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:3.0:1788838376.580448:0:24889:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff624ebc380 x1875729116516096/t0(4294969485) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.580460:0:24889:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969485, current: 4294969485, replaying 00010000:00000040:3.0:1788838376.580464:0:24889:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.580501:0:24889:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff624ebc380 x1875729116516096/t0(4294969485) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.580513:0:24889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff624ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+12:2403:x1875729116516096:12345-192.168.203.30@tcp:10:dd.0 Request processed in 83us (775us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.580521:0:24889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1055 00000100:00000040:3.0:1788838376.580525:0:24889:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:0.0:1788838376.581128:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969485, next_transno: 4294969485 00010000:00080000:0.0:1788838376.581135:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969485) 00010000:00080000:0.0:1788838376.581148:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116516096 t4294969485 from 192.168.203.30@tcp req@ffff8ff624ebc380 x1875729116516096/t0(4294969485) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788838376.581188:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff624ebc380 x1875729116516096/t0(4294969485) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788838376.581232:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x385:0x0] 00000001:00000040:0.0:1788838376.581503:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 8 00000020:00000040:0.0:1788838376.581508:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=13 00010000:00000040:0.0:1788838376.581567:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969485, xid 1875729116516096 00000100:00000040:0.0:1788838376.581582:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838376.581590:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838376.581668:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:0.0:1788838376.581681:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788838376.581690:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:0.0:1788838376.581704:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 12 00010000:00080000:0.0:1788838376.581709:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00010000:00080000:0.0:1788838376.581714:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00000100:00000040:3.0:1788838376.587017:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff611a7f800 x1875729116517504 msgsize 440 00000100:00100000:3.0:1788838376.587043:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.587175:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116517504 00000100:00100000:1.0:1788838376.587191:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116517504 00000020:00000040:1.0:1788838376.587196:0:25104:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.587203:0:25104:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=13 00000100:00000040:1.0:1788838376.587235:0:25104:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.587300:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1056 00000100:00000040:1.0:1788838376.587305:0:25104:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.587316:0:25104:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff611a7f800 x1875729116517504/t0(4294969486) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.587334:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff611a7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:efc561ba-875e-4857-b79b-9bd7023bd57c+13:2403:x1875729116517504:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:1.0:1788838376.587358:0:25104:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff611a7f800 x1875729116517504/t0(4294969486) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.587370:0:25104:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969486, current: 4294969486, replaying 00010000:00000040:1.0:1788838376.587389:0:25104:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.587409:0:25104:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff611a7f800 x1875729116517504/t0(4294969486) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.587420:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff611a7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:efc561ba-875e-4857-b79b-9bd7023bd57c+13:2403:x1875729116517504:12345-192.168.203.30@tcp:10:dd.0 Request processed in 90us (405us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.587429:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1056 00000100:00000040:1.0:1788838376.587432:0:25104:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.587453:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969486, next_transno: 4294969486 00010000:00080000:1.0:1788838376.587458:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969486) 00010000:00080000:1.0:1788838376.587466:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116517504 t4294969486 from 192.168.203.30@tcp req@ffff8ff611a7f800 x1875729116517504/t0(4294969486) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.587494:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff611a7f800 x1875729116517504/t0(4294969486) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788838376.587536:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x386:0x0] 00000001:00000040:1.0:1788838376.587786:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 9 00000020:00000040:1.0:1788838376.587790:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=14 00010000:00000040:1.0:1788838376.587862:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969486, xid 1875729116517504 00000100:00000040:1.0:1788838376.587874:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.587882:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.587946:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.587957:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.587963:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.587976:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 13 00010000:00080000:1.0:1788838376.587980:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00010000:00080000:1.0:1788838376.587985:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00000100:00000040:3.0:1788838376.597298:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5071ce680 x1875729116517120 msgsize 1512 00000100:00100000:3.0:1788838376.597323:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838376.597618:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116517120 00000100:00100000:0.0:1788838376.597633:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116517120 00000020:00000040:0.0:1788838376.597637:0:24890:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:0.0:1788838376.597645:0:24890:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=14 00000100:00000040:0.0:1788838376.597686:0:24890:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788838376.597748:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1057 00000100:00000040:0.0:1788838376.597755:0:24890:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:0.0:1788838376.597766:0:24890:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5071ce680 x1875729116517120/t0(4294969487) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.597782:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+14:2403:x1875729116517120:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:0.0:1788838376.597952:0:24890:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff5071ce680 x1875729116517120/t0(4294969487) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788838376.597977:0:24890:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969487, current: 4294969487, replaying 00010000:00000040:0.0:1788838376.597981:0:24890:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:0.0:1788838376.597996:0:24890:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071ce680 x1875729116517120/t0(4294969487) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.598007:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+14:2403:x1875729116517120:12345-192.168.203.30@tcp:4:dd.0 Request processed in 228us (713us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838376.598017:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1057 00000100:00000040:0.0:1788838376.598021:0:24890:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:0.0:1788838376.598043:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969487, next_transno: 4294969487 00010000:00080000:0.0:1788838376.598048:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969487) 00010000:00080000:0.0:1788838376.598058:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116517120 t4294969487 from 192.168.203.30@tcp req@ffff8ff5071ce680 x1875729116517120/t0(4294969487) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788838376.598434:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff5071ce680 x1875729116517120/t0(4294969487) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788838376.598573:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788838376.598611:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:0.0:1788838376.598615:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000020:00000040:0.0:1788838376.598636:0:96981:0:(tgt_handler.c:2946:tgt_brw_write()) Checksum 1024 from 12345-192.168.203.30@tcp OK: aeab8e04 00000001:00000040:0.0:1788838376.600093:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 10 00000020:00000040:0.0:1788838376.600103:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=15 00010000:00000040:1.0:1788838376.601472:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969487, xid 1875729116517120 00000100:00000040:1.0:1788838376.601514:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.601525:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.601603:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.601620:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.601635:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.601652:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 14 00010000:00080000:1.0:1788838376.601660:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00010000:00080000:1.0:1788838376.601666:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00000100:00000040:1.0:1788838376.607569:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff63f746d80 x1875729116519552 msgsize 440 00000100:00100000:1.0:1788838376.607590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.610111:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116519552 00000100:00100000:3.0:1788838376.610129:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116519552 00000020:00000040:3.0:1788838376.610133:0:26090:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.610140:0:26090:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=15 00000100:00000040:3.0:1788838376.610177:0:26090:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.610250:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1058 00000100:00000040:3.0:1788838376.610255:0:26090:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.610265:0:26090:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff63f746d80 x1875729116519552/t0(4294969488) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.610282:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63f746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+15:2403:x1875729116519552:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:3.0:1788838376.610296:0:26090:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff63f746d80 x1875729116519552/t0(4294969488) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.610307:0:26090:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969488, current: 4294969488, replaying 00010000:00000040:3.0:1788838376.610311:0:26090:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.610328:0:26090:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff63f746d80 x1875729116519552/t0(4294969488) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.610337:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63f746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+15:2403:x1875729116519552:12345-192.168.203.30@tcp:10:dd.0 Request processed in 60us (2772us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.610345:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1058 00000100:00000040:3.0:1788838376.610348:0:26090:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.610376:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969488, next_transno: 4294969488 00010000:00080000:3.0:1788838376.610381:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969488) 00010000:00080000:3.0:1788838376.610392:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116519552 t4294969488 from 192.168.203.30@tcp req@ffff8ff63f746d80 x1875729116519552/t0(4294969488) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.610411:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff63f746d80 x1875729116519552/t0(4294969488) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788838376.610447:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x394:0x0] 00000001:00000040:3.0:1788838376.610702:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 11 00000020:00000040:3.0:1788838376.610707:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=16 00010000:00000040:3.0:1788838376.610753:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969488, xid 1875729116519552 00000100:00000040:3.0:1788838376.610772:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.610779:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.611094:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.611107:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788838376.611124:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.611136:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 15 00010000:00080000:3.0:1788838376.611142:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00010000:00080000:3.0:1788838376.611146:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00000100:00000040:1.0:1788838376.617768:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff501afe680 x1875729116519936 msgsize 440 00000100:00100000:1.0:1788838376.617787:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.621844:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116519936 00000100:00100000:3.0:1788838376.621864:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116519936 00000020:00000040:3.0:1788838376.621868:0:24879:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.621876:0:24879:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=16 00000100:00000040:3.0:1788838376.621912:0:24879:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.622072:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1059 00000100:00000040:3.0:1788838376.622078:0:24879:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.622090:0:24879:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff501afe680 x1875729116519936/t0(4294969489) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.622106:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+16:2403:x1875729116519936:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:3.0:1788838376.622122:0:24879:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff501afe680 x1875729116519936/t0(4294969489) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.622133:0:24879:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969489, current: 4294969489, replaying 00010000:00000040:3.0:1788838376.622137:0:24879:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.622154:0:24879:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff501afe680 x1875729116519936/t0(4294969489) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.622165:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+16:2403:x1875729116519936:12345-192.168.203.30@tcp:10:dd.0 Request processed in 62us (4400us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.622173:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1059 00000100:00000040:3.0:1788838376.622189:0:24879:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.622757:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969489, next_transno: 4294969489 00010000:00080000:3.0:1788838376.622766:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969489) 00010000:00080000:3.0:1788838376.622777:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116519936 t4294969489 from 192.168.203.30@tcp req@ffff8ff501afe680 x1875729116519936/t0(4294969489) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.623225:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff501afe680 x1875729116519936/t0(4294969489) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788838376.623270:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x389:0x0] 00000001:00000040:3.0:1788838376.623576:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 12 00000020:00000040:3.0:1788838376.623581:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=17 00010000:00000040:3.0:1788838376.623625:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969489, xid 1875729116519936 00000100:00000040:3.0:1788838376.623636:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.623644:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.623723:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.623736:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788838376.623745:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.623759:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 16 00010000:00080000:3.0:1788838376.623764:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00010000:00080000:3.0:1788838376.623769:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00000100:00000040:2.0:1788838376.634221:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc73100 x1875729116520960 msgsize 1512 00000100:00100000:2.0:1788838376.634245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.634306:0:24888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116520960 00000100:00100000:2.0:1788838376.634320:0:24888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116520960 00000020:00000040:2.0:1788838376.634323:0:24888:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.634329:0:24888:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=17 00000100:00000040:2.0:1788838376.634363:0:24888:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788838376.634420:0:24888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1060 00000100:00000040:2.0:1788838376.634425:0:24888:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:2.0:1788838376.634435:0:24888:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc73100 x1875729116520960/t0(4294969490) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.634451:0:24888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+17:2403:x1875729116520960:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:2.0:1788838376.634547:0:24888:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bc73100 x1875729116520960/t0(4294969490) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788838376.634558:0:24888:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969490, current: 4294969490, replaying 00010000:00000040:2.0:1788838376.634562:0:24888:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:2.0:1788838376.634577:0:24888:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc73100 x1875729116520960/t0(4294969490) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.634597:0:24888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+17:2403:x1875729116520960:12345-192.168.203.30@tcp:4:dd.0 Request processed in 148us (379us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.634605:0:24888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1060 00000100:00000040:2.0:1788838376.634609:0:24888:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:2.0:1788838376.634635:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969490, next_transno: 4294969490 00010000:00080000:2.0:1788838376.634640:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969490) 00010000:00080000:2.0:1788838376.634648:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116520960 t4294969490 from 192.168.203.30@tcp req@ffff8ff62bc73100 x1875729116520960/t0(4294969490) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.634668:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bc73100 x1875729116520960/t0(4294969490) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.634793:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788838376.634864:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:2.0:1788838376.634869:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788838376.635587:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 13 00000020:00000040:2.0:1788838376.635594:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=18 00010000:00000040:2.0:1788838376.635633:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969490, xid 1875729116520960 00000100:00000040:2.0:1788838376.635648:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838376.635656:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838376.635718:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:2.0:1788838376.635731:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788838376.635741:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:2.0:1788838376.635754:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 17 00010000:00080000:2.0:1788838376.635759:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00010000:00080000:2.0:1788838376.635764:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00010000:00010000:0.0:1788838376.645030:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1788838376.645791:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff5071cf800 x1875729116521984 msgsize 1512 00000100:00100000:3.0:1788838376.645838:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.645885:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116521984 00000100:00100000:3.0:1788838376.645898:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116521984 00000020:00000040:3.0:1788838376.645902:0:25108:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.645907:0:25108:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=18 00000100:00000040:3.0:1788838376.645935:0:25108:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.646005:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1061 00000100:00000040:3.0:1788838376.646011:0:25108:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.646028:0:25108:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff5071cf800 x1875729116521984/t0(4294969491) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.646046:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff5071cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2403:x1875729116521984:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:3.0:1788838376.646061:0:25108:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff5071cf800 x1875729116521984/t0(4294969491) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.646073:0:25108:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969491, current: 4294969491, replaying 00010000:00000040:3.0:1788838376.646077:0:25108:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.646090:0:25108:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff5071cf800 x1875729116521984/t0(4294969491) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.646099:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff5071cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+18:2403:x1875729116521984:12345-192.168.203.30@tcp:4:dd.0 Request processed in 57us (308us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.646107:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1061 00000100:00000040:3.0:1788838376.646110:0:25108:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:2.0:1788838376.646425:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969491, next_transno: 4294969491 00010000:00080000:2.0:1788838376.646432:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969491) 00010000:00080000:2.0:1788838376.646450:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116521984 t4294969491 from 192.168.203.30@tcp req@ffff8ff5071cf800 x1875729116521984/t0(4294969491) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.646661:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff5071cf800 x1875729116521984/t0(4294969491) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.646785:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788838376.646847:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:2.0:1788838376.646851:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788838376.647231:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 14 00000020:00000040:2.0:1788838376.647236:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=19 00010000:00000040:2.0:1788838376.647775:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969491, xid 1875729116521984 00000100:00000040:2.0:1788838376.647790:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838376.647892:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838376.648015:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:2.0:1788838376.648032:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788838376.648043:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:2.0:1788838376.648056:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 18 00010000:00080000:2.0:1788838376.648062:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00010000:00080000:2.0:1788838376.648066:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00000100:00000040:0.0:1788838376.652950:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2d880 x1875729116522624 msgsize 440 00000100:00100000:0.0:1788838376.652974:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.654182:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116522624 00000100:00100000:1.0:1788838376.654201:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116522624 00000020:00000040:1.0:1788838376.654205:0:8468:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.654212:0:8468:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=19 00000100:00000040:1.0:1788838376.654253:0:8468:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.655559:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1062 00000100:00000040:1.0:1788838376.655566:0:8468:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.655579:0:8468:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2d880 x1875729116522624/t0(4294969492) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.655604:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+19:2403:x1875729116522624:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:1.0:1788838376.655618:0:8468:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bd2d880 x1875729116522624/t0(4294969492) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.655628:0:8468:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969492, current: 4294969492, replaying 00010000:00000040:1.0:1788838376.655632:0:8468:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.655648:0:8468:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2d880 x1875729116522624/t0(4294969492) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.655666:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+19:2403:x1875729116522624:12345-192.168.203.30@tcp:10:dd.0 Request processed in 73us (2719us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.655673:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1062 00010000:00080000:0.0:1788838376.655861:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969492, next_transno: 4294969492 00010000:00080000:0.0:1788838376.655867:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969492) 00010000:00080000:0.0:1788838376.655886:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116522624 t4294969492 from 192.168.203.30@tcp req@ffff8ff62bd2d880 x1875729116522624/t0(4294969492) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788838376.655906:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bd2d880 x1875729116522624/t0(4294969492) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788838376.655946:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38b:0x0] 00000001:00000040:0.0:1788838376.656878:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 15 00000020:00000040:0.0:1788838376.656886:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=20 00010000:00000040:0.0:1788838376.656929:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969492, xid 1875729116522624 00000100:00000040:0.0:1788838376.656943:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838376.656951:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838376.657016:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:0.0:1788838376.657041:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788838376.657058:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:0.0:1788838376.657063:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00010000:00080000:0.0:1788838376.657068:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00000100:00000040:1.0:1788838376.657214:0:8468:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.657229:0:8468:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 19 00000100:00000040:3.0:1788838376.670194:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503f46a00 x1875729116522752 msgsize 440 00000100:00100000:3.0:1788838376.670216:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.670249:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116522752 00000100:00100000:2.0:1788838376.670471:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116522752 00000020:00000040:2.0:1788838376.670489:0:24891:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.670496:0:24891:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=20 00000100:00000040:2.0:1788838376.670533:0:24891:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788838376.670635:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1063 00000100:00000040:2.0:1788838376.670640:0:24891:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:2.0:1788838376.670652:0:24891:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503f46a00 x1875729116522752/t0(4294969493) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.670669:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+20:2403:x1875729116522752:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:2.0:1788838376.670707:0:24891:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f46a00 x1875729116522752/t0(4294969493) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788838376.670716:0:24891:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969493, current: 4294969493, replaying 00010000:00000040:2.0:1788838376.670719:0:24891:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:2.0:1788838376.670738:0:24891:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503f46a00 x1875729116522752/t0(4294969493) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.670747:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+20:2403:x1875729116522752:12345-192.168.203.30@tcp:10:dd.0 Request processed in 82us (555us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.670755:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1063 00000100:00000040:2.0:1788838376.670758:0:24891:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.670816:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969493, next_transno: 4294969493 00010000:00080000:1.0:1788838376.670820:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969493) 00010000:00080000:1.0:1788838376.670830:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116522752 t4294969493 from 192.168.203.30@tcp req@ffff8ff503f46a00 x1875729116522752/t0(4294969493) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.670847:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f46a00 x1875729116522752/t0(4294969493) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788838376.670884:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38a:0x0] 00000001:00000040:1.0:1788838376.671123:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 16 00000020:00000040:1.0:1788838376.671128:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=21 00010000:00000040:1.0:1788838376.671172:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969493, xid 1875729116522752 00000100:00000040:1.0:1788838376.671185:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.671192:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.671254:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.671277:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.671284:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.671295:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 20 00010000:00080000:1.0:1788838376.671300:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00010000:00080000:1.0:1788838376.671304:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00000100:00000040:0.0:1788838376.675732:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2dc00 x1875729116523264 msgsize 1512 00000100:00100000:0.0:1788838376.675757:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.675857:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116523264 00000100:00100000:1.0:1788838376.675870:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116523264 00000020:00000040:1.0:1788838376.675873:0:8466:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.675898:0:8466:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=21 00000100:00000040:1.0:1788838376.675932:0:8466:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.675992:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1064 00000100:00000040:1.0:1788838376.675998:0:8466:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.676007:0:8466:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2dc00 x1875729116523264/t0(4294969494) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.676023:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+21:2403:x1875729116523264:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:1.0:1788838376.676049:0:8466:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bd2dc00 x1875729116523264/t0(4294969494) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.676060:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969494, current: 4294969494, replaying 00010000:00000040:1.0:1788838376.676063:0:8466:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.676084:0:8466:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2dc00 x1875729116523264/t0(4294969494) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.676092:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+21:2403:x1875729116523264:12345-192.168.203.30@tcp:4:dd.0 Request processed in 72us (363us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.676099:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1064 00000100:00000040:1.0:1788838376.676103:0:8466:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.676158:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969494, next_transno: 4294969494 00010000:00080000:3.0:1788838376.676165:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969494) 00010000:00080000:3.0:1788838376.676175:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116523264 t4294969494 from 192.168.203.30@tcp req@ffff8ff62bd2dc00 x1875729116523264/t0(4294969494) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.676193:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bd2dc00 x1875729116523264/t0(4294969494) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.676315:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788838376.676368:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:3.0:1788838376.676372:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1788838376.677089:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 17 00000020:00000040:3.0:1788838376.677103:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=22 00010000:00000040:3.0:1788838376.677689:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969494, xid 1875729116523264 00000100:00000040:3.0:1788838376.677706:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.677714:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.677784:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.677812:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.678059:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.678075:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 21 00010000:00080000:1.0:1788838376.678080:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00010000:00080000:1.0:1788838376.678085:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00000100:00000040:1.0:1788838376.687113:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff501afc700 x1875729116524544 msgsize 440 00000100:00100000:1.0:1788838376.687135:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.688003:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116524544 00000100:00100000:3.0:1788838376.688018:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116524544 00000020:00000040:3.0:1788838376.688021:0:8467:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.688028:0:8467:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=22 00000100:00000040:3.0:1788838376.688068:0:8467:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.688135:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1065 00000100:00000040:3.0:1788838376.688140:0:8467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.688149:0:8467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff501afc700 x1875729116524544/t0(4294969495) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.688165:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2403:x1875729116524544:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:3.0:1788838376.688180:0:8467:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff501afc700 x1875729116524544/t0(4294969495) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.688190:0:8467:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969495, current: 4294969495, replaying 00010000:00000040:3.0:1788838376.688194:0:8467:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.688208:0:8467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff501afc700 x1875729116524544/t0(4294969495) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.688218:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+22:2403:x1875729116524544:12345-192.168.203.30@tcp:10:dd.0 Request processed in 55us (1118us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.688225:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1065 00000100:00000040:3.0:1788838376.688229:0:8467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.688248:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969495, next_transno: 4294969495 00010000:00080000:3.0:1788838376.688268:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969495) 00010000:00080000:3.0:1788838376.688278:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116524544 t4294969495 from 192.168.203.30@tcp req@ffff8ff501afc700 x1875729116524544/t0(4294969495) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.688296:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff501afc700 x1875729116524544/t0(4294969495) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788838376.688335:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38c:0x0] 00000001:00000040:3.0:1788838376.689155:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 18 00000020:00000040:3.0:1788838376.689161:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=23 00010000:00000040:3.0:1788838376.689209:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969495, xid 1875729116524544 00000100:00000040:3.0:1788838376.689225:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.689234:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.689308:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.689321:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788838376.689329:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.689344:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 22 00010000:00080000:3.0:1788838376.689349:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00010000:00080000:3.0:1788838376.692157:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00000100:00000040:2.0:1788838376.699791:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc70a80 x1875729116524928 msgsize 440 00000100:00100000:2.0:1788838376.700022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.700302:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116524928 00000100:00100000:1.0:1788838376.700317:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116524928 00000020:00000040:1.0:1788838376.700321:0:24878:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.700335:0:24878:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=23 00000100:00000040:1.0:1788838376.700550:0:24878:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.700642:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1066 00000100:00000040:1.0:1788838376.700648:0:24878:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.700658:0:24878:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc70a80 x1875729116524928/t0(4294969496) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.700674:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+23:2403:x1875729116524928:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:1.0:1788838376.700690:0:24878:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bc70a80 x1875729116524928/t0(4294969496) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.700700:0:24878:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969496, current: 4294969496, replaying 00010000:00000040:1.0:1788838376.700704:0:24878:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.700756:0:24878:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc70a80 x1875729116524928/t0(4294969496) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.700766:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+23:2403:x1875729116524928:12345-192.168.203.30@tcp:10:dd.0 Request processed in 94us (977us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.700773:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1066 00000100:00000040:1.0:1788838376.700777:0:24878:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.700947:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969496, next_transno: 4294969496 00010000:00080000:3.0:1788838376.700953:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969496) 00010000:00080000:3.0:1788838376.701031:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116524928 t4294969496 from 192.168.203.30@tcp req@ffff8ff62bc70a80 x1875729116524928/t0(4294969496) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.701089:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bc70a80 x1875729116524928/t0(4294969496) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788838376.701131:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38e:0x0] 00000001:00000040:3.0:1788838376.701638:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 19 00000020:00000040:3.0:1788838376.701645:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=24 00010000:00000040:3.0:1788838376.701695:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969496, xid 1875729116524928 00000100:00000040:3.0:1788838376.701717:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.701725:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.702134:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.702147:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788838376.702176:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.702190:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 23 00010000:00080000:3.0:1788838376.702196:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00010000:00080000:3.0:1788838376.702201:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00000100:00000040:0.0:1788838376.708040:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bd2df80 x1875729116525056 msgsize 1512 00000100:00100000:0.0:1788838376.708059:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.708121:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116525056 00000100:00100000:1.0:1788838376.708134:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116525056 00000020:00000040:1.0:1788838376.708138:0:24876:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.708144:0:24876:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=24 00000100:00000040:1.0:1788838376.708179:0:24876:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.708249:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1067 00000100:00000040:1.0:1788838376.708563:0:24876:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.708575:0:24876:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bd2df80 x1875729116525056/t0(4294969497) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.708593:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2403:x1875729116525056:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:1.0:1788838376.708624:0:24876:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bd2df80 x1875729116525056/t0(4294969497) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.708635:0:24876:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969497, current: 4294969497, replaying 00010000:00000040:1.0:1788838376.708639:0:24876:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.709135:0:24876:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bd2df80 x1875729116525056/t0(4294969497) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.709147:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+24:2403:x1875729116525056:12345-192.168.203.30@tcp:4:dd.0 Request processed in 559us (1110us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.709155:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1067 00000100:00000040:1.0:1788838376.709159:0:24876:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:0.0:1788838376.710633:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969497, next_transno: 4294969497 00010000:00080000:0.0:1788838376.710643:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969497) 00010000:00080000:0.0:1788838376.710661:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116525056 t4294969497 from 192.168.203.30@tcp req@ffff8ff62bd2df80 x1875729116525056/t0(4294969497) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788838376.710694:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bd2df80 x1875729116525056/t0(4294969497) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788838376.711181:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788838376.711225:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:0.0:1788838376.711237:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1788838376.713187:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 20 00000020:00000040:0.0:1788838376.713202:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=25 00010000:00000040:0.0:1788838376.713256:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969497, xid 1875729116525056 00000100:00000040:0.0:1788838376.713274:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838376.713283:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838376.714598:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:0.0:1788838376.714623:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.714929:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.714947:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 24 00010000:00080000:1.0:1788838376.714956:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00010000:00080000:1.0:1788838376.714962:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00000100:00000040:3.0:1788838376.722375:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503f46d80 x1875729116526080 msgsize 1512 00000100:00100000:3.0:1788838376.722398:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838376.723229:0:24889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116526080 00000100:00100000:0.0:1788838376.723245:0:24889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116526080 00000020:00000040:0.0:1788838376.723249:0:24889:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:0.0:1788838376.723256:0:24889:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=25 00000100:00000040:0.0:1788838376.723294:0:24889:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788838376.723363:0:24889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1068 00000100:00000040:0.0:1788838376.723369:0:24889:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:0.0:1788838376.723378:0:24889:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503f46d80 x1875729116526080/t0(4294969498) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.723393:0:24889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2403:x1875729116526080:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:0.0:1788838376.723407:0:24889:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f46d80 x1875729116526080/t0(4294969498) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788838376.723417:0:24889:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969498, current: 4294969498, replaying 00010000:00000040:0.0:1788838376.723421:0:24889:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:0.0:1788838376.723436:0:24889:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503f46d80 x1875729116526080/t0(4294969498) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.723446:0:24889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+25:2403:x1875729116526080:12345-192.168.203.30@tcp:4:dd.0 Request processed in 55us (1076us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838376.723453:0:24889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1068 00000100:00000040:0.0:1788838376.723476:0:24889:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.723773:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969498, next_transno: 4294969498 00010000:00080000:3.0:1788838376.723778:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969498) 00010000:00080000:3.0:1788838376.723789:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116526080 t4294969498 from 192.168.203.30@tcp req@ffff8ff503f46d80 x1875729116526080/t0(4294969498) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.723829:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f46d80 x1875729116526080/t0(4294969498) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.723968:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788838376.724004:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:3.0:1788838376.724007:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1788838376.724317:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 21 00000020:00000040:3.0:1788838376.724322:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=26 00010000:00000040:3.0:1788838376.725257:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969498, xid 1875729116526080 00000100:00000040:3.0:1788838376.725279:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.725288:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.725404:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.725421:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788838376.725432:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.725447:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 25 00010000:00080000:3.0:1788838376.725463:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00010000:00080000:3.0:1788838376.725467:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00000100:00000040:2.0:1788838376.733018:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bc71f80 x1875729116527104 msgsize 1512 00000100:00100000:2.0:1788838376.733044:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.733204:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116527104 00000100:00100000:3.0:1788838376.733217:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116527104 00000020:00000040:3.0:1788838376.733221:0:8468:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.733228:0:8468:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=26 00000100:00000040:3.0:1788838376.733258:0:8468:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.733316:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1069 00000100:00000040:3.0:1788838376.733321:0:8468:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.733330:0:8468:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bc71f80 x1875729116527104/t0(4294969499) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.733345:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bc71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2403:x1875729116527104:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:3.0:1788838376.733635:0:8468:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bc71f80 x1875729116527104/t0(4294969499) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.733647:0:8468:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969499, current: 4294969499, replaying 00010000:00000040:3.0:1788838376.733652:0:8468:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.733673:0:8468:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bc71f80 x1875729116527104/t0(4294969499) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.733684:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bc71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+26:2403:x1875729116527104:12345-192.168.203.30@tcp:4:dd.0 Request processed in 340us (668us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.733691:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1069 00000100:00000040:3.0:1788838376.733695:0:8468:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:2.0:1788838376.733748:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969499, next_transno: 4294969499 00010000:00080000:2.0:1788838376.733753:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969499) 00010000:00080000:2.0:1788838376.733762:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116527104 t4294969499 from 192.168.203.30@tcp req@ffff8ff62bc71f80 x1875729116527104/t0(4294969499) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.733780:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff62bc71f80 x1875729116527104/t0(4294969499) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.734704:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788838376.734748:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:2.0:1788838376.734753:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788838376.735131:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 22 00000020:00000040:2.0:1788838376.735138:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=27 00010000:00000040:2.0:1788838376.737863:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969499, xid 1875729116527104 00000100:00000040:2.0:1788838376.737893:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838376.737903:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838376.737973:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:2.0:1788838376.737990:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788838376.738002:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:2.0:1788838376.738017:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 26 00010000:00080000:2.0:1788838376.738025:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00010000:00080000:2.0:1788838376.738030:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00000100:00000040:3.0:1788838376.743561:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503f44e00 x1875729116526976 msgsize 440 00000100:00100000:3.0:1788838376.743583:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.743715:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116526976 00000100:00100000:2.0:1788838376.743728:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116526976 00000020:00000040:2.0:1788838376.743732:0:24891:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.743739:0:24891:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=27 00000100:00000040:2.0:1788838376.743770:0:24891:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788838376.743850:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1070 00000100:00000040:2.0:1788838376.743855:0:24891:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:2.0:1788838376.743864:0:24891:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503f44e00 x1875729116526976/t0(4294969500) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.743880:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+27:2403:x1875729116526976:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:2.0:1788838376.743894:0:24891:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f44e00 x1875729116526976/t0(4294969500) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788838376.743904:0:24891:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969500, current: 4294969500, replaying 00010000:00000040:2.0:1788838376.743908:0:24891:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:2.0:1788838376.743930:0:24891:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503f44e00 x1875729116526976/t0(4294969500) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.743939:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+27:2403:x1875729116526976:12345-192.168.203.30@tcp:10:dd.0 Request processed in 62us (382us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.743966:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1070 00000100:00000040:2.0:1788838376.743970:0:24891:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:0.0:1788838376.744664:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969500, next_transno: 4294969500 00010000:00080000:0.0:1788838376.744671:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969500) 00010000:00080000:0.0:1788838376.744684:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116526976 t4294969500 from 192.168.203.30@tcp req@ffff8ff503f44e00 x1875729116526976/t0(4294969500) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788838376.744706:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f44e00 x1875729116526976/t0(4294969500) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788838376.744746:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38f:0x0] 00000001:00000040:0.0:1788838376.745670:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 23 00000020:00000040:0.0:1788838376.745679:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=28 00010000:00000040:0.0:1788838376.745721:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969500, xid 1875729116526976 00000100:00000040:0.0:1788838376.745735:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838376.745742:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838376.745828:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:0.0:1788838376.745841:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788838376.745850:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:0.0:1788838376.745864:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 27 00010000:00080000:0.0:1788838376.745869:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00010000:00080000:0.0:1788838376.745874:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00000100:00000040:1.0:1788838376.750085:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff501affb80 x1875729116528128 msgsize 1512 00000100:00100000:1.0:1788838376.750113:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838376.750381:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116528128 00000100:00100000:0.0:1788838376.750464:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116528128 00000020:00000040:0.0:1788838376.750469:0:8466:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:0.0:1788838376.750484:0:8466:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=28 00000100:00000040:0.0:1788838376.750519:0:8466:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788838376.750586:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1071 00000100:00000040:0.0:1788838376.750592:0:8466:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:0.0:1788838376.750602:0:8466:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff501affb80 x1875729116528128/t0(4294969501) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.750642:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+28:2403:x1875729116528128:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:0.0:1788838376.750659:0:8466:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff501affb80 x1875729116528128/t0(4294969501) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788838376.750669:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969501, current: 4294969501, replaying 00010000:00000040:0.0:1788838376.750673:0:8466:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:0.0:1788838376.750691:0:8466:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff501affb80 x1875729116528128/t0(4294969501) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.750700:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501affb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+28:2403:x1875729116528128:12345-192.168.203.30@tcp:4:dd.0 Request processed in 60us (618us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838376.750708:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1071 00000100:00000040:0.0:1788838376.750711:0:8466:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:2.0:1788838376.750845:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969501, next_transno: 4294969501 00010000:00080000:2.0:1788838376.750850:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969501) 00010000:00080000:2.0:1788838376.750859:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116528128 t4294969501 from 192.168.203.30@tcp req@ffff8ff501affb80 x1875729116528128/t0(4294969501) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.750877:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff501affb80 x1875729116528128/t0(4294969501) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.751004:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788838376.751040:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:2.0:1788838376.751044:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788838376.752671:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 24 00000020:00000040:2.0:1788838376.752684:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=29 00010000:00000040:2.0:1788838376.753117:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969501, xid 1875729116528128 00000100:00000040:2.0:1788838376.753137:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838376.753147:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838376.753225:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:2.0:1788838376.753241:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788838376.753252:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:2.0:1788838376.753268:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 28 00010000:00080000:2.0:1788838376.753275:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00010000:00080000:2.0:1788838376.753281:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00000100:00000040:2.0:1788838376.758561:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff504ffa300 x1875729116529024 msgsize 440 00000100:00100000:2.0:1788838376.758584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.766215:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116529024 00000100:00100000:1.0:1788838376.766238:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116529024 00000020:00000040:1.0:1788838376.766242:0:24879:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.766250:0:24879:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=29 00000100:00000040:1.0:1788838376.766287:0:24879:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.771581:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1072 00000100:00000040:1.0:1788838376.771593:0:24879:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.771606:0:24879:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff504ffa300 x1875729116529024/t0(4294969502) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.771633:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+29:2403:x1875729116529024:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:1.0:1788838376.771659:0:24879:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff504ffa300 x1875729116529024/t0(4294969502) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.771669:0:24879:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969502, current: 4294969502, replaying 00010000:00000040:1.0:1788838376.771673:0:24879:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.771690:0:24879:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff504ffa300 x1875729116529024/t0(4294969502) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.771700:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+29:2403:x1875729116529024:12345-192.168.203.30@tcp:10:dd.0 Request processed in 79us (13142us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.771708:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1072 00000100:00000040:1.0:1788838376.771712:0:24879:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:0.0:1788838376.771792:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969502, next_transno: 4294969502 00010000:00080000:0.0:1788838376.771818:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969502) 00010000:00080000:0.0:1788838376.771830:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116529024 t4294969502 from 192.168.203.30@tcp req@ffff8ff504ffa300 x1875729116529024/t0(4294969502) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788838376.771848:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff504ffa300 x1875729116529024/t0(4294969502) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788838376.771891:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38d:0x0] 00000001:00000040:0.0:1788838376.772126:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 25 00000020:00000040:0.0:1788838376.772131:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=30 00010000:00000040:0.0:1788838376.772176:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969502, xid 1875729116529024 00000100:00000040:0.0:1788838376.772189:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838376.772195:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838376.772267:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:0.0:1788838376.772286:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788838376.772293:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:0.0:1788838376.772307:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 29 00010000:00080000:0.0:1788838376.772312:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00010000:00080000:0.0:1788838376.772316:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00000100:00000040:3.0:1788838376.780665:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503f47480 x1875729116529152 msgsize 1512 00000100:00100000:3.0:1788838376.780689:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.781001:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116529152 00000100:00100000:1.0:1788838376.781014:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116529152 00000020:00000040:1.0:1788838376.781018:0:24878:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.781024:0:24878:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=30 00000100:00000040:1.0:1788838376.781058:0:24878:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.781120:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1073 00000100:00000040:1.0:1788838376.781126:0:24878:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.781137:0:24878:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503f47480 x1875729116529152/t0(4294969503) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.781152:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+30:2403:x1875729116529152:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:1.0:1788838376.781165:0:24878:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f47480 x1875729116529152/t0(4294969503) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.781175:0:24878:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969503, current: 4294969503, replaying 00010000:00000040:1.0:1788838376.781179:0:24878:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.781197:0:24878:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503f47480 x1875729116529152/t0(4294969503) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.781215:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+30:2403:x1875729116529152:12345-192.168.203.30@tcp:4:dd.0 Request processed in 66us (551us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.781222:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1073 00000100:00000040:1.0:1788838376.781225:0:24878:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:0.0:1788838376.781286:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969503, next_transno: 4294969503 00010000:00080000:0.0:1788838376.781291:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969503) 00010000:00080000:0.0:1788838376.781301:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116529152 t4294969503 from 192.168.203.30@tcp req@ffff8ff503f47480 x1875729116529152/t0(4294969503) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788838376.781318:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f47480 x1875729116529152/t0(4294969503) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788838376.781458:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1788838376.781506:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:0.0:1788838376.781510:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1788838376.781866:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 26 00000020:00000040:0.0:1788838376.781871:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=31 00010000:00000040:1.0:1788838376.784705:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969503, xid 1875729116529152 00000100:00000040:1.0:1788838376.784733:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.784744:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.784840:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.784856:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.784868:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.784882:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 30 00010000:00080000:1.0:1788838376.784890:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00010000:00080000:1.0:1788838376.784895:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00000100:00000040:1.0:1788838376.801783:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff501afc380 x1875729116530048 msgsize 440 00000100:00100000:1.0:1788838376.801851:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.801993:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116530048 00000100:00100000:2.0:1788838376.802009:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116530048 00000020:00000040:2.0:1788838376.802033:0:24876:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.802040:0:24876:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=31 00000100:00000040:2.0:1788838376.802076:0:24876:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788838376.802129:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1074 00000100:00000040:2.0:1788838376.802134:0:24876:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:2.0:1788838376.802145:0:24876:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff501afc380 x1875729116530048/t0(4294969504) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.802161:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+31:2403:x1875729116530048:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:2.0:1788838376.802174:0:24876:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff501afc380 x1875729116530048/t0(4294969504) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788838376.802185:0:24876:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969504, current: 4294969504, replaying 00010000:00000040:2.0:1788838376.802188:0:24876:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:2.0:1788838376.802207:0:24876:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff501afc380 x1875729116530048/t0(4294969504) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.802217:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+31:2403:x1875729116530048:12345-192.168.203.30@tcp:10:dd.0 Request processed in 59us (436us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.802225:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1074 00000100:00000040:2.0:1788838376.802229:0:24876:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.802337:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969504, next_transno: 4294969504 00010000:00080000:1.0:1788838376.802341:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969504) 00010000:00080000:1.0:1788838376.802351:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116530048 t4294969504 from 192.168.203.30@tcp req@ffff8ff501afc380 x1875729116530048/t0(4294969504) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.802369:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff501afc380 x1875729116530048/t0(4294969504) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788838376.802485:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x390:0x0] 00000001:00000040:1.0:1788838376.802720:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 27 00000020:00000040:1.0:1788838376.802724:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=32 00010000:00000040:1.0:1788838376.802768:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969504, xid 1875729116530048 00000100:00000040:1.0:1788838376.802780:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.802954:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.803063:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.803075:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.803082:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.803095:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 31 00010000:00080000:1.0:1788838376.803100:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00010000:00080000:1.0:1788838376.803105:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00000100:00000040:3.0:1788838376.822763:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503f45500 x1875729116530688 msgsize 1512 00000100:00100000:3.0:1788838376.822785:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.822932:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116530688 00000100:00100000:2.0:1788838376.822946:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116530688 00000020:00000040:2.0:1788838376.822950:0:25104:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.822957:0:25104:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=32 00000100:00000040:0.0:1788838376.823066:0:25104:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788838376.823430:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1075 00000100:00000040:0.0:1788838376.823437:0:25104:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:0.0:1788838376.823447:0:25104:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503f45500 x1875729116530688/t0(4294969505) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.823465:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:efc561ba-875e-4857-b79b-9bd7023bd57c+32:2403:x1875729116530688:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:0.0:1788838376.823491:0:25104:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f45500 x1875729116530688/t0(4294969505) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788838376.823502:0:25104:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969505, current: 4294969505, replaying 00010000:00000040:0.0:1788838376.823507:0:25104:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:0.0:1788838376.823551:0:25104:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503f45500 x1875729116530688/t0(4294969505) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.823560:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:efc561ba-875e-4857-b79b-9bd7023bd57c+32:2403:x1875729116530688:12345-192.168.203.30@tcp:4:dd.0 Request processed in 100us (799us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838376.823567:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1075 00000100:00000040:0.0:1788838376.823571:0:25104:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.823708:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969505, next_transno: 4294969505 00010000:00080000:3.0:1788838376.823714:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969505) 00010000:00080000:3.0:1788838376.823723:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116530688 t4294969505 from 192.168.203.30@tcp req@ffff8ff503f45500 x1875729116530688/t0(4294969505) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.823740:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f45500 x1875729116530688/t0(4294969505) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.823895:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788838376.823930:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:3.0:1788838376.823933:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1788838376.824257:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 28 00000020:00000040:3.0:1788838376.824263:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=33 00010000:00000040:3.0:1788838376.826735:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969505, xid 1875729116530688 00000100:00000040:3.0:1788838376.826765:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.826777:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.826892:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.826909:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788838376.826921:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.826939:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 32 00010000:00080000:3.0:1788838376.826947:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00010000:00080000:3.0:1788838376.826961:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00000100:00000040:0.0:1788838376.836593:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff50719f100 x1875729116531968 msgsize 440 00000100:00100000:0.0:1788838376.836616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.836930:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116531968 00000100:00100000:2.0:1788838376.836945:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116531968 00000020:00000040:2.0:1788838376.836949:0:8468:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.836966:0:8468:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=33 00000100:00000040:2.0:1788838376.837004:0:8468:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788838376.837057:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1076 00000100:00000040:2.0:1788838376.837080:0:8468:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:2.0:1788838376.837091:0:8468:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff50719f100 x1875729116531968/t0(4294969506) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.837107:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+33:2403:x1875729116531968:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:2.0:1788838376.837122:0:8468:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff50719f100 x1875729116531968/t0(4294969506) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788838376.837133:0:8468:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969506, current: 4294969506, replaying 00010000:00000040:2.0:1788838376.837137:0:8468:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:2.0:1788838376.837156:0:8468:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff50719f100 x1875729116531968/t0(4294969506) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.837166:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+33:2403:x1875729116531968:12345-192.168.203.30@tcp:10:dd.0 Request processed in 62us (575us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.837173:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1076 00000100:00000040:2.0:1788838376.837177:0:8468:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.837293:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969506, next_transno: 4294969506 00010000:00080000:1.0:1788838376.837298:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969506) 00010000:00080000:1.0:1788838376.837308:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116531968 t4294969506 from 192.168.203.30@tcp req@ffff8ff50719f100 x1875729116531968/t0(4294969506) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.837327:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff50719f100 x1875729116531968/t0(4294969506) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788838376.837382:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x391:0x0] 00000001:00000040:1.0:1788838376.837650:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 29 00000020:00000040:1.0:1788838376.837655:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=34 00010000:00000040:1.0:1788838376.837700:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969506, xid 1875729116531968 00000100:00000040:1.0:1788838376.837713:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.837719:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.837786:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.837862:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.837869:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.837882:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 33 00010000:00080000:1.0:1788838376.837887:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00010000:00080000:1.0:1788838376.837891:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00000100:00000040:1.0:1788838376.847073:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff501afdc00 x1875729116532096 msgsize 1512 00000100:00100000:1.0:1788838376.847095:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.847162:0:26090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116532096 00000100:00100000:1.0:1788838376.847176:0:26090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116532096 00000020:00000040:1.0:1788838376.847180:0:26090:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.847185:0:26090:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=34 00000100:00000040:1.0:1788838376.847216:0:26090:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.847268:0:26090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1077 00000100:00000040:1.0:1788838376.847274:0:26090:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.847284:0:26090:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff501afdc00 x1875729116532096/t0(4294969507) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.847300:0:26090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+34:2403:x1875729116532096:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:1.0:1788838376.847314:0:26090:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff501afdc00 x1875729116532096/t0(4294969507) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.847325:0:26090:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969507, current: 4294969507, replaying 00010000:00000040:1.0:1788838376.847328:0:26090:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.847341:0:26090:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff501afdc00 x1875729116532096/t0(4294969507) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.847350:0:26090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+34:2403:x1875729116532096:12345-192.168.203.30@tcp:4:dd.0 Request processed in 54us (279us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.847357:0:26090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1077 00000100:00000040:1.0:1788838376.847361:0:26090:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.847379:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969507, next_transno: 4294969507 00010000:00080000:1.0:1788838376.847384:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969507) 00010000:00080000:1.0:1788838376.847404:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116532096 t4294969507 from 192.168.203.30@tcp req@ffff8ff501afdc00 x1875729116532096/t0(4294969507) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.847421:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff501afdc00 x1875729116532096/t0(4294969507) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.847572:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788838376.847619:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:1.0:1788838376.847623:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788838376.848007:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 30 00000020:00000040:1.0:1788838376.848013:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=35 00010000:00000040:1.0:1788838376.849716:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969507, xid 1875729116532096 00000100:00000040:1.0:1788838376.849743:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.849753:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.849847:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.849863:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.849876:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.849892:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 34 00010000:00080000:1.0:1788838376.849900:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00010000:00080000:1.0:1788838376.849905:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00000100:00000040:2.0:1788838376.855778:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff504ffb800 x1875729116532736 msgsize 1512 00000100:00100000:2.0:1788838376.855828:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838376.856228:0:8467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116532736 00000100:00100000:0.0:1788838376.856241:0:8467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116532736 00000020:00000040:0.0:1788838376.856245:0:8467:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:0.0:1788838376.856252:0:8467:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=35 00000100:00000040:0.0:1788838376.856289:0:8467:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788838376.856525:0:8467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1078 00000100:00000040:0.0:1788838376.856530:0:8467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:0.0:1788838376.856541:0:8467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff504ffb800 x1875729116532736/t0(4294969508) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.856558:0:8467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+35:2403:x1875729116532736:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:0.0:1788838376.856572:0:8467:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff504ffb800 x1875729116532736/t0(4294969508) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788838376.856582:0:8467:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969508, current: 4294969508, replaying 00010000:00000040:0.0:1788838376.856586:0:8467:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:0.0:1788838376.856601:0:8467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff504ffb800 x1875729116532736/t0(4294969508) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.856610:0:8467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+35:2403:x1875729116532736:12345-192.168.203.30@tcp:4:dd.0 Request processed in 56us (834us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838376.856630:0:8467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1078 00000100:00000040:0.0:1788838376.856633:0:8467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.856710:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969508, next_transno: 4294969508 00010000:00080000:1.0:1788838376.856715:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969508) 00010000:00080000:1.0:1788838376.856725:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116532736 t4294969508 from 192.168.203.30@tcp req@ffff8ff504ffb800 x1875729116532736/t0(4294969508) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.856742:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff504ffb800 x1875729116532736/t0(4294969508) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.856894:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788838376.856935:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:1.0:1788838376.856939:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788838376.857255:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 31 00000020:00000040:1.0:1788838376.857261:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=36 00010000:00000040:1.0:1788838376.858631:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969508, xid 1875729116532736 00000100:00000040:1.0:1788838376.858663:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.858694:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.858869:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.858888:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.858901:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.858918:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 35 00010000:00080000:1.0:1788838376.858925:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00010000:00080000:1.0:1788838376.858930:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00000100:00000040:0.0:1788838376.877658:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61fcd2d80 x1875729116533632 msgsize 1512 00000100:00100000:0.0:1788838376.877685:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838376.877879:0:24879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116533632 00000100:00100000:1.0:1788838376.877892:0:24879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116533632 00000020:00000040:1.0:1788838376.877896:0:24879:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:1.0:1788838376.877902:0:24879:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=36 00000100:00000040:1.0:1788838376.877938:0:24879:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788838376.878005:0:24879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1079 00000100:00000040:1.0:1788838376.878010:0:24879:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:1.0:1788838376.878019:0:24879:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61fcd2d80 x1875729116533632/t0(4294969509) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.878035:0:24879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+36:2403:x1875729116533632:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:1.0:1788838376.878050:0:24879:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff61fcd2d80 x1875729116533632/t0(4294969509) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788838376.878060:0:24879:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969509, current: 4294969509, replaying 00010000:00000040:1.0:1788838376.878065:0:24879:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:1.0:1788838376.878083:0:24879:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61fcd2d80 x1875729116533632/t0(4294969509) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788838376.878093:0:24879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+36:2403:x1875729116533632:12345-192.168.203.30@tcp:4:dd.0 Request processed in 60us (438us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788838376.878100:0:24879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1079 00000100:00000040:1.0:1788838376.878103:0:24879:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.879206:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969509, next_transno: 4294969509 00010000:00080000:3.0:1788838376.879220:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969509) 00010000:00080000:3.0:1788838376.879241:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116533632 t4294969509 from 192.168.203.30@tcp req@ffff8ff61fcd2d80 x1875729116533632/t0(4294969509) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.879270:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff61fcd2d80 x1875729116533632/t0(4294969509) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.879430:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788838376.879473:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:3.0:1788838376.879488:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1788838376.879835:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 32 00000020:00000040:3.0:1788838376.879840:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=37 00010000:00000040:3.0:1788838376.884140:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969509, xid 1875729116533632 00000100:00000040:3.0:1788838376.884171:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.884184:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.884262:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.884279:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788838376.884289:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.884303:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 36 00010000:00080000:3.0:1788838376.884310:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00010000:00080000:3.0:1788838376.884315:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00000100:00000040:2.0:1788838376.887584:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff504ffb100 x1875729116533504 msgsize 440 00000100:00100000:2.0:1788838376.887605:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.888738:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116533504 00000100:00100000:3.0:1788838376.888754:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116533504 00000020:00000040:3.0:1788838376.888758:0:25108:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.888773:0:25108:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=37 00000100:00000040:3.0:1788838376.888824:0:25108:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.888885:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1080 00000100:00000040:3.0:1788838376.888891:0:25108:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.888900:0:25108:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff504ffb100 x1875729116533504/t0(4294969510) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.888916:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+37:2403:x1875729116533504:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:3.0:1788838376.888931:0:25108:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff504ffb100 x1875729116533504/t0(4294969510) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.888941:0:25108:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969510, current: 4294969510, replaying 00010000:00000040:3.0:1788838376.888955:0:25108:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.888978:0:25108:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff504ffb100 x1875729116533504/t0(4294969510) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.888988:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+37:2403:x1875729116533504:12345-192.168.203.30@tcp:10:dd.0 Request processed in 75us (1406us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.888997:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1080 00000100:00000040:3.0:1788838376.889001:0:25108:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.889036:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969510, next_transno: 4294969510 00010000:00080000:1.0:1788838376.889043:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969510) 00010000:00080000:1.0:1788838376.889054:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116533504 t4294969510 from 192.168.203.30@tcp req@ffff8ff504ffb100 x1875729116533504/t0(4294969510) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.889071:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff504ffb100 x1875729116533504/t0(4294969510) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788838376.889111:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x392:0x0] 00000001:00000040:1.0:1788838376.889348:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 33 00000020:00000040:1.0:1788838376.889364:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=38 00010000:00000040:1.0:1788838376.889494:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969510, xid 1875729116533504 00000100:00000040:1.0:1788838376.889507:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.889514:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.889586:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.889597:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.889605:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.889620:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 37 00010000:00080000:1.0:1788838376.889624:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00010000:00080000:1.0:1788838376.889628:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00000100:00000040:2.0:1788838376.894165:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff504ff8e00 x1875729116534016 msgsize 440 00000100:00100000:2.0:1788838376.894188:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.900661:0:24889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116534016 00000100:00100000:3.0:1788838376.900685:0:24889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116534016 00000020:00000040:3.0:1788838376.900688:0:24889:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.900696:0:24889:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=38 00000100:00000040:2.0:1788838376.902940:0:24889:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788838376.903040:0:24889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1081 00000100:00000040:2.0:1788838376.903046:0:24889:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:2.0:1788838376.903056:0:24889:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff504ff8e00 x1875729116534016/t0(4294969511) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.903073:0:24889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff504ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+38:2403:x1875729116534016:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:2.0:1788838376.903110:0:24889:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff504ff8e00 x1875729116534016/t0(4294969511) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788838376.903121:0:24889:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969511, current: 4294969511, replaying 00010000:00000040:2.0:1788838376.903125:0:24889:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:2.0:1788838376.903147:0:24889:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff504ff8e00 x1875729116534016/t0(4294969511) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.903158:0:24889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff504ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:efc561ba-875e-4857-b79b-9bd7023bd57c+38:2403:x1875729116534016:12345-192.168.203.30@tcp:10:dd.0 Request processed in 87us (8995us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.903167:0:24889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1081 00000100:00000040:2.0:1788838376.903170:0:24889:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:2.0:1788838376.903195:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969511, next_transno: 4294969511 00010000:00080000:2.0:1788838376.903200:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969511) 00010000:00080000:2.0:1788838376.903209:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116534016 t4294969511 from 192.168.203.30@tcp req@ffff8ff504ff8e00 x1875729116534016/t0(4294969511) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.903225:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff504ff8e00 x1875729116534016/t0(4294969511) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788838376.903266:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x393:0x0] 00000001:00000040:2.0:1788838376.903680:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 34 00000020:00000040:2.0:1788838376.903686:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=39 00010000:00000040:2.0:1788838376.903730:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969511, xid 1875729116534016 00000100:00000040:2.0:1788838376.903743:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838376.903750:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838376.903854:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:2.0:1788838376.903866:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788838376.904038:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:2.0:1788838376.904053:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 38 00010000:00080000:2.0:1788838376.904068:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00010000:00080000:2.0:1788838376.904073:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00000100:00000040:2.0:1788838376.907870:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503c3d180 x1875729116534656 msgsize 1512 00000100:00100000:2.0:1788838376.907890:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838376.908297:0:24890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116534656 00000100:00100000:3.0:1788838376.908310:0:24890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116534656 00000020:00000040:3.0:1788838376.908315:0:24890:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:3.0:1788838376.908322:0:24890:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=39 00000100:00000040:3.0:1788838376.908370:0:24890:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788838376.908569:0:24890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1082 00000100:00000040:3.0:1788838376.908575:0:24890:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:3.0:1788838376.908584:0:24890:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503c3d180 x1875729116534656/t0(4294969512) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.908600:0:24890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+39:2403:x1875729116534656:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:3.0:1788838376.908617:0:24890:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3d180 x1875729116534656/t0(4294969512) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788838376.908627:0:24890:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969512, current: 4294969512, replaying 00010000:00000040:3.0:1788838376.908631:0:24890:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:3.0:1788838376.908643:0:24890:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3d180 x1875729116534656/t0(4294969512) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788838376.908675:0:24890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+39:2403:x1875729116534656:12345-192.168.203.30@tcp:4:dd.0 Request processed in 78us (807us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838376.908682:0:24890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1082 00000100:00000040:3.0:1788838376.908686:0:24890:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:2.0:1788838376.908771:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969512, next_transno: 4294969512 00010000:00080000:2.0:1788838376.908775:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969512) 00010000:00080000:2.0:1788838376.908785:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116534656 t4294969512 from 192.168.203.30@tcp req@ffff8ff503c3d180 x1875729116534656/t0(4294969512) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.908830:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3d180 x1875729116534656/t0(4294969512) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788838376.908981:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1788838376.909022:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:2.0:1788838376.909026:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1788838376.910302:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 35 00000020:00000040:2.0:1788838376.910312:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=40 00010000:00000040:2.0:1788838376.911061:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969512, xid 1875729116534656 00000100:00000040:2.0:1788838376.911082:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838376.911092:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838376.911167:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:2.0:1788838376.911182:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788838376.911193:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:2.0:1788838376.911211:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 39 00010000:00080000:2.0:1788838376.911218:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00010000:00080000:2.0:1788838376.911223:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00000100:00000040:3.0:1788838376.919268:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503f47100 x1875729116535040 msgsize 1512 00000100:00100000:3.0:1788838376.919289:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838376.919712:0:24891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116535040 00000100:00100000:0.0:1788838376.919732:0:24891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116535040 00000020:00000040:0.0:1788838376.919736:0:24891:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:0.0:1788838376.919744:0:24891:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=40 00000100:00000040:0.0:1788838376.919780:0:24891:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788838376.919871:0:24891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1083 00000100:00000040:0.0:1788838376.919877:0:24891:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:0.0:1788838376.919889:0:24891:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503f47100 x1875729116535040/t0(4294969513) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.919905:0:24891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+40:2403:x1875729116535040:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:0.0:1788838376.919919:0:24891:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f47100 x1875729116535040/t0(4294969513) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788838376.919929:0:24891:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969513, current: 4294969513, replaying 00010000:00000040:0.0:1788838376.919933:0:24891:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:0.0:1788838376.919966:0:24891:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503f47100 x1875729116535040/t0(4294969513) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.919977:0:24891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+40:2403:x1875729116535040:12345-192.168.203.30@tcp:4:dd.0 Request processed in 73us (708us total) trans 0 rc 0/-999 00010000:00080000:3.0:1788838376.919984:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969513, next_transno: 4294969513 00000100:00100000:0.0:1788838376.919986:0:24891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1083 00000100:00000040:0.0:1788838376.919995:0:24891:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.919997:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969513) 00010000:00080000:3.0:1788838376.920018:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116535040 t4294969513 from 192.168.203.30@tcp req@ffff8ff503f47100 x1875729116535040/t0(4294969513) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.920052:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f47100 x1875729116535040/t0(4294969513) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.920161:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788838376.920189:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:3.0:1788838376.920193:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1788838376.923024:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 36 00000020:00000040:3.0:1788838376.923036:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=41 00010000:00000040:3.0:1788838376.923087:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969513, xid 1875729116535040 00000100:00000040:3.0:1788838376.923102:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.923110:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.923175:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.923188:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788838376.923198:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.923209:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 40 00010000:00080000:3.0:1788838376.923214:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00010000:00080000:3.0:1788838376.923219:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00000100:00000040:3.0:1788838376.932119:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503f47800 x1875729116534912 msgsize 440 00000100:00100000:3.0:1788838376.932139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838376.934948:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116534912 00000100:00100000:0.0:1788838376.934982:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116534912 00000020:00000040:0.0:1788838376.934987:0:8466:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:0.0:1788838376.934995:0:8466:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=41 00000100:00000040:0.0:1788838376.935037:0:8466:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788838376.935117:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1084 00000100:00000040:0.0:1788838376.935124:0:8466:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:0.0:1788838376.935136:0:8466:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503f47800 x1875729116534912/t0(4294969514) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.935153:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+41:2403:x1875729116534912:12345-192.168.203.30@tcp:10:dd.0 00000020:00000040:0.0:1788838376.935170:0:8466:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f47800 x1875729116534912/t0(4294969514) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788838376.935181:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969514, current: 4294969514, replaying 00010000:00000040:0.0:1788838376.935185:0:8466:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:0.0:1788838376.935211:0:8466:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503f47800 x1875729116534912/t0(4294969514) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.935221:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+41:2403:x1875729116534912:12345-192.168.203.30@tcp:10:dd.0 Request processed in 72us (3103us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838376.935229:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1084 00000100:00000040:0.0:1788838376.935233:0:8466:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.935458:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969514, next_transno: 4294969514 00010000:00080000:1.0:1788838376.935463:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969514) 00010000:00080000:1.0:1788838376.935475:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116534912 t4294969514 from 192.168.203.30@tcp req@ffff8ff503f47800 x1875729116534912/t0(4294969514) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.935504:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f47800 x1875729116534912/t0(4294969514) o10->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 440/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788838376.935552:0:96981:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x395:0x0] 00000001:00000040:1.0:1788838376.936210:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 37 00000020:00000040:1.0:1788838376.936229:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=42 00010000:00000040:1.0:1788838376.938238:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969514, xid 1875729116534912 00000100:00000040:1.0:1788838376.938268:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.938279:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.938424:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.938443:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.938457:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.938474:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 41 00010000:00080000:1.0:1788838376.938491:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00010000:00080000:1.0:1788838376.938497:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00000100:00000040:3.0:1788838376.941085:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503f46300 x1875729116535552 msgsize 1512 00000100:00100000:3.0:1788838376.941299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.944880:0:24888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116535552 00000100:00100000:2.0:1788838376.944905:0:24888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116535552 00000020:00000040:2.0:1788838376.944909:0:24888:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.944917:0:24888:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=42 00000100:00000040:2.0:1788838376.944987:0:24888:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788838376.945057:0:24888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1085 00000100:00000040:2.0:1788838376.945064:0:24888:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:2.0:1788838376.945073:0:24888:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503f46300 x1875729116535552/t0(4294969515) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.945089:0:24888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+42:2403:x1875729116535552:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:2.0:1788838376.945104:0:24888:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f46300 x1875729116535552/t0(4294969515) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788838376.945114:0:24888:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969515, current: 4294969515, replaying 00010000:00000040:2.0:1788838376.945118:0:24888:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:2.0:1788838376.945146:0:24888:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503f46300 x1875729116535552/t0(4294969515) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.945156:0:24888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:efc561ba-875e-4857-b79b-9bd7023bd57c+42:2403:x1875729116535552:12345-192.168.203.30@tcp:4:dd.0 Request processed in 70us (4073us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.945164:0:24888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1085 00000100:00000040:2.0:1788838376.945168:0:24888:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.945199:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969515, next_transno: 4294969515 00010000:00080000:3.0:1788838376.945206:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969515) 00010000:00080000:3.0:1788838376.945217:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116535552 t4294969515 from 192.168.203.30@tcp req@ffff8ff503f46300 x1875729116535552/t0(4294969515) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.945237:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503f46300 x1875729116535552/t0(4294969515) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.945387:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788838376.945431:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:3.0:1788838376.945435:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1788838376.946235:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 38 00000020:00000040:3.0:1788838376.946243:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=43 00010000:00000040:3.0:1788838376.946285:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969515, xid 1875729116535552 00000100:00000040:3.0:1788838376.946302:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.946310:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.946383:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.946396:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788838376.950014:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:2.0:1788838376.950045:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 42 00010000:00080000:2.0:1788838376.950053:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00010000:00080000:2.0:1788838376.950060:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00000100:00000040:3.0:1788838376.950250:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6270bf100 x1875729116535808 msgsize 1512 00000100:00100000:3.0:1788838376.950263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.950523:0:24878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116535808 00000100:00100000:2.0:1788838376.950536:0:24878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116535808 00000020:00000040:2.0:1788838376.950540:0:24878:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.950545:0:24878:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=43 00000100:00000040:2.0:1788838376.950575:0:24878:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788838376.950626:0:24878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1086 00000100:00000040:2.0:1788838376.950631:0:24878:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:2.0:1788838376.950657:0:24878:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6270bf100 x1875729116535808/t0(4294969516) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.950673:0:24878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+43:2403:x1875729116535808:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:2.0:1788838376.950687:0:24878:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff6270bf100 x1875729116535808/t0(4294969516) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788838376.950697:0:24878:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969516, current: 4294969516, replaying 00010000:00000040:2.0:1788838376.950701:0:24878:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:2.0:1788838376.950723:0:24878:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270bf100 x1875729116535808/t0(4294969516) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788838376.950733:0:24878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+43:2403:x1875729116535808:12345-192.168.203.30@tcp:4:dd.0 Request processed in 63us (482us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.950741:0:24878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1086 00000100:00000040:2.0:1788838376.950745:0:24878:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.951041:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969516, next_transno: 4294969516 00010000:00080000:3.0:1788838376.951047:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969516) 00010000:00080000:3.0:1788838376.951057:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116535808 t4294969516 from 192.168.203.30@tcp req@ffff8ff6270bf100 x1875729116535808/t0(4294969516) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.951075:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff6270bf100 x1875729116535808/t0(4294969516) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788838376.951300:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1788838376.951341:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:3.0:1788838376.951346:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1788838376.952642:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 39 00000020:00000040:3.0:1788838376.952655:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=44 00010000:00000040:3.0:1788838376.953086:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969516, xid 1875729116535808 00000100:00000040:3.0:1788838376.953174:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:3.0:1788838376.953184:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:3.0:1788838376.953258:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:3.0:1788838376.953272:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788838376.953283:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.953300:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 43 00010000:00080000:3.0:1788838376.953306:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969517 00010000:00080000:3.0:1788838376.953310:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969517 00000100:00000040:2.0:1788838376.962278:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503c3df80 x1875729116536064 msgsize 1512 00000100:00100000:2.0:1788838376.962300:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838376.963043:0:25108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116536064 00000100:00100000:0.0:1788838376.963058:0:25108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116536064 00000020:00000040:0.0:1788838376.963063:0:25108:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:0.0:1788838376.963070:0:25108:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=44 00000100:00000040:0.0:1788838376.963104:0:25108:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788838376.963214:0:25108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1087 00000100:00000040:0.0:1788838376.963219:0:25108:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:0.0:1788838376.963231:0:25108:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503c3df80 x1875729116536064/t0(4294969517) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.963263:0:25108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+44:2403:x1875729116536064:12345-192.168.203.30@tcp:4:dd.0 00000020:00000040:0.0:1788838376.963278:0:25108:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3df80 x1875729116536064/t0(4294969517) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788838376.963289:0:25108:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969517, current: 4294969517, replaying 00010000:00000040:0.0:1788838376.963293:0:25108:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:0.0:1788838376.963316:0:25108:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3df80 x1875729116536064/t0(4294969517) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788838376.963327:0:25108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:efc561ba-875e-4857-b79b-9bd7023bd57c+44:2403:x1875729116536064:12345-192.168.203.30@tcp:4:dd.0 Request processed in 68us (1051us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788838376.963337:0:25108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1087 00000100:00000040:0.0:1788838376.963341:0:25108:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:1.0:1788838376.963392:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969517, next_transno: 4294969517 00010000:00080000:1.0:1788838376.963398:0:96981:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969517) 00010000:00080000:1.0:1788838376.963409:0:96981:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875729116536064 t4294969517 from 192.168.203.30@tcp req@ffff8ff503c3df80 x1875729116536064/t0(4294969517) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.963429:0:96981:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3df80 x1875729116536064/t0(4294969517) o4->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 1512/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788838376.963583:0:96981:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1788838376.963628:0:96981:0:(lnet-crypto.c:96:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 4647 MB/s 00000020:00000040:1.0:1788838376.963632:0:96981:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1788838376.964040:0:96981:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8ff604961800 : new cb_count 40 00000020:00000040:1.0:1788838376.964047:0:96981:0:(genops.c:868:class_export_get()) GET export ffff8ff604961800 refcount=45 00010000:00000040:1.0:1788838376.964726:0:96981:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969477, transno 4294969517, xid 1875729116536064 00000100:00000040:1.0:1788838376.964745:0:96981:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838376.964755:0:96981:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838376.964849:0:96981:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00010000:00080000:1.0:1788838376.964863:0:96981:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788838376.964873:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:1.0:1788838376.964891:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 44 00010000:00080000:1.0:1788838376.964909:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969518 00010000:00080000:1.0:1788838376.964914:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969518 00000100:00000040:3.0:1788838376.968640:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6270bc700 x1875729116540160 msgsize 328 00000100:00100000:3.0:1788838376.968666:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.968768:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116540160 00000100:00100000:2.0:1788838376.968782:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116540160 00000020:00000040:2.0:1788838376.968786:0:26206:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.968793:0:26206:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=45 00000100:00100000:2.0:1788838376.968900:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6079 00000100:00000040:2.0:1788838376.968905:0:26206:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 1 00000100:00000040:2.0:1788838376.968915:0:26206:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6270bc700 x1875729116540160/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.968930:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+45:2403:x1875729116540160:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788838376.969065:0:26206:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff6270bc700 x1875729116540160/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788838376.969094:0:26206:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00010000:00080000:2.0:1788838376.969099:0:26206:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff6270bc700 x1875729116540160/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.969127:0:26206:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270bc700 x1875729116540160/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.969136:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+45:2403:x1875729116540160:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 209us (499us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.969144:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6079 00000100:00000040:2.0:1788838376.969148:0:26206:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00010000:00080000:3.0:1788838376.969204:0:96981:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294969518 00010000:00080000:3.0:1788838376.969210:0:96981:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00000040:3.0:1788838376.969223:0:96981:0:(ldlm_lib.c:2907:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:3.0:1788838376.969226:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838376.969230:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838376.969237:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff6270bc700 x1875729116540160/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838376.969246:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00000100:00000040:2.0:1788838376.981419:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503c3d880 x1875729116540288 msgsize 328 00000100:00100000:2.0:1788838376.981442:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:2.0:1788838376.981496:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503c3dc00 x1875729116540416 msgsize 328 00000100:00100000:2.0:1788838376.981502:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:2.0:1788838376.981522:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503c3f800 x1875729116540544 msgsize 328 00000100:00100000:2.0:1788838376.981526:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:2.0:1788838376.981544:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503c3d500 x1875729116540672 msgsize 328 00000100:00100000:2.0:1788838376.981548:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:2.0:1788838376.981566:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503c3f480 x1875729116540800 msgsize 328 00000100:00100000:2.0:1788838376.981570:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:2.0:1788838376.981591:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503c3fb80 x1875729116540928 msgsize 328 00000100:00100000:2.0:1788838376.981595:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:2.0:1788838376.981627:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff503c3ed80 x1875729116541056 msgsize 328 00000100:00100000:2.0:1788838376.981632:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838376.981681:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116540288 00000100:00100000:2.0:1788838376.981696:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116540288 00000020:00000040:2.0:1788838376.981700:0:26220:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.981717:0:26220:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=46 00000100:00100000:2.0:1788838376.981786:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116540416 00000100:00100000:2.0:1788838376.981790:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116540416 00000020:00000040:2.0:1788838376.981792:0:26220:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.981794:0:26220:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=47 00000100:00100000:2.0:1788838376.981845:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116540544 00000100:00100000:2.0:1788838376.981849:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116540544 00000020:00000040:2.0:1788838376.981851:0:26220:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.981852:0:26220:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=48 00000100:00100000:2.0:1788838376.981868:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116540672 00000100:00100000:2.0:1788838376.981871:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116540672 00000020:00000040:2.0:1788838376.981873:0:26220:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.981875:0:26220:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=49 00000100:00100000:2.0:1788838376.981889:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116540800 00000100:00100000:2.0:1788838376.981891:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116540800 00000020:00000040:2.0:1788838376.981894:0:26220:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.981896:0:26220:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=50 00000100:00100000:2.0:1788838376.981912:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116540928 00000100:00100000:2.0:1788838376.981915:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116540928 00000020:00000040:2.0:1788838376.981917:0:26220:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.981918:0:26220:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=51 00000100:00100000:2.0:1788838376.981938:0:26220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116541056 00000100:00100000:2.0:1788838376.981941:0:26220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116541056 00000020:00000040:2.0:1788838376.981943:0:26220:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad93 00000020:00000040:2.0:1788838376.981945:0:26220:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604961800 refcount=52 00000100:00100000:2.0:1788838376.981980:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6080 00000100:00000040:2.0:1788838376.981985:0:26220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 2 00000100:00000040:2.0:1788838376.981996:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503c3d880 x1875729116540288/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982011:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540288:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788838376.982030:0:26220:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3d880 x1875729116540288/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788838376.982050:0:26220:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 3 00010000:00080000:2.0:1788838376.982056:0:26220:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff503c3d880 x1875729116540288/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.982067:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3d880 x1875729116540288/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982076:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540288:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 67us (660us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.982083:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6080 00000100:00000040:2.0:1788838376.982086:0:26220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 2 00000100:00100000:2.0:1788838376.982098:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6081 00000100:00000040:2.0:1788838376.982100:0:26220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 3 00000100:00000040:2.0:1788838376.982104:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503c3dc00 x1875729116540416/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982115:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540416:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788838376.982122:0:26220:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3dc00 x1875729116540416/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788838376.982129:0:26220:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 4 00010000:00080000:2.0:1788838376.982133:0:26220:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff503c3dc00 x1875729116540416/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.982141:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3dc00 x1875729116540416/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982149:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540416:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 36us (651us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.982162:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6081 00000100:00000040:2.0:1788838376.982164:0:26220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 3 00000100:00100000:2.0:1788838376.982174:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6082 00000100:00000040:2.0:1788838376.982177:0:26220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 4 00000100:00000040:2.0:1788838376.982181:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503c3f800 x1875729116540544/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982191:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540544:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788838376.982198:0:26220:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3f800 x1875729116540544/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788838376.982205:0:26220:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 5 00010000:00080000:2.0:1788838376.982209:0:26220:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff503c3f800 x1875729116540544/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.982218:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3f800 x1875729116540544/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982226:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540544:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 36us (702us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.982232:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6082 00000100:00000040:2.0:1788838376.982234:0:26220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 4 00000100:00100000:2.0:1788838376.982241:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6083 00000100:00000040:2.0:1788838376.982244:0:26220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 5 00000100:00000040:2.0:1788838376.982247:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503c3d500 x1875729116540672/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982257:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540672:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788838376.982270:0:26220:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3d500 x1875729116540672/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788838376.982277:0:26220:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 6 00010000:00080000:2.0:1788838376.982280:0:26220:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff503c3d500 x1875729116540672/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.982290:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3d500 x1875729116540672/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982298:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540672:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 42us (752us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.982305:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6083 00000100:00000040:2.0:1788838376.982307:0:26220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 5 00000100:00100000:2.0:1788838376.982317:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6084 00000100:00000040:2.0:1788838376.982320:0:26220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 6 00000100:00000040:2.0:1788838376.982323:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503c3f480 x1875729116540800/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982334:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540800:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788838376.982340:0:26220:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3f480 x1875729116540800/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788838376.982347:0:26220:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 7 00010000:00080000:2.0:1788838376.982351:0:26220:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff503c3f480 x1875729116540800/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.982360:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3f480 x1875729116540800/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982379:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540800:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 47us (811us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.982385:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6084 00000100:00000040:2.0:1788838376.982388:0:26220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 6 00000100:00100000:2.0:1788838376.982396:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6085 00000100:00000040:2.0:1788838376.982399:0:26220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 7 00000100:00000040:2.0:1788838376.982403:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503c3fb80 x1875729116540928/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982413:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540928:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788838376.982420:0:26220:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3fb80 x1875729116540928/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788838376.982428:0:26220:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 8 00010000:00080000:2.0:1788838376.982432:0:26220:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff503c3fb80 x1875729116540928/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.982441:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3fb80 x1875729116540928/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982450:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116540928:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 38us (857us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.982457:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6085 00000100:00000040:2.0:1788838376.982459:0:26220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 7 00000100:00100000:2.0:1788838376.982466:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6086 00000100:00000040:2.0:1788838376.982468:0:26220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604961800 : new rpc_count 8 00000100:00000040:2.0:1788838376.982472:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff503c3ed80 x1875729116541056/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982501:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116541056:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788838376.982510:0:26220:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8ff503c3ed80 x1875729116541056/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788838376.982518:0:26220:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8ff604961800 : new rpc_count 9 00010000:00080000:2.0:1788838376.982522:0:26220:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff503c3ed80 x1875729116541056/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838376.982531:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3ed80 x1875729116541056/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838376.982541:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:efc561ba-875e-4857-b79b-9bd7023bd57c+52:2403:x1875729116541056:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 42us (912us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838376.982547:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6086 00000100:00000040:2.0:1788838376.982550:0:26220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604961800 : new rpc_count 8 00010000:00000040:3.0:1788838376.984662:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 7 00000020:00000040:3.0:1788838376.984693:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 51 00010000:00080000:3.0:1788838376.984699:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838376.984723:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838376.984763:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff503c3d880 x1875729116540288/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838376.984778:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1788838376.984780:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 6 00000020:00000040:3.0:1788838376.984787:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 50 00010000:00080000:3.0:1788838376.984789:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838376.984790:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838376.984812:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff503c3dc00 x1875729116540416/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838376.984819:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1788838376.984822:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 5 00000020:00000040:3.0:1788838376.984829:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 49 00010000:00080000:3.0:1788838376.984831:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838376.984833:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838376.984838:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff503c3f800 x1875729116540544/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838376.984845:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1788838376.984847:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 4 00000020:00000040:3.0:1788838376.984852:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 48 00010000:00080000:3.0:1788838376.984854:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838376.984855:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838376.984861:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff503c3d500 x1875729116540672/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838376.984868:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1788838376.984870:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 3 00000020:00000040:3.0:1788838376.984875:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 47 00010000:00080000:3.0:1788838376.984877:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838376.984879:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838376.984884:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff503c3f480 x1875729116540800/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838376.984908:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1788838376.984910:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 2 00000020:00000040:3.0:1788838376.984917:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 46 00010000:00080000:3.0:1788838376.984919:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838376.984920:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838376.984925:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff503c3fb80 x1875729116540928/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838376.984932:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1788838376.984934:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 1 00000020:00000040:3.0:1788838376.984941:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 45 00010000:00080000:3.0:1788838376.984943:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838376.984945:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838376.984949:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff503c3ed80 x1875729116541056/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:277/0 lens 328/0 e 0 to 0 dl 1788838387 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838376.984957:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1788838376.984959:0:96981:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8ff604961800 : new rpc_count 0 00000020:00000040:3.0:1788838376.984964:0:96981:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 44 00010000:00080000:3.0:1788838376.984966:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 40000000:00000040:2.0:1788838377.523065:0:97080:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00010000:00010000:1.0:1788838377.661884:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1788838378.365748:0:75685:0:(genops.c:1210:class_import_get()) import ffff8ff6061da800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1788838378.365823:0:75685:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001ee9e54d] to pc [ptlrpcd_00_00+0] req@ffff8ff61d2aea00 x1875729135226368/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838378.365866:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff61d2aea00 x1875729135226368/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838378.365881:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff61d2aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135226368:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788838378.365919:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff61d2aea00 x1875729135226368/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838378.365928:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838378.365980:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61d2ac700 x1875729135226368 msgsize 224 00000100:00100000:0.0:1788838378.365985:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838378.366024:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff61d2aea00 x1875729135226368/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838378.366056:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1483428 usecs (1484 jiffies) 00000100:00100000:0.0:1788838378.366104:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135226368 00000100:00100000:0.0:1788838378.366114:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135226368 00000020:00000040:0.0:1788838378.366118:0:37907:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e20 00000020:00000040:0.0:1788838378.366123:0:37907:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d6800 refcount=7 00000100:00000040:0.0:1788838378.366152:0:37907:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1788838378.366186:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4301 00000100:00000040:0.0:1788838378.366191:0:37907:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d6800 : new rpc_count 1 00000100:00000040:0.0:1788838378.366198:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61d2ac700 x1875729135226368/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:279/0 lens 224/0 e 0 to 0 dl 1788838389 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838378.366211:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135226368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788838378.366265:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00010000:00000040:0.0:1788838378.366281:0:37907:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875729135226368 00000100:00000040:0.0:1788838378.366291:0:37907:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838378.366297:0:37907:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838378.366315:0:37907:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff61d2aea00 x1875729135226368/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838378.366347:0:37907:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838378.366352:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61d2ac700 x1875729135226368/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:279/0 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838378.366361:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135226368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838378.366368:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4301 00000100:00000040:0.0:1788838378.366380:0:37907:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d6800 : new rpc_count 0 00000100:00000040:3.0:1788838378.366504:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:3.0:1788838378.366512:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff61d2aea00 x1875729135226368/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1788838378.366526:0:3643:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352795 avail=317092 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023577 state=0: rc = 0 00000100:00000040:3.0:1788838378.366534:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61d2aea00 x1875729135226368/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838378.366541:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff61d2aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135226368:0@lo:41:osp-pre-0-1.0 00000100:00000040:3.0:1788838378.366548:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff61d2aea00 x1875729135226368/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838378.366566:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff6061da800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:0.0:1788838378.366710:0:37907:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d6800 : new refcount 6 00000020:00000040:2.0:1788838378.366846:0:94404:0:(genops.c:1210:class_import_get()) import ffff8ff6271d7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788838378.366864:0:94404:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000096a9937b] to pc [ptlrpcd_00_01+1] req@ffff8ff503c3ce00 x1875729135226496/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838378.366936:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff503c3ce00 x1875729135226496/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838378.366959:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135226496:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1788838378.366978:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff503c3ce00 x1875729135226496/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838378.366986:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838378.367126:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61d2ad880 x1875729135226496 msgsize 224 00000100:00100000:0.0:1788838378.367132:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838378.367192:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff503c3ce00 x1875729135226496/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838378.367204:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5312 usecs (6 jiffies) 00000100:00100000:2.0:1788838378.373326:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135226496 00000100:00100000:2.0:1788838378.373349:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135226496 00000020:00000040:2.0:1788838378.373353:0:8471:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e66 00000020:00000040:2.0:1788838378.373362:0:8471:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff624a94800 refcount=5 00000100:00000040:2.0:1788838378.373465:0:8471:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788838378.373585:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4302 00000100:00000040:2.0:1788838378.373591:0:8471:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff624a94800 : new rpc_count 1 00000100:00000040:2.0:1788838378.373602:0:8471:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61d2ad880 x1875729135226496/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:279/0 lens 224/0 e 0 to 0 dl 1788838389 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838378.373631:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135226496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788838378.373688:0:8471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00010000:00000040:2.0:1788838378.373705:0:8471:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135226496 00000100:00000040:2.0:1788838378.373720:0:8471:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838378.373727:0:8471:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838378.373795:0:8471:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff503c3ce00 x1875729135226496/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838378.373860:0:8471:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838378.373867:0:8471:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61d2ad880 x1875729135226496/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:279/0 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838378.373875:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135226496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 248us (6747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838378.373882:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4302 00000100:00000040:2.0:1788838378.373886:0:8471:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff624a94800 : new rpc_count 0 00000020:00000040:2.0:1788838378.373897:0:8471:0:(genops.c:879:class_export_put()) PUTting export ffff8ff624a94800 : new refcount 4 00000100:00000040:1.0:1788838378.373995:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788838378.374004:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff503c3ce00 x1875729135226496/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788838378.374019:0:3644:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352889 avail=317186 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023681 state=0: rc = 0 00000100:00000040:1.0:1788838378.374028:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3ce00 x1875729135226496/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838378.374036:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135226496:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788838378.374045:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff503c3ce00 x1875729135226496/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788838378.374057:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff6271d7800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:1.0:1788838378.535157:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-osd (ffff8ff6395619b8) now 12 - health_check_show 00000020:00000040:1.0:1788838378.535180:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-osd (ffff8ff6395619b8) now 12 - health_check_show 00000020:00000040:1.0:1788838378.535185:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-osd (ffff8ff632e68000) now 10 - health_check_show 00000020:00000040:1.0:1788838378.535189:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001-osd (ffff8ff632e68000) now 10 - health_check_show 00000020:00000040:1.0:1788838378.535192:0:97128:0:(obd_config.c:995:class_incref()) incref MGC192.168.203.130@tcp (ffff8ff610244d28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535196:0:97128:0:(obd_config.c:1023:class_decref()) Decref MGC192.168.203.130@tcp (ffff8ff610244d28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535199:0:97128:0:(obd_config.c:995:class_incref()) incref MGS (ffff8ff61d0e3370) now 8 - health_check_show 00000020:00000040:1.0:1788838378.535209:0:97128:0:(obd_config.c:1023:class_decref()) Decref MGS (ffff8ff61d0e3370) now 8 - health_check_show 00000020:00000040:1.0:1788838378.535212:0:97128:0:(obd_config.c:995:class_incref()) incref MDS (ffff8ff639563370) now 4 - health_check_show 00000020:00000040:1.0:1788838378.535226:0:97128:0:(obd_config.c:1023:class_decref()) Decref MDS (ffff8ff639563370) now 4 - health_check_show 00000020:00000040:1.0:1788838378.535229:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-mdtlov (ffff8ff5021999b8) now 5 - health_check_show 00000020:00000040:1.0:1788838378.535233:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001-mdtlov (ffff8ff5021999b8) now 5 - health_check_show 00000020:00000040:1.0:1788838378.535235:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 12 - health_check_show 00000020:00000040:1.0:1788838378.535264:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 12 - health_check_show 00000020:00000040:1.0:1788838378.535267:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDD0001 (ffff8ff611adcd28) now 5 - health_check_show 00000020:00000040:1.0:1788838378.535269:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDD0001 (ffff8ff611adcd28) now 5 - health_check_show 00000020:00000040:1.0:1788838378.535272:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff8ff632e6cd28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535275:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff8ff632e6cd28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535277:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff8ff61d0e19b8) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535279:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff8ff61d0e19b8) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535282:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff8ff5035e0000) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535284:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff8ff5035e0000) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535286:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff8ff6271c99b8) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535289:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff8ff6271c99b8) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535291:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-mdtlov (ffff8ff639560000) now 5 - health_check_show 00000020:00000040:1.0:1788838378.535294:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-mdtlov (ffff8ff639560000) now 5 - health_check_show 00000020:00000040:1.0:1788838378.535296:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 16 - health_check_show 00000020:00000040:1.0:1788838378.535298:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 16 - health_check_show 00000020:00000040:1.0:1788838378.535301:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDD0000 (ffff8ff608220000) now 5 - health_check_show 00000020:00000040:1.0:1788838378.535303:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDD0000 (ffff8ff608220000) now 5 - health_check_show 00000020:00000040:1.0:1788838378.535305:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-QMT0000 (ffff8ff61d0e0000) now 5 - health_check_show 00000020:00000040:1.0:1788838378.535308:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-QMT0000 (ffff8ff61d0e0000) now 5 - health_check_show 00000020:00000040:1.0:1788838378.535311:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osd (ffff8ff608224d28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535316:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000-osd (ffff8ff608224d28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535318:0:97128:0:(obd_config.c:995:class_incref()) incref OSS (ffff8ff610243370) now 4 - health_check_show 00000020:00000040:1.0:1788838378.535326:0:97128:0:(obd_config.c:1023:class_decref()) Decref OSS (ffff8ff610243370) now 4 - health_check_show 00000020:00000040:1.0:1788838378.535329:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8ff503ca0000) now 10 - health_check_show 00000020:00000040:1.0:1788838378.535442:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8ff503ca0000) now 10 - health_check_show 00000020:00000040:1.0:1788838378.535446:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8ff624ff0000) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535448:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff8ff624ff0000) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535450:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8ff624ff4d28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535458:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff8ff624ff4d28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535461:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff8ff61d0e4d28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535463:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff8ff61d0e4d28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535481:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff8ff6271ccd28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535483:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff8ff6271ccd28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535486:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-OST0001-osd (ffff8ff50219b370) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535490:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001-osd (ffff8ff50219b370) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535493:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - health_check_show 00000020:00000040:1.0:1788838378.535521:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - health_check_show 00000020:00000040:1.0:1788838378.535525:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff8ff639564d28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535527:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff8ff639564d28) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535529:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff8ff5027219b8) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535532:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff8ff5027219b8) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535534:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff8ff6271cb370) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535536:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff8ff6271cb370) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535539:0:97128:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff8ff6082219b8) now 6 - health_check_show 00000020:00000040:1.0:1788838378.535542:0:97128:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff8ff6082219b8) now 6 - health_check_show 00000100:00000040:3.0:1788838378.559668:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61211c050 x1875729116541184 msgsize 224 00000100:00100000:3.0:1788838378.559691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:3.0:1788838378.559694:0:3638:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838378.559739:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6270bfb80 x1875729116541440 msgsize 224 00000100:00100000:3.0:1788838378.559744:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:3.0:1788838378.559774:0:3638:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6270bf800 x1875729116541312 msgsize 224 00000100:00100000:3.0:1788838378.559780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838378.561338:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116541440 00000100:00100000:2.0:1788838378.561357:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116541440 00000020:00000040:2.0:1788838378.561361:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc941e 00000020:00000040:2.0:1788838378.561368:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604960800 refcount=11 00000020:00000040:2.0:1788838378.561393:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 12 - evictor 00000100:00000040:2.0:1788838378.561439:0:66255:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788838378.561504:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116541312 00000100:00100000:2.0:1788838378.561509:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116541312 00000020:00000040:2.0:1788838378.561510:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e27 00000020:00000040:2.0:1788838378.561514:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609269000 refcount=51 00000020:00000040:2.0:1788838378.561523:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 16 - evictor 00000100:00100000:2.0:1788838378.561551:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1504 00000100:00000040:2.0:1788838378.561556:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604960800 : new rpc_count 1 00000100:00000040:2.0:1788838378.561583:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6270bfb80 x1875729116541440/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:279/0 lens 224/0 e 0 to 0 dl 1788838389 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838378.561603:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2404:x1875729116541440:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:2.0:1788838378.561640:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 77309411471, transno 0, xid 1875729116541440 00000100:00000040:2.0:1788838378.561655:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838378.561661:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838378.561737:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838378.561743:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270bfb80 x1875729116541440/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:279/0 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838378.561752:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2404:x1875729116541440:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 155us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838378.561758:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1504 00000100:00000040:2.0:1788838378.561762:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604960800 : new rpc_count 0 00000020:00000040:2.0:1788838378.561776:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604960800 : new refcount 10 00000100:00100000:2.0:1788838378.561786:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1505 00000100:00000040:2.0:1788838378.561789:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609269000 : new rpc_count 1 00000100:00000040:2.0:1788838378.561792:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6270bf800 x1875729116541312/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:279/0 lens 224/0 e 0 to 0 dl 1788838389 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838378.562213:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1788838378.562220:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 16 - evictor 00000100:00080000:3.0:1788838378.562235:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1788838378.562237:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 12 - evictor 00000100:00100000:2.0:1788838378.562267:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2404:x1875729116541312:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:2.0:1788838378.562287:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 124554051733, transno 0, xid 1875729116541312 00000100:00000040:2.0:1788838378.562293:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838378.562298:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:2.0:1788838378.562318:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00000100:00000040:2.0:1788838378.562324:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270bf800 x1875729116541312/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:279/0 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838378.562349:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2404:x1875729116541312:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 91us (2571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838378.562357:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1505 00000100:00000040:2.0:1788838378.562360:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609269000 : new rpc_count 0 00000020:00000040:2.0:1788838378.562369:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609269000 : new refcount 50 00000100:00100000:0.0:1788838378.562792:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116541184 00000100:00100000:0.0:1788838378.562816:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116541184 00000020:00000040:0.0:1788838378.562819:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9da2 00000020:00000040:0.0:1788838378.562825:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff61d4bf800 refcount=10 00000100:00000040:0.0:1788838378.562861:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788838378.562901:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00000040:0.0:1788838378.562905:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff61d4bf800 : new rpc_count 1 00000100:00000040:0.0:1788838378.562911:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61211c050 x1875729116541184/t0(0) o400->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:279/0 lens 224/0 e 0 to 0 dl 1788838389 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838378.562925:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116541184:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:0.0:1788838378.562938:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116541184 00000100:00000040:0.0:1788838378.562943:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838378.562947:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838378.563087:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838378.563094:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61211c050 x1875729116541184/t0(0) o400->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:279/0 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838378.563104:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2404:x1875729116541184:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 181us (3439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838378.563121:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00000040:0.0:1788838378.563124:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff61d4bf800 : new rpc_count 0 00000020:00000040:0.0:1788838378.563135:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff61d4bf800 : new refcount 9 00000100:00000040:3.0:1788838378.576444:0:3637:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6270bd880 x1875729116541568 msgsize 224 00000100:00100000:3.0:1788838378.576474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838378.576557:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116541568 00000100:00100000:1.0:1788838378.576570:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116541568 00000020:00000040:1.0:1788838378.576574:0:26218:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccca1bc 00000020:00000040:1.0:1788838378.576580:0:26218:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff50443a000 refcount=7 00000020:00000040:1.0:1788838378.576598:0:26218:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00100000:1.0:1788838378.576668:0:26218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2768 00000100:00000040:1.0:1788838378.576673:0:26218:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff50443a000 : new rpc_count 1 00000100:00000040:1.0:1788838378.576685:0:26218:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6270bd880 x1875729116541568/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:279/0 lens 224/0 e 0 to 0 dl 1788838389 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838378.576702:0:26218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116541568:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:1.0:1788838378.576746:0:26218:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116541568 00000100:00000040:1.0:1788838378.576760:0:26218:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838378.576767:0:26218:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838378.576863:0:26218:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838378.576870:0:26218:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270bd880 x1875729116541568/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:279/0 lens 224/224 e 0 to 0 dl 1788838389 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838378.576879:0:26218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2404:x1875729116541568:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 181us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838378.576887:0:26218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2768 00000100:00000040:1.0:1788838378.576890:0:26218:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff50443a000 : new rpc_count 0 00000020:00000040:1.0:1788838378.576904:0:26218:0:(genops.c:879:class_export_put()) PUTting export ffff8ff50443a000 : new refcount 6 00000100:00080000:3.0:1788838378.577346:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1788838378.577352:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00010000:00010000:3.0:1788838378.685062:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1788838378.877287:0:94408:0:(genops.c:1210:class_import_get()) import ffff8ff619428000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788838378.877354:0:94408:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005d070c08] to pc [ptlrpcd_00_02+2] req@ffff8ff503c3c000 x1875729135226624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838378.877482:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff503c3c000 x1875729135226624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838378.877502:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135226624:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788838378.877552:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff503c3c000 x1875729135226624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838394 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838378.877561:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838378.877614:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61d2ae680 x1875729135226624 msgsize 224 00000100:00100000:0.0:1788838378.877618:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838378.877654:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff503c3c000 x1875729135226624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838394 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838378.877680:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8935 usecs (9 jiffies) 00000100:00100000:1.0:1788838378.877756:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135226624 00000100:00100000:1.0:1788838378.877768:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135226624 00000020:00000040:1.0:1788838378.877772:0:12691:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e90 00000020:00000040:1.0:1788838378.877777:0:12691:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff632f51800 refcount=5 00000020:00000040:1.0:1788838378.877831:0:12691:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:1.0:1788838378.877882:0:12691:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1788838378.877924:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00000040:1.0:1788838378.877929:0:12691:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff632f51800 : new rpc_count 1 00000100:00000040:1.0:1788838378.877935:0:12691:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61d2ae680 x1875729135226624/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:279/0 lens 224/0 e 0 to 0 dl 1788838389 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838378.877949:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135226624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838378.877988:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1788838378.878001:0:12691:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875729135226624 00000100:00000040:1.0:1788838378.878012:0:12691:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:1.0:1788838378.878018:0:12691:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788838378.878041:0:12691:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff503c3c000 x1875729135226624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788838378.878518:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1788838378.878525:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:1.0:1788838378.878951:0:12691:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:1.0:1788838378.878962:0:12691:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61d2ae680 x1875729135226624/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:279/0 lens 224/368 e 0 to 0 dl 1788838389 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838378.878972:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135226624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1027us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838378.878982:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00000040:1.0:1788838378.878986:0:12691:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff632f51800 : new rpc_count 0 00000020:00000040:1.0:1788838378.879003:0:12691:0:(genops.c:879:class_export_put()) PUTting export ffff8ff632f51800 : new refcount 4 00000100:00000040:0.0:1788838378.879077:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:0.0:1788838378.879085:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff503c3c000 x1875729135226624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788838378.879098:0:3645:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1788838378.879101:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1788838378.879111:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3c000 x1875729135226624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838378.879120:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135226624:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788838378.879127:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff503c3c000 x1875729135226624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838394 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838378.879138:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff619428000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:0.0:1788838379.709046:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1788838379.902162:0:75689:0:(genops.c:1210:class_import_get()) import ffff8ff61942c000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1788838379.902219:0:75689:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c0fe9a75] to pc [ptlrpcd_00_03+3] req@ffff8ff6270be680 x1875729135226752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838379.902291:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1788838379.902324:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6270be680 x1875729135226752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838379.902340:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135226752:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1788838379.902380:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6270be680 x1875729135226752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838395 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838379.902389:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838379.902446:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61d2adf80 x1875729135226752 msgsize 224 00000100:00100000:0.0:1788838379.902452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838379.902495:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6270be680 x1875729135226752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838395 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838379.902513:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5686 usecs (6 jiffies) 00000100:00100000:3.0:1788838379.902584:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135226752 00000100:00100000:3.0:1788838379.902595:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135226752 00000020:00000040:3.0:1788838379.902599:0:8464:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c82 00000020:00000040:3.0:1788838379.902604:0:8464:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a649800 refcount=5 00000020:00000040:3.0:1788838379.902621:0:8464:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:3.0:1788838379.902660:0:8464:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1788838379.902695:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00000040:3.0:1788838379.902708:0:8464:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff63a649800 : new rpc_count 1 00000100:00000040:3.0:1788838379.902715:0:8464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61d2adf80 x1875729135226752/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:280/0 lens 224/0 e 0 to 0 dl 1788838390 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838379.902729:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135226752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838379.902759:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1788838379.902772:0:8464:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1875729135226752 00000100:00000040:3.0:1788838379.902783:0:8464:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:3.0:1788838379.902789:0:8464:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838379.902838:0:8464:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8ff6270be680 x1875729135226752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838395 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838379.902858:0:8464:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:3.0:1788838379.902864:0:8464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61d2adf80 x1875729135226752/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:280/0 lens 224/368 e 0 to 0 dl 1788838390 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838379.902873:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135226752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838379.902881:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00000040:3.0:1788838379.902884:0:8464:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a649800 : new rpc_count 0 00000020:00000040:3.0:1788838379.902899:0:8464:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a649800 : new refcount 4 00000100:00080000:0.0:1788838379.902974:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788838379.902979:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:0.0:1788838379.903027:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:0.0:1788838379.903035:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6270be680 x1875729135226752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788838379.903047:0:3645:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1788838379.903051:0:3645:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1788838379.903059:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270be680 x1875729135226752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838395 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838379.903067:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135226752:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1788838379.903074:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6270be680 x1875729135226752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788838395 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838379.903085:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff61942c000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788838380.413554:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.413583:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000100:00000040:2.0:1788838380.413619:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS req@ffff8ff503c3e300 x1875729135226880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.413639:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bdaa15ca] to pc [ptlrpcd_00_00+0] req@ffff8ff503c3e300 x1875729135226880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.413677:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.413684:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff501ab3000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788838380.413691:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8ff503c3e680 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.413700:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c9a762ba] to pc [ptlrpcd_00_01+1] req@ffff8ff503c3e680 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.413707:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.413712:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff5031c5000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788838380.413718:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8ff503c3ea00 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.413741:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e42d0a06] to pc [ptlrpcd_00_02+2] req@ffff8ff503c3ea00 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.413760:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.413766:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff6061da800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788838380.413776:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8ff503c3c380 x1875729135227264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.413785:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002f079c72] to pc [ptlrpcd_00_03+3] req@ffff8ff503c3c380 x1875729135227264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838380.413793:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838380.413826:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1788838380.413830:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.413836:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff61942c000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788838380.413844:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff503c3f100 x1875729135227392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.413854:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000725def89] to pc [ptlrpcd_00_00+0] req@ffff8ff503c3f100 x1875729135227392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.413862:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.413867:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff632feb800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788838380.413874:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8ff503c3c700 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.413883:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b1dc3cbf] to pc [ptlrpcd_00_01+1] req@ffff8ff503c3c700 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.413902:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.413908:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff6271d7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788838380.413918:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff8ff503c3c000 x1875729135227648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.413927:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005d070c08] to pc [ptlrpcd_00_02+2] req@ffff8ff503c3c000 x1875729135227648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838380.414069:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838380.414072:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1788838380.414075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.414082:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff619428000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788838380.414093:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff503c3ce00 x1875729135227776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.414103:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000096a9937b] to pc [ptlrpcd_00_03+3] req@ffff8ff503c3ce00 x1875729135227776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.414111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.414120:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff6104d8000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788838380.414129:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8ff6407a9180 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.414137:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d4f13e88] to pc [ptlrpcd_00_00+0] req@ffff8ff6407a9180 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.414145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.414150:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff627d5d800 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1788838380.414164:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff8ff6407aa300 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.414174:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bf42735a] to pc [ptlrpcd_00_01+1] req@ffff8ff6407aa300 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.414182:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838380.414187:0:36:0:(genops.c:1210:class_import_get()) import ffff8ff50d494800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1788838380.414193:0:36:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff8ff6407ab100 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838380.414202:0:36:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009e7f59b6] to pc [ptlrpcd_00_02+2] req@ffff8ff6407ab100 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.414213:0:36:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 1 (3779) 00000100:00000040:3.0:1788838380.414576:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff503c3e300 x1875729135226880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838380.414594:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135226880:0@lo:400:kworker.0 00000100:00000040:3.0:1788838380.414632:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff503c3e300 x1875729135226880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838380.414642:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838380.414708:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61211d850 x1875729135226880 msgsize 224 00000100:00100000:3.0:1788838380.414714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838380.414724:0:3643:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838380.414751:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff503c3e300 x1875729135226880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838380.414787:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff503c3f100 x1875729135227392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838380.414795:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135227392:0@lo:400:kworker.0 00000100:00000040:3.0:1788838380.414834:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff503c3f100 x1875729135227392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838380.414840:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838380.414857:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6270bdf80 x1875729135227392 msgsize 224 00000100:00100000:3.0:1788838380.414861:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838380.414879:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff503c3f100 x1875729135227392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838380.414889:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5673 usecs (6 jiffies) 00000100:00000040:3.0:1788838380.414896:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407a9180 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838380.414906:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135227904:0@lo:400:kworker.0 00000100:00000040:3.0:1788838380.414919:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407a9180 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838380.414927:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.415091:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff503c3ea00 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.415103:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135227136:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.415121:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff503c3ea00 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.415128:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.415183:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff503c3c380 x1875729135227264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.415193:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135227264:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.415209:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff503c3c380 x1875729135227264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.415215:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.415232:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61d2ac000 x1875729135227264 msgsize 224 00000100:00100000:0.0:1788838380.415237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838380.415252:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff503c3c380 x1875729135227264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.415263:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1479598 usecs (1480 jiffies) 00000100:00000040:0.0:1788838380.415269:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff503c3ce00 x1875729135227776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.415277:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135227776:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.415290:0:3646:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff503c3ce00 x1875729135227776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.415297:0:3646:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.415309:0:3646:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61d2aea00 x1875729135227776 msgsize 224 00000100:00100000:0.0:1788838380.415313:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838380.415340:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff503c3ce00 x1875729135227776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.415378:0:3646:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8735 usecs (9 jiffies) 00000100:00000040:0.0:1788838380.415415:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff503c3e680 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.415425:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135227008:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.415441:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff503c3e680 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.415449:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1788838380.415488:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135227264 00000100:00100000:0.0:1788838380.415497:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135227264 00000020:00000040:0.0:1788838380.415501:0:37907:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e20 00000020:00000040:0.0:1788838380.415507:0:37907:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d6800 refcount=7 00000100:00000040:0.0:1788838380.415533:0:37907:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1788838380.415565:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4303 00000100:00000040:0.0:1788838380.415570:0:37907:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d6800 : new rpc_count 1 00000100:00000040:0.0:1788838380.415576:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61d2ac000 x1875729135227264/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.415589:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135227264:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838380.415619:0:37907:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875729135227264 00000100:00000040:0.0:1788838380.415630:0:37907:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838380.415636:0:37907:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.415656:0:37907:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff503c3c380 x1875729135227264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.415676:0:37907:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838380.415680:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61d2ac000 x1875729135227264/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.415688:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135227264:12345-0@lo:400:kworker.0 Request processed in 102us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838380.415703:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4303 00000100:00000040:0.0:1788838380.415707:0:37907:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d6800 : new rpc_count 0 00000020:00000040:0.0:1788838380.415720:0:37907:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d6800 : new refcount 6 00000100:00100000:0.0:1788838380.415739:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135227392 00000100:00100000:0.0:1788838380.415743:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135227392 00000020:00000040:0.0:1788838380.415746:0:26209:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c82 00000020:00000040:0.0:1788838380.415749:0:26209:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a649800 refcount=5 00000100:00100000:0.0:1788838380.415776:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135227776 00000100:00100000:0.0:1788838380.415779:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135227776 00000020:00000040:0.0:1788838380.415781:0:26209:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e90 00000020:00000040:0.0:1788838380.415783:0:26209:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff632f51800 refcount=5 00000020:00000040:0.0:1788838380.415793:0:26209:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00100000:0.0:1788838380.415849:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00000040:0.0:1788838380.415851:0:26209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff63a649800 : new rpc_count 1 00000100:00000040:0.0:1788838380.415856:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6270bdf80 x1875729135227392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.415867:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135227392:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838380.415879:0:26209:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1875729135227392 00000100:00000040:0.0:1788838380.415884:0:26209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838380.415888:0:26209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.415907:0:26209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff503c3f100 x1875729135227392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.415922:0:26209:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838380.415926:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270bdf80 x1875729135227392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.415934:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135227392:12345-0@lo:400:kworker.0 Request processed in 69us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838380.415940:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000100:00000040:0.0:1788838380.415949:0:26209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a649800 : new rpc_count 0 00000100:00000040:3.0:1788838380.420509:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6270be300 x1875729135227904 msgsize 224 00000100:00100000:3.0:1788838380.420528:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788838380.420601:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407a9180 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838380.420625:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 5882 usecs (6 jiffies) 00000100:00000040:3.0:1788838380.420688:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1788838380.420696:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff503c3f100 x1875729135227392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838380.420722:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3f100 x1875729135227392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838380.420730:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135227392:0@lo:400:kworker.0 00000100:00000040:3.0:1788838380.420737:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff503c3f100 x1875729135227392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788838380.420750:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff61942c000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00100000:3.0:1788838380.420819:0:94392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135226880 00000100:00100000:3.0:1788838380.420829:0:94392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135226880 00000020:00000040:3.0:1788838380.420832:0:94392:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:3.0:1788838380.420837:0:94392:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=24 00000100:00000040:3.0:1788838380.420868:0:94392:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788838380.420901:0:94392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00000040:3.0:1788838380.420906:0:94392:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:3.0:1788838380.420912:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61211d850 x1875729135226880/t0(0) o400->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838380.420927:0:94392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135226880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838380.421163:0:26220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00000040:2.0:1788838380.421168:0:26220:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff632f51800 : new rpc_count 1 00000100:00000040:2.0:1788838380.421175:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61d2aea00 x1875729135227776/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.421190:0:26220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61d2aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135227776:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838380.421209:0:26220:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875729135227776 00000100:00000040:2.0:1788838380.421219:0:26220:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838380.421225:0:26220:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838380.421278:0:26220:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff503c3ce00 x1875729135227776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.421301:0:26220:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838380.421306:0:26220:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61d2aea00 x1875729135227776/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.421315:0:26220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61d2aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135227776:12345-0@lo:400:kworker.0 Request processed in 130us (6003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838380.421343:0:26220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00000040:2.0:1788838380.421347:0:26220:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff632f51800 : new rpc_count 0 00000020:00000040:2.0:1788838380.421362:0:26220:0:(genops.c:879:class_export_put()) PUTting export ffff8ff632f51800 : new refcount 4 00000020:00000040:0.0:1788838380.421482:0:26209:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a649800 : new refcount 4 00000100:00100000:0.0:1788838380.421506:0:75504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135227904 00000100:00100000:0.0:1788838380.421512:0:75504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135227904 00000020:00000040:0.0:1788838380.421514:0:75504:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fb6 00000020:00000040:0.0:1788838380.421517:0:75504:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609257000 refcount=5 00000100:00000040:0.0:1788838380.421534:0:75504:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1788838380.421562:0:75504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00000040:0.0:1788838380.421565:0:75504:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609257000 : new rpc_count 1 00000100:00000040:0.0:1788838380.421570:0:75504:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6270be300 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.421582:0:75504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135227904:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838380.421595:0:75504:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135227904 00000100:00000040:0.0:1788838380.421600:0:75504:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838380.421604:0:75504:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.421626:0:75504:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407a9180 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.421649:0:75504:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838380.421653:0:75504:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270be300 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.421661:0:75504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135227904:12345-0@lo:400:kworker.0 Request processed in 81us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838380.421667:0:75504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00000040:0.0:1788838380.421670:0:75504:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609257000 : new rpc_count 0 00000020:00000040:0.0:1788838380.421676:0:75504:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609257000 : new refcount 4 00000100:00080000:0.0:1788838380.421704:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788838380.421710:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:0.0:1788838380.421912:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bcd1500 x1875729135227008 msgsize 224 00000100:00100000:0.0:1788838380.421918:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838380.421949:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff503c3e680 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.426938:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8037 usecs (9 jiffies) 00000100:00000040:0.0:1788838380.426974:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff503c3c700 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.426995:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135227520:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.427034:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff503c3c700 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.427043:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.427093:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bcd1880 x1875729135227520 msgsize 224 00000100:00100000:0.0:1788838380.427098:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838380.427124:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff503c3c700 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.427134:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 134371 usecs (135 jiffies) 00000100:00000040:0.0:1788838380.427141:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407aa300 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.427150:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135228032:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.427172:0:3644:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407aa300 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.427178:0:3644:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.427192:0:3644:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bcd0a80 x1875729135228032 msgsize 224 00000100:00100000:0.0:1788838380.427196:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838380.427205:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407aa300 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.427214:0:3644:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 3995 usecs (4 jiffies) 00000100:00100000:0.0:1788838380.427256:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135227008 00000100:00100000:0.0:1788838380.427266:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135227008 00000020:00000040:0.0:1788838380.427281:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fa8 00000020:00000040:0.0:1788838380.427286:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639656800 refcount=5 00000020:00000040:0.0:1788838380.427303:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 16 - evictor 00000100:00000040:0.0:1788838380.427330:0:66255:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1788838380.427359:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135227520 00000100:00100000:0.0:1788838380.427362:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135227520 00000020:00000040:0.0:1788838380.427364:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9faf 00000020:00000040:0.0:1788838380.427367:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609254800 refcount=5 00000100:00100000:0.0:1788838380.427402:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135228032 00000100:00100000:0.0:1788838380.427405:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135228032 00000020:00000040:0.0:1788838380.427407:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadc4 00000020:00000040:0.0:1788838380.427409:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff509c64000 refcount=5 00000100:00100000:0.0:1788838380.427432:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00000040:0.0:1788838380.427437:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639656800 : new rpc_count 1 00000100:00000040:0.0:1788838380.427444:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bcd1500 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.427468:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135227008:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838380.427498:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135227008 00000100:00000040:0.0:1788838380.427510:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838380.427517:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.427539:0:66255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff503c3e680 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.427558:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838380.427564:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bcd1500 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.427573:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135227008:12345-0@lo:400:kworker.0 Request processed in 108us (5659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838380.427581:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00000040:0.0:1788838380.427585:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639656800 : new rpc_count 0 00000020:00000040:0.0:1788838380.427607:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639656800 : new refcount 4 00000100:00100000:0.0:1788838380.427618:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00000040:0.0:1788838380.427620:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609254800 : new rpc_count 1 00000100:00000040:0.0:1788838380.427625:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bcd1880 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.427635:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135227520:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838380.427647:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135227520 00000100:00000040:0.0:1788838380.427651:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838380.427654:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.427673:0:66255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff503c3c700 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.427686:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838380.427690:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bcd1880 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.427699:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135227520:12345-0@lo:400:kworker.0 Request processed in 65us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838380.427705:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00000040:0.0:1788838380.427708:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609254800 : new rpc_count 0 00000020:00000040:0.0:1788838380.427714:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609254800 : new refcount 4 00000100:00100000:0.0:1788838380.427722:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00000040:0.0:1788838380.427724:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff509c64000 : new rpc_count 1 00000100:00000040:0.0:1788838380.427727:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bcd0a80 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.427738:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135228032:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838380.427746:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135228032 00000100:00000040:0.0:1788838380.427751:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838380.427760:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.427775:0:66255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407aa300 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.427787:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838380.427791:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bcd0a80 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.427819:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135228032:12345-0@lo:400:kworker.0 Request processed in 82us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838380.427825:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00000040:0.0:1788838380.427827:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff509c64000 : new rpc_count 0 00000020:00000040:0.0:1788838380.427834:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c64000 : new refcount 4 00000100:00080000:0.0:1788838380.427849:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1788838380.427853:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 16 - evictor 00000100:00000040:0.0:1788838380.427892:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1788838380.427899:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff503c3e680 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.427909:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3e680 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.427917:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135227008:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.427930:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1788838380.427934:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff503c3c700 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.427941:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3c700 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.427947:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135227520:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.427957:0:3644:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:0.0:1788838380.427967:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407aa300 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.427975:0:3644:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407aa300 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.427982:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135228032:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.427989:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff503c3e680 x1875729135227008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838380.428000:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff501ab3000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1788838380.428011:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff503c3c700 x1875729135227520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838380.428018:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff632feb800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1788838380.428023:0:3644:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407aa300 x1875729135228032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838380.428029:0:3644:0:(genops.c:1223:class_import_put()) import ffff8ff627d5d800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1788838380.428048:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff60876c450 x1875729135227136 msgsize 224 00000100:00100000:0.0:1788838380.428053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838380.428055:0:3645:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788838380.428071:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff503c3ea00 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.428084:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7411 usecs (8 jiffies) 00000100:00000040:0.0:1788838380.428092:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff503c3c000 x1875729135227648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.428102:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135227648:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.428122:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff503c3c000 x1875729135227648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.428128:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.428153:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff62bcd0380 x1875729135227648 msgsize 224 00000100:00100000:0.0:1788838380.428157:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838380.428175:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff503c3c000 x1875729135227648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.428184:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 5423 usecs (6 jiffies) 00000100:00000040:0.0:1788838380.428191:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407ab100 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.428199:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135228160:0@lo:400:kworker.0 00000100:00000040:0.0:1788838380.428219:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407ab100 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.428226:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.428482:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff502709880 x1875729135228160 msgsize 224 00000100:00100000:0.0:1788838380.428497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788838380.428538:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407ab100 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.428556:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 4365 usecs (5 jiffies) 00000100:00100000:0.0:1788838380.428604:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135227136 00000100:00100000:0.0:1788838380.428613:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135227136 00000020:00000040:0.0:1788838380.428616:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3d07 00000020:00000040:0.0:1788838380.428622:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d2000 refcount=5 00000020:00000040:0.0:1788838380.428640:0:66255:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 12 - evictor 00000100:00000040:0.0:1788838380.428662:0:66255:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1788838380.428685:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135228160 00000100:00100000:0.0:1788838380.432362:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135228160 00000020:00000040:0.0:1788838380.432373:0:66255:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadd9 00000020:00000040:0.0:1788838380.432379:0:66255:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff509c76000 refcount=5 00000100:00100000:0.0:1788838380.432450:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00000040:0.0:1788838380.432466:0:66255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d2000 : new rpc_count 1 00000100:00000040:0.0:1788838380.432474:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff60876c450 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.432505:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff60876c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135227136:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838380.432530:0:66255:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135227136 00000100:00000040:0.0:1788838380.432540:0:66255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838380.432546:0:66255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838380.432597:0:66255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff503c3ea00 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838380.432639:0:66255:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838380.432645:0:66255:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff60876c450 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838380.432654:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff60876c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135227136:12345-0@lo:400:kworker.0 Request processed in 151us (4604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838380.432661:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00000040:0.0:1788838380.432665:0:66255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d2000 : new rpc_count 0 00000020:00000040:0.0:1788838380.432676:0:66255:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d2000 : new refcount 4 00010000:00000040:3.0:1788838380.434831:0:94392:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135226880 00000100:00000040:3.0:1788838380.434863:0:94392:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:3.0:1788838380.434874:0:94392:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788838380.434948:0:94392:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff503c3e300 x1875729135226880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788838380.434988:0:94392:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:3.0:1788838380.434996:0:94392:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61211d850 x1875729135226880/t0(0) o400->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838380.435008:0:94392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135226880:12345-0@lo:400:kworker.0 Request processed in 14084us (20298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838380.435299:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00000040:2.0:1788838380.435306:0:67312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff509c76000 : new rpc_count 1 00000100:00000040:2.0:1788838380.435312:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff502709880 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.435579:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135228160:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838380.435605:0:67312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135228160 00000100:00000040:2.0:1788838380.435611:0:67312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838380.435615:0:67312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838380.435642:0:67312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407ab100 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.435665:0:67312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838380.435669:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff502709880 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.435678:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135228160:12345-0@lo:400:kworker.0 Request processed in 112us (7197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838380.435686:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00000040:2.0:1788838380.435691:0:67312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff509c76000 : new rpc_count 0 00000020:00000040:2.0:1788838380.435711:0:67312:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c76000 : new refcount 4 00000100:00100000:3.0:1788838380.435842:0:94392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00000040:3.0:1788838380.435845:0:94392:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:3.0:1788838380.435858:0:94392:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00100000:2.0:1788838380.437305:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135227648 00000100:00100000:2.0:1788838380.437337:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135227648 00000020:00000040:2.0:1788838380.437341:0:23765:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e66 00000020:00000040:2.0:1788838380.437348:0:23765:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff624a94800 refcount=5 00000100:00000040:2.0:1788838380.437390:0:23765:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788838380.437423:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4304 00000100:00000040:2.0:1788838380.437436:0:23765:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff624a94800 : new rpc_count 1 00000100:00000040:2.0:1788838380.437445:0:23765:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff62bcd0380 x1875729135227648/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:281/0 lens 224/0 e 0 to 0 dl 1788838391 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.437472:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff62bcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135227648:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838380.437506:0:23765:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135227648 00000100:00000040:2.0:1788838380.437518:0:23765:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838380.437525:0:23765:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838380.437575:0:23765:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff503c3c000 x1875729135227648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.437601:0:23765:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838380.437605:0:23765:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff62bcd0380 x1875729135227648/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:281/0 lens 224/224 e 0 to 0 dl 1788838391 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.437613:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff62bcd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135227648:12345-0@lo:400:kworker.0 Request processed in 145us (9458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838380.437619:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4304 00000100:00000040:2.0:1788838380.437622:0:23765:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff624a94800 : new rpc_count 0 00000020:00000040:2.0:1788838380.437633:0:23765:0:(genops.c:879:class_export_put()) PUTting export ffff8ff624a94800 : new refcount 4 00000100:00000040:2.0:1788838380.437685:0:3646:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1788838380.437694:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff503c3c380 x1875729135227264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.437706:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3c380 x1875729135227264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.437713:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135227264:0@lo:400:kworker.0 00000100:00000040:2.0:1788838380.437732:0:3646:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:2.0:1788838380.437737:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff503c3ce00 x1875729135227776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.437757:0:3646:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3ce00 x1875729135227776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.437764:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135227776:0@lo:400:kworker.0 00000100:00000040:2.0:1788838380.437776:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff503c3c380 x1875729135227264/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838380.437787:0:3646:0:(genops.c:1223:class_import_put()) import ffff8ff6061da800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788838380.437831:0:3646:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff503c3ce00 x1875729135227776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838380.437837:0:3646:0:(genops.c:1223:class_import_put()) import ffff8ff619428000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788838380.437878:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff503c3e300 x1875729135226880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.437887:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3e300 x1875729135226880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.437894:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135226880:0@lo:400:kworker.0 00000100:00000040:2.0:1788838380.437910:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838380.437915:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407a9180 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.437923:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a9180 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.437930:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135227904:0@lo:400:kworker.0 00000100:00000040:2.0:1788838380.437936:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff503c3e300 x1875729135226880/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838380.437944:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00000100:00000040:2.0:1788838380.437971:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407a9180 x1875729135227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838380.437977:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff6104d8000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00080000:1.0:1788838380.445553:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1788838380.445566:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 12 - evictor 00000100:00000040:2.0:1788838380.445619:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838380.445634:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff503c3ea00 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.445649:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3ea00 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.445657:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135227136:0@lo:400:kworker.0 00000100:00000040:2.0:1788838380.445673:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838380.445678:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff503c3c000 x1875729135227648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.445686:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff503c3c000 x1875729135227648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.445693:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135227648:0@lo:400:kworker.0 00000100:00000040:2.0:1788838380.445709:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838380.445715:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407ab100 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838380.445723:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407ab100 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838380.445730:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135228160:0@lo:400:kworker.0 00000100:00000040:2.0:1788838380.445739:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff503c3ea00 x1875729135227136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838380.445753:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff5031c5000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788838380.445784:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff503c3c000 x1875729135227648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838380.445794:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff6271d7800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788838380.445843:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407ab100 x1875729135228160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838396 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838380.445856:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff50d494800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00010000:00010000:0.0:1788838380.740208:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788838380.944218:0:96965:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969517 is committed 00000001:00000040:0.0:1788838380.944240:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 39 00000020:00000040:0.0:1788838380.944245:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 43 00000001:00000040:0.0:1788838380.944256:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 38 00000020:00000040:0.0:1788838380.944258:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 42 00000001:00000040:0.0:1788838380.944263:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 37 00000020:00000040:0.0:1788838380.944265:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 41 00000001:00000040:0.0:1788838380.944269:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 36 00000020:00000040:0.0:1788838380.944271:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 40 00000001:00000040:0.0:1788838380.944276:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 35 00000020:00000040:0.0:1788838380.944278:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 39 00000001:00000040:0.0:1788838380.944282:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 34 00000020:00000040:0.0:1788838380.944296:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 38 00000001:00000040:0.0:1788838380.944434:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 33 00000020:00000040:0.0:1788838380.944437:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 37 00000001:00000040:0.0:1788838380.944440:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 32 00000020:00000040:0.0:1788838380.944441:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 36 00000001:00000040:0.0:1788838380.944447:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 31 00000020:00000040:0.0:1788838380.944457:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 35 00000001:00000040:0.0:1788838380.944462:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 30 00000020:00000040:0.0:1788838380.944464:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 34 00000001:00000040:0.0:1788838380.944473:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 29 00000020:00000040:0.0:1788838380.944475:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 33 00000001:00000040:0.0:1788838380.944479:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 28 00000020:00000040:0.0:1788838380.944481:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 32 00000001:00000040:0.0:1788838380.944484:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 27 00000020:00000040:0.0:1788838380.944485:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 31 00000001:00000040:0.0:1788838380.944489:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 26 00000020:00000040:0.0:1788838380.944491:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 30 00000001:00000040:0.0:1788838380.944494:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 25 00000020:00000040:0.0:1788838380.944496:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 29 00000001:00000040:0.0:1788838380.944500:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 24 00000020:00000040:0.0:1788838380.944503:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 28 00000001:00000040:0.0:1788838380.944505:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 23 00000020:00000040:0.0:1788838380.944507:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 27 00000001:00000040:0.0:1788838380.944511:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 22 00000020:00000040:0.0:1788838380.944513:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 26 00000001:00000040:0.0:1788838380.944516:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 21 00000020:00000040:0.0:1788838380.944518:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 25 00000001:00000040:0.0:1788838380.944521:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 20 00000020:00000040:0.0:1788838380.944522:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 24 00000001:00000040:0.0:1788838380.944528:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 19 00000020:00000040:0.0:1788838380.944536:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 23 00000001:00000040:0.0:1788838380.944540:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 18 00000020:00000040:0.0:1788838380.944542:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 22 00000001:00000040:0.0:1788838380.944546:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 17 00000020:00000040:0.0:1788838380.944548:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 21 00000001:00000040:0.0:1788838380.944550:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 16 00000020:00000040:0.0:1788838380.944552:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 20 00000001:00000040:0.0:1788838380.944556:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 15 00000020:00000040:0.0:1788838380.944558:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 19 00000001:00000040:0.0:1788838380.944561:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 14 00000020:00000040:0.0:1788838380.944563:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 18 00000001:00000040:0.0:1788838380.944565:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 13 00000020:00000040:0.0:1788838380.944567:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 17 00000001:00000040:0.0:1788838380.944572:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 12 00000020:00000040:0.0:1788838380.944574:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 16 00000001:00000040:0.0:1788838380.944578:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 11 00000020:00000040:0.0:1788838380.944580:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 15 00000001:00000040:0.0:1788838380.944583:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 10 00000020:00000040:0.0:1788838380.944585:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 14 00000001:00000040:0.0:1788838380.944588:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 9 00000020:00000040:0.0:1788838380.944589:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 13 00000001:00000040:0.0:1788838380.944594:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 8 00000020:00000040:0.0:1788838380.944596:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 12 00000001:00000040:0.0:1788838380.944599:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 7 00000020:00000040:0.0:1788838380.944601:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 11 00000001:00000040:0.0:1788838380.944604:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 6 00000020:00000040:0.0:1788838380.944605:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 10 00000001:00000040:0.0:1788838380.944608:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 5 00000020:00000040:0.0:1788838380.944610:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 9 00000001:00000040:0.0:1788838380.944614:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 4 00000020:00000040:0.0:1788838380.944621:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 8 00000001:00000040:0.0:1788838380.944627:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 3 00000020:00000040:0.0:1788838380.944629:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 7 00000001:00000040:0.0:1788838380.944632:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 2 00000020:00000040:0.0:1788838380.944633:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 6 00000001:00000040:0.0:1788838380.944637:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 1 00000020:00000040:0.0:1788838380.944638:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 5 00000001:00000040:0.0:1788838380.944641:0:96965:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8ff604961800 : new cb_count 0 00000020:00000040:0.0:1788838380.944642:0:96965:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604961800 : new refcount 4 00000100:00000040:2.0:1788838381.438897:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.438915:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff605445000 refcount=4 obd=MGC192.168.203.130@tcp 00000100:00000040:2.0:1788838381.438941:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 57943c9a-ca27-46d8-8845-5d2bce640e45->MGS req@ffff8ff6407ab100 x1875729135228288/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.438957:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009e7f59b6] to pc [ptlrpcd_00_03+3] req@ffff8ff6407ab100 x1875729135228288/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.438975:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.438981:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff501ab3000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788838381.438988:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8ff6407a9180 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.438998:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d4f13e88] to pc [ptlrpcd_00_00+0] req@ffff8ff6407a9180 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439013:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.439018:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff5031c5000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788838381.439025:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8ff6407ab800 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.439033:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004646a068] to pc [ptlrpcd_00_01+1] req@ffff8ff6407ab800 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439041:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.439059:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff6061da800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788838381.439068:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8ff6407a8700 x1875729135228672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.439078:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003f62c506] to pc [ptlrpcd_00_02+2] req@ffff8ff6407a8700 x1875729135228672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838381.439086:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838381.439090:0:27607:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1788838381.439093:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.439097:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff61942c000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788838381.439104:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff6407ab480 x1875729135228800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.439113:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a70830aa] to pc [ptlrpcd_00_03+3] req@ffff8ff6407ab480 x1875729135228800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439120:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.439124:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff632feb800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788838381.439131:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8ff6407abb80 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.439138:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b438ff3c] to pc [ptlrpcd_00_00+0] req@ffff8ff6407abb80 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439146:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.439150:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff6271d7800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788838381.439159:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff8ff6407a8a80 x1875729135229056/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.439179:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000068158de1] to pc [ptlrpcd_00_01+1] req@ffff8ff6407a8a80 x1875729135229056/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788838381.439187:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838381.439189:0:27607:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1788838381.439192:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.439197:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff619428000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788838381.439205:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8ff6407aaa00 x1875729135229184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.439213:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002c3457e2] to pc [ptlrpcd_00_02+2] req@ffff8ff6407aaa00 x1875729135229184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439220:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.439225:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff6104d8000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788838381.439231:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8ff6407aa680 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.439240:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000012c4536a] to pc [ptlrpcd_00_03+3] req@ffff8ff6407aa680 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439246:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.439251:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff627d5d800 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1788838381.439257:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff8ff6407a8e00 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.439265:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006a6e31a5] to pc [ptlrpcd_00_00+0] req@ffff8ff6407a8e00 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439284:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788838381.439288:0:27607:0:(genops.c:1210:class_import_get()) import ffff8ff50d494800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1788838381.439297:0:27607:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff8ff6407aad80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788838381.439306:0:27607:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bbadfa11] to pc [ptlrpcd_00_01+1] req@ffff8ff6407aad80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439316:0:27607:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (3780) 00000100:00000040:2.0:1788838381.439334:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407a8700 x1875729135228672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.439346:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135228672:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.439391:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407a8700 x1875729135228672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439399:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.439440:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6407a9f80 x1875729135228672 msgsize 224 00000100:00100000:2.0:1788838381.439456:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.439482:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407a8700 x1875729135228672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439499:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1475861 usecs (1476 jiffies) 00000100:00000040:2.0:1788838381.439507:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407aaa00 x1875729135229184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.439516:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135229184:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.439528:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407aaa00 x1875729135229184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439535:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.439550:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6407a9500 x1875729135229184 msgsize 224 00000100:00100000:2.0:1788838381.439560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.439576:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407aaa00 x1875729135229184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439587:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9328 usecs (10 jiffies) 00000100:00100000:2.0:1788838381.439601:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00000040:2.0:1788838381.439607:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407ab100 x1875729135228288/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.439615:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135228288:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.439628:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407ab100 x1875729135228288/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439634:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.439651:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff61211e450 x1875729135228288 msgsize 224 00000100:00100000:2.0:1788838381.439655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.439656:0:3645:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788838381.439667:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407ab100 x1875729135228288/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439688:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407ab480 x1875729135228800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.439695:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135228800:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.439706:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407ab480 x1875729135228800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439712:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.439723:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6407a8000 x1875729135228800 msgsize 224 00000100:00100000:2.0:1788838381.439727:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.439740:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407ab480 x1875729135228800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439749:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5681 usecs (6 jiffies) 00000100:00000040:2.0:1788838381.439754:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407aa680 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.439768:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135229312:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.439781:0:3645:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407aa680 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439788:0:3645:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.439824:0:3645:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6407a9c00 x1875729135229312 msgsize 224 00000100:00100000:2.0:1788838381.439829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.439844:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407aa680 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439853:0:3645:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 7283 usecs (8 jiffies) 00000100:00000040:2.0:1788838381.439870:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407a9180 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.439878:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135228416:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.439890:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407a9180 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439897:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.439907:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6407a9880 x1875729135228416 msgsize 224 00000100:00100000:2.0:1788838381.439910:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.439922:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407a9180 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439931:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8051 usecs (9 jiffies) 00000100:00000040:2.0:1788838381.439936:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407abb80 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.439944:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135228928:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.439953:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407abb80 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.439970:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.439981:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6407a8380 x1875729135228928 msgsize 224 00000100:00100000:2.0:1788838381.439984:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.439996:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407abb80 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440005:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 133812 usecs (134 jiffies) 00000100:00000040:2.0:1788838381.440011:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407a8e00 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440019:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135229440:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.440030:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407a8e00 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440036:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.440045:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6407aa300 x1875729135229440 msgsize 224 00000100:00100000:2.0:1788838381.440049:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.440059:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407a8e00 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440068:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 10605 usecs (11 jiffies) 00000100:00100000:2.0:1788838381.440077:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00000040:2.0:1788838381.440081:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407ab800 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440089:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135228544:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.440099:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407ab800 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440105:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.440117:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff50f38f480 x1875729135228544 msgsize 224 00000100:00100000:2.0:1788838381.440121:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.440134:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407ab800 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440149:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7460 usecs (8 jiffies) 00000100:00000040:2.0:1788838381.440155:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407a8a80 x1875729135229056/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440163:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135229056:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.440175:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407a8a80 x1875729135229056/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440182:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.440193:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff50f38d880 x1875729135229056 msgsize 224 00000100:00100000:2.0:1788838381.440197:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.440207:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407a8a80 x1875729135229056/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440215:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 6456 usecs (7 jiffies) 00000100:00000040:2.0:1788838381.440220:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8ff6407aad80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440228:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6407aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135229568:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.440238:0:3643:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8ff6407aad80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440244:0:3643:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.440254:0:3643:0:(events.c:337:request_in_callback()) incoming req@ffff8ff50f38fb80 x1875729135229568 msgsize 224 00000100:00100000:2.0:1788838381.440258:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788838381.440267:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8ff6407aad80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440274:0:3643:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 21865 usecs (22 jiffies) 00000100:00100000:2.0:1788838381.440293:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135228672 00000100:00100000:2.0:1788838381.440300:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135228672 00000020:00000040:2.0:1788838381.440302:0:37907:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e20 00000020:00000040:2.0:1788838381.440312:0:37907:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d6800 refcount=7 00000100:00000040:2.0:1788838381.440333:0:37907:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788838381.440352:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135229056 00000100:00100000:2.0:1788838381.440355:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135229056 00000020:00000040:2.0:1788838381.440356:0:37907:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e66 00000020:00000040:2.0:1788838381.440359:0:37907:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff624a94800 refcount=5 00000100:00100000:2.0:1788838381.440376:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4305 00000100:00000040:2.0:1788838381.440380:0:37907:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d6800 : new rpc_count 1 00000100:00000040:2.0:1788838381.440385:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6407a9f80 x1875729135228672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440395:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135228672:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838381.440418:0:37907:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875729135228672 00000100:00000040:2.0:1788838381.440427:0:37907:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838381.440432:0:37907:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.440465:0:37907:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407a8700 x1875729135228672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440485:0:37907:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838381.440490:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a9f80 x1875729135228672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440498:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135228672:12345-0@lo:400:kworker.0 Request processed in 104us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838381.440505:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4305 00000100:00000040:2.0:1788838381.440508:0:37907:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d6800 : new rpc_count 0 00000020:00000040:2.0:1788838381.440517:0:37907:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d6800 : new refcount 6 00000100:00100000:2.0:1788838381.440526:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4306 00000100:00000040:2.0:1788838381.440529:0:37907:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff624a94800 : new rpc_count 1 00000100:00000040:2.0:1788838381.440533:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff50f38d880 x1875729135229056/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440556:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135229056:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838381.440567:0:37907:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135229056 00000100:00000040:2.0:1788838381.440572:0:37907:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838381.440575:0:37907:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.440591:0:37907:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407a8a80 x1875729135229056/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440607:0:37907:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838381.440612:0:37907:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff50f38d880 x1875729135229056/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440620:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135229056:12345-0@lo:400:kworker.0 Request processed in 68us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838381.440625:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4306 00000100:00000040:2.0:1788838381.440627:0:37907:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff624a94800 : new rpc_count 0 00000020:00000040:2.0:1788838381.440633:0:37907:0:(genops.c:879:class_export_put()) PUTting export ffff8ff624a94800 : new refcount 4 00000100:00100000:2.0:1788838381.440649:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135229184 00000100:00100000:2.0:1788838381.440652:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135229184 00000020:00000040:2.0:1788838381.440655:0:26215:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e90 00000020:00000040:2.0:1788838381.440658:0:26215:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff632f51800 refcount=5 00000100:00100000:2.0:1788838381.440681:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135228800 00000100:00100000:2.0:1788838381.440683:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135228800 00000020:00000040:2.0:1788838381.440685:0:26215:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3c82 00000020:00000040:2.0:1788838381.440687:0:26215:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a649800 refcount=5 00000020:00000040:2.0:1788838381.440696:0:26215:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00100000:2.0:1788838381.440716:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00000040:2.0:1788838381.440719:0:26215:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff632f51800 : new rpc_count 1 00000100:00000040:2.0:1788838381.440723:0:26215:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6407a9500 x1875729135229184/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440746:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135229184:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838381.440756:0:26215:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1875729135229184 00000100:00000040:2.0:1788838381.440760:0:26215:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838381.440763:0:26215:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.440780:0:26215:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407aaa00 x1875729135229184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440793:0:26215:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838381.440818:0:26215:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a9500 x1875729135229184/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440826:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135229184:12345-0@lo:400:kworker.0 Request processed in 83us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838381.440832:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00000040:2.0:1788838381.440834:0:26215:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff632f51800 : new rpc_count 0 00000020:00000040:2.0:1788838381.440840:0:26215:0:(genops.c:879:class_export_put()) PUTting export ffff8ff632f51800 : new refcount 4 00000100:00100000:2.0:1788838381.440849:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772 00000100:00000040:2.0:1788838381.440852:0:26215:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff63a649800 : new rpc_count 1 00000100:00000040:2.0:1788838381.440855:0:26215:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6407a8000 x1875729135228800/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440866:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135228800:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838381.440876:0:26215:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1875729135228800 00000100:00000040:2.0:1788838381.440881:0:26215:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838381.440884:0:26215:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.440899:0:26215:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407ab480 x1875729135228800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.440913:0:26215:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838381.440924:0:26215:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a8000 x1875729135228800/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.440933:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135228800:12345-0@lo:400:kworker.0 Request processed in 68us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838381.440939:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772 00000100:00000040:2.0:1788838381.440941:0:26215:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff63a649800 : new rpc_count 0 00000020:00000040:2.0:1788838381.440947:0:26215:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a649800 : new refcount 4 00000100:00100000:2.0:1788838381.440968:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135229312 00000100:00100000:2.0:1788838381.440972:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135229312 00000020:00000040:2.0:1788838381.440974:0:66254:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fb6 00000020:00000040:2.0:1788838381.440977:0:66254:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609257000 refcount=5 00000100:00000040:2.0:1788838381.440988:0:66254:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788838381.440998:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135228416 00000100:00100000:2.0:1788838381.441001:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135228416 00000020:00000040:2.0:1788838381.441002:0:66254:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9fa8 00000020:00000040:2.0:1788838381.441004:0:66254:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639656800 refcount=5 00000100:00100000:2.0:1788838381.441015:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135228928 00000100:00100000:2.0:1788838381.441017:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135228928 00000020:00000040:2.0:1788838381.441019:0:66254:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9faf 00000020:00000040:2.0:1788838381.441021:0:66254:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609254800 refcount=5 00000100:00100000:2.0:1788838381.441034:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135229440 00000100:00100000:2.0:1788838381.441036:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135229440 00000020:00000040:2.0:1788838381.441038:0:66254:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadc4 00000020:00000040:2.0:1788838381.441040:0:66254:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff509c64000 refcount=5 00000100:00100000:2.0:1788838381.441051:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135228544 00000100:00100000:2.0:1788838381.441053:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135228544 00000020:00000040:2.0:1788838381.441055:0:66254:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc3d07 00000020:00000040:2.0:1788838381.441057:0:66254:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff5052d2000 refcount=5 00000100:00100000:2.0:1788838381.441067:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135229568 00000100:00100000:2.0:1788838381.441069:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135229568 00000020:00000040:2.0:1788838381.441071:0:66254:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccadd9 00000020:00000040:2.0:1788838381.441073:0:66254:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff509c76000 refcount=5 00000100:00100000:2.0:1788838381.441095:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00000040:2.0:1788838381.441098:0:66254:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609257000 : new rpc_count 1 00000100:00000040:2.0:1788838381.441102:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6407a9c00 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441111:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135229312:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838381.441121:0:66254:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135229312 00000100:00000040:2.0:1788838381.441125:0:66254:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838381.441128:0:66254:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.441146:0:66254:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407aa680 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441160:0:66254:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838381.441164:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a9c00 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441172:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135229312:12345-0@lo:400:kworker.0 Request processed in 62us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838381.441178:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00000040:2.0:1788838381.441180:0:66254:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609257000 : new rpc_count 0 00000020:00000040:2.0:1788838381.441187:0:66254:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609257000 : new refcount 4 00000100:00100000:2.0:1788838381.441196:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00000040:2.0:1788838381.441199:0:66254:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639656800 : new rpc_count 1 00000100:00000040:2.0:1788838381.441203:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6407a9880 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441213:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135228416:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838381.441222:0:66254:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135228416 00000100:00000040:2.0:1788838381.441226:0:66254:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838381.441229:0:66254:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.441249:0:66254:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407a9180 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441263:0:66254:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838381.441267:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a9880 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441275:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875729135228416:12345-0@lo:400:kworker.0 Request processed in 64us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838381.441281:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00000040:2.0:1788838381.441284:0:66254:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639656800 : new rpc_count 0 00000020:00000040:2.0:1788838381.441289:0:66254:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639656800 : new refcount 4 00000100:00100000:2.0:1788838381.441298:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00000040:2.0:1788838381.441301:0:66254:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609254800 : new rpc_count 1 00000100:00000040:2.0:1788838381.441304:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6407a8380 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441314:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135228928:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838381.441321:0:66254:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135228928 00000100:00000040:2.0:1788838381.441325:0:66254:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838381.441328:0:66254:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.441340:0:66254:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407abb80 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441351:0:66254:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838381.441354:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a8380 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441362:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875729135228928:12345-0@lo:400:kworker.0 Request processed in 50us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838381.441368:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00000040:2.0:1788838381.441370:0:66254:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609254800 : new rpc_count 0 00000020:00000040:2.0:1788838381.441381:0:66254:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609254800 : new refcount 4 00000100:00100000:2.0:1788838381.441407:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00000040:2.0:1788838381.441410:0:66254:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff509c64000 : new rpc_count 1 00000100:00000040:2.0:1788838381.441413:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6407aa300 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441424:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6407aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135229440:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838381.441432:0:66254:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135229440 00000100:00000040:2.0:1788838381.441436:0:66254:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838381.441438:0:66254:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.441467:0:66254:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407a8e00 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441480:0:66254:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838381.441484:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407aa300 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441491:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6407aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875729135229440:12345-0@lo:400:kworker.0 Request processed in 70us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838381.441496:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00000040:2.0:1788838381.441498:0:66254:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff509c64000 : new rpc_count 0 00000020:00000040:2.0:1788838381.441503:0:66254:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c64000 : new refcount 4 00000100:00100000:2.0:1788838381.441511:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00000040:2.0:1788838381.441513:0:66254:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff5052d2000 : new rpc_count 1 00000100:00000040:2.0:1788838381.441517:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff50f38f480 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441528:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135228544:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838381.441536:0:66254:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135228544 00000100:00000040:2.0:1788838381.441540:0:66254:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838381.441550:0:66254:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.441567:0:66254:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407ab800 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441579:0:66254:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838381.441584:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff50f38f480 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441591:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875729135228544:12345-0@lo:400:kworker.0 Request processed in 66us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838381.441597:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00000040:2.0:1788838381.441599:0:66254:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff5052d2000 : new rpc_count 0 00000020:00000040:2.0:1788838381.441605:0:66254:0:(genops.c:879:class_export_put()) PUTting export ffff8ff5052d2000 : new refcount 4 00000100:00100000:2.0:1788838381.441613:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00000040:2.0:1788838381.441616:0:66254:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff509c76000 : new rpc_count 1 00000100:00000040:2.0:1788838381.441619:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff50f38fb80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441630:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135229568:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788838381.441640:0:66254:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135229568 00000100:00000040:2.0:1788838381.441644:0:66254:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:2.0:1788838381.441647:0:66254:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788838381.441661:0:66254:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407aad80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441673:0:66254:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:2.0:1788838381.441677:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff50f38fb80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441685:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875729135229568:12345-0@lo:400:kworker.0 Request processed in 57us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838381.441690:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00000040:2.0:1788838381.441697:0:66254:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff509c76000 : new rpc_count 0 00000020:00000040:2.0:1788838381.441703:0:66254:0:(genops.c:879:class_export_put()) PUTting export ffff8ff509c76000 : new refcount 4 00000100:00080000:2.0:1788838381.441747:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1788838381.441751:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00000040:2.0:1788838381.441792:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838381.441821:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407ab800 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441830:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407ab800 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441837:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875729135228544:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.441850:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838381.441854:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407a8a80 x1875729135229056/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441860:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a8a80 x1875729135229056/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441865:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135229056:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.441873:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838381.441876:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407aad80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441882:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407aad80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441887:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875729135229568:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.441895:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838381.441899:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407a9180 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441918:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a9180 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441924:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875729135228416:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.441937:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1788838381.441940:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407abb80 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441947:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407abb80 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441952:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875729135228928:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.441959:0:3643:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838381.441962:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407a8e00 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.441969:0:3643:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a8e00 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.441975:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875729135229440:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.441981:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407ab800 x1875729135228544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838381.441990:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff5031c5000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788838381.441999:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407a8a80 x1875729135229056/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838381.442005:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff6271d7800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788838381.442011:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407aad80 x1875729135229568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838381.442030:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff50d494800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1788838381.442037:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407a9180 x1875729135228416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838381.442044:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff501ab3000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788838381.442048:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407abb80 x1875729135228928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838381.442055:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff632feb800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788838381.442060:0:3643:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407a8e00 x1875729135229440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838381.442066:0:3643:0:(genops.c:1223:class_import_put()) import ffff8ff627d5d800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1788838381.442097:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969455 00000100:00000040:2.0:1788838381.442102:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407ab480 x1875729135228800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.442110:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407ab480 x1875729135228800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.442117:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135228800:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.442126:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788838381.442130:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407aa680 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.442136:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407aa680 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.442141:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135229312:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.442150:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:2.0:1788838381.442153:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407a8700 x1875729135228672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.442168:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407a8700 x1875729135228672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.442173:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135228672:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.442186:0:3645:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969458 00000100:00000040:2.0:1788838381.442190:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407aaa00 x1875729135229184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788838381.442197:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407aaa00 x1875729135229184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838381.442203:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135229184:0@lo:400:kworker.0 00000100:00000040:2.0:1788838381.442208:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407ab480 x1875729135228800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838381.442216:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff61942c000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788838381.442223:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407aa680 x1875729135229312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838381.442229:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff6104d8000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788838381.442234:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407a8700 x1875729135228672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838381.442239:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff6061da800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788838381.442243:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407aaa00 x1875729135229184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788838381.442249:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff619428000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00100000:0.0:1788838381.442497:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135228288 00000100:00100000:0.0:1788838381.442504:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135228288 00000020:00000040:0.0:1788838381.442506:0:94398:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9dc5 00000020:00000040:0.0:1788838381.442509:0:94398:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff639712000 refcount=24 00000100:00000040:0.0:1788838381.442526:0:94398:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788838381.442555:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00000040:0.0:1788838381.442558:0:94398:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff639712000 : new rpc_count 1 00000100:00000040:0.0:1788838381.442563:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff61211e450 x1875729135228288/t0(0) o400->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:282/0 lens 224/0 e 0 to 0 dl 1788838392 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838381.442573:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff61211e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135228288:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788838381.442584:0:94398:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729135228288 00000100:00000040:0.0:1788838381.442590:0:94398:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838381.442593:0:94398:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838381.442617:0:94398:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8ff6407ab100 x1875729135228288/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838381.442639:0:94398:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838381.442644:0:94398:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff61211e450 x1875729135228288/t0(0) o400->57943c9a-ca27-46d8-8845-5d2bce640e45@0@lo:282/0 lens 224/224 e 0 to 0 dl 1788838392 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838381.442653:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff61211e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135228288:12345-0@lo:400:kworker.0 Request processed in 81us (3000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838381.442669:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00000040:0.0:1788838381.442672:0:94398:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff639712000 : new rpc_count 0 00000020:00000040:0.0:1788838381.442681:0:94398:0:(genops.c:879:class_export_put()) PUTting export ffff8ff639712000 : new refcount 23 00000100:00000040:0.0:1788838381.442724:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8ff6407ab100 x1875729135228288/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788838381.442732:0:3645:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6407ab100 x1875729135228288/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838381.442739:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6407ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135228288:0@lo:400:kworker.0 00000100:00000040:0.0:1788838381.442744:0:3645:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8ff6407ab100 x1875729135228288/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788838397 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788838381.442750:0:3645:0:(genops.c:1223:class_import_put()) import ffff8ff605445000 refcount=3 obd=MGC192.168.203.130@tcp 00010000:00010000:1.0:1788838381.760026:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1788838382.594183:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff632f2cc50 x1875729116541696 msgsize 224 00000100:00100000:3.0:1788838382.594199:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:3.0:1788838382.594201:0:3636:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788838382.594247:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6270bd180 x1875729116541824 msgsize 224 00000100:00100000:3.0:1788838382.594253:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:3.0:1788838382.594279:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6270bea00 x1875729116542080 msgsize 224 00000100:00100000:3.0:1788838382.594284:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00000040:3.0:1788838382.594345:0:3636:0:(events.c:337:request_in_callback()) incoming req@ffff8ff6270bc380 x1875729116541952 msgsize 224 00000100:00100000:3.0:1788838382.594350:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838382.594380:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116541824 00000100:00100000:3.0:1788838382.594389:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116541824 00000020:00000040:3.0:1788838382.594392:0:66254:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9e27 00000020:00000040:3.0:1788838382.594396:0:66254:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff609269000 refcount=51 00000020:00000040:3.0:1788838382.594411:0:66254:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8ff608223370) now 16 - evictor 00000100:00000040:3.0:1788838382.594433:0:66254:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1788838382.594467:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116541952 00000100:00100000:3.0:1788838382.594470:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116541952 00000020:00000040:3.0:1788838382.594472:0:66254:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc941e 00000020:00000040:3.0:1788838382.594474:0:66254:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff604960800 refcount=11 00000020:00000040:3.0:1788838382.594481:0:66254:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8ff611ad99b8) now 12 - evictor 00000100:00100000:3.0:1788838382.594514:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1518 00000100:00000040:3.0:1788838382.594519:0:66254:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff609269000 : new rpc_count 1 00000100:00000040:3.0:1788838382.594526:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6270bd180 x1875729116541824/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:283/0 lens 224/0 e 0 to 0 dl 1788838393 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838382.594541:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2406:x1875729116541824:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838382.594716:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116541696 00000100:00100000:1.0:1788838382.594722:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116541696 00000020:00000040:1.0:1788838382.594723:0:94395:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccc9da2 00000020:00000040:1.0:1788838382.594726:0:94395:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff61d4bf800 refcount=10 00000100:00000040:1.0:1788838382.594742:0:94395:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788838382.594774:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00000040:1.0:1788838382.594777:0:94395:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff61d4bf800 : new rpc_count 1 00000100:00000040:1.0:1788838382.594783:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff632f2cc50 x1875729116541696/t0(0) o400->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:283/0 lens 224/0 e 0 to 0 dl 1788838393 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838382.594824:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116541696:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:1.0:1788838382.594846:0:94395:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116541696 00000100:00000040:1.0:1788838382.594856:0:94395:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838382.594861:0:94395:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838382.594901:0:94395:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838382.594912:0:94395:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff632f2cc50 x1875729116541696/t0(0) o400->2af93169-6705-472b-b7ff-fd7cc5c04782@192.168.203.30@tcp:283/0 lens 224/224 e 0 to 0 dl 1788838393 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838382.594937:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116541696:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 143us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838382.594945:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00000040:1.0:1788838382.594948:0:94395:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff61d4bf800 : new rpc_count 0 00000020:00000040:1.0:1788838382.594957:0:94395:0:(genops.c:879:class_export_put()) PUTting export ffff8ff61d4bf800 : new refcount 9 00000100:00100000:1.0:1788838382.595067:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1519 00000100:00000040:1.0:1788838382.595070:0:67312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff604960800 : new rpc_count 1 00000100:00000040:1.0:1788838382.595075:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6270bc380 x1875729116541952/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:283/0 lens 224/0 e 0 to 0 dl 1788838393 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838382.595087:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116541952:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:1.0:1788838382.595100:0:67312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 77309411471, transno 0, xid 1875729116541952 00000100:00000040:1.0:1788838382.595104:0:67312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838382.595108:0:67312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838382.595125:0:67312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838382.595130:0:67312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270bc380 x1875729116541952/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:283/0 lens 224/224 e 0 to 0 dl 1788838393 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838382.595139:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116541952:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 54us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838382.595145:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1519 00000100:00000040:1.0:1788838382.595147:0:67312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff604960800 : new rpc_count 0 00000020:00000040:1.0:1788838382.595155:0:67312:0:(genops.c:879:class_export_put()) PUTting export ffff8ff604960800 : new refcount 10 00000100:00080000:1.0:1788838382.595168:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1788838382.595171:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8ff611ad99b8) now 12 - evictor 00000100:00080000:1.0:1788838382.595174:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1788838382.595175:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8ff608223370) now 16 - evictor 00000100:00100000:1.0:1788838382.595194:0:20253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116542080 00000100:00100000:1.0:1788838382.595197:0:20253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116542080 00000020:00000040:1.0:1788838382.595198:0:20253:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396ccca1bc 00000020:00000040:1.0:1788838382.595201:0:20253:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff50443a000 refcount=7 00000020:00000040:1.0:1788838382.595207:0:20253:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00000100:00100000:1.0:1788838382.595235:0:20253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2773 00000100:00000040:1.0:1788838382.595237:0:20253:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8ff50443a000 : new rpc_count 1 00000100:00000040:1.0:1788838382.595241:0:20253:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8ff6270bea00 x1875729116542080/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:283/0 lens 224/0 e 0 to 0 dl 1788838393 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838382.595252:0:20253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2406:x1875729116542080:12345-192.168.203.30@tcp:400:kworker.0 00010000:00000040:1.0:1788838382.595262:0:20253:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875729116542080 00000100:00000040:1.0:1788838382.595266:0:20253:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838382.595269:0:20253:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:1.0:1788838382.595282:0:20253:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00000100:00000040:1.0:1788838382.595286:0:20253:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270bea00 x1875729116542080/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:283/0 lens 224/224 e 0 to 0 dl 1788838393 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788838382.595294:0:20253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2406:x1875729116542080:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 43us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838382.595300:0:20253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2773 00000100:00000040:1.0:1788838382.595302:0:20253:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff50443a000 : new rpc_count 0 00000020:00000040:1.0:1788838382.595307:0:20253:0:(genops.c:879:class_export_put()) PUTting export ffff8ff50443a000 : new refcount 6 00000100:00080000:1.0:1788838382.595350:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1788838382.595352:0:6542:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8ff502724d28) now 10 - evictor 00010000:00000040:0.0:1788838382.601768:0:66254:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 124554051733, transno 0, xid 1875729116541824 00000100:00000040:0.0:1788838382.601789:0:66254:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff633208380 refcount 11 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838382.601824:0:66254:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.30@tcp 00000100:00000040:0.0:1788838382.601883:0:66254:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff633208380 refcount 10 to 192.168.203.30@tcp 00000100:00000040:0.0:1788838382.601892:0:66254:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8ff6270bd180 x1875729116541824/t0(0) o400->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:283/0 lens 224/224 e 0 to 0 dl 1788838393 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788838382.601903:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2406:x1875729116541824:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 7364us (7653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838382.601913:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1518 00000100:00000040:0.0:1788838382.601926:0:66254:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8ff609269000 : new rpc_count 0 00000020:00000040:0.0:1788838382.601941:0:66254:0:(genops.c:879:class_export_put()) PUTting export ffff8ff609269000 : new refcount 50 00010000:00010000:3.0:1788838382.781143:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1788838382.979911:0:26213:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad8c 00000020:00000040:0.0:1788838382.979923:0:26213:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff63a64b800 refcount=6 00000100:00000040:0.0:1788838382.979928:0:26213:0:(service.c:1659:ptlrpc_at_send_early_reply()) RPC GETting export ffff8ff63a64b800 : new rpc_count 2 00000100:00000040:0.0:1788838382.979945:0:26213:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838382.979969:0:26213:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838382.980047:0:26213:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838382.980054:0:26213:0:(service.c:1685:ptlrpc_at_send_early_reply()) RPC PUTting export ffff8ff63a64b800 : new rpc_count 1 00000020:00000040:0.0:1788838382.980056:0:26213:0:(genops.c:879:class_export_put()) PUTting export ffff8ff63a64b800 : new refcount 5 00000100:00000040:0.0:1788838382.980064:0:26213:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +20s 00000020:00000040:0.0:1788838382.980070:0:26213:0:(genops.c:804:class_conn2export()) looking for export cookie 0x88da08396cccad85 00000020:00000040:0.0:1788838382.980073:0:26213:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8ff627f9d800 refcount=6 00000100:00000040:0.0:1788838382.980075:0:26213:0:(service.c:1659:ptlrpc_at_send_early_reply()) RPC GETting export ffff8ff627f9d800 : new rpc_count 2 00000100:00000040:0.0:1788838382.980079:0:26213:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8ff611edf540 refcount 66 to 0@lo 00000100:00000040:0.0:1788838382.980083:0:26213:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788838382.980100:0:26213:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8ff611edf540 refcount 65 to 0@lo 00000100:00000040:0.0:1788838382.980103:0:26213:0:(service.c:1685:ptlrpc_at_send_early_reply()) RPC PUTting export ffff8ff627f9d800 : new rpc_count 1 00000020:00000040:0.0:1788838382.980105:0:26213:0:(genops.c:879:class_export_put()) PUTting export ffff8ff627f9d800 : new refcount 5 00000001:02000400:1.0:1788838383.358021:0:97322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788838383.490617:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788838383.490634:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff501afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135229696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838383.490701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838383.491023:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788838383.491034:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff501afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135229824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838383.491067:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838383.491140:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135229696 00000100:00100000:1.0:1788838383.491149:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135229696 00000100:00100000:1.0:1788838383.491199:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135229824 00000100:00100000:1.0:1788838383.491202:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135229824 00000100:00100000:1.0:1788838383.491225:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4307 00000100:00100000:1.0:1788838383.491234:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135229696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838383.491269:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00000100:00100000:1.0:1788838383.491315:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135229696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838383.491321:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4307 00000100:00100000:1.0:1788838383.491337:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4308 00000100:00100000:1.0:1788838383.491344:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff6270bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135229824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838383.491359:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:1.0:1788838383.491389:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff6270bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135229824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838383.491394:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4308 00000100:00100000:3.0:1788838383.491478:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff501afed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135229824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838383.491513:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff501afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135229696:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788838383.807378:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838383.997202:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff502709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135229952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788838383.997281:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838383.997334:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135229952 00000100:00100000:3.0:1788838383.997343:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135229952 00000100:00080000:1.0:1788838383.997414:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838383.997415:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:3.0:1788838383.997426:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135229952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788838383.997469:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838383.997526:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875729135229952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838383.997533:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00100000:1.0:1788838383.997608:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff502709180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875729135229952:0@lo:13:osp-pre-1-0.0 00000020:00000004:3.0:1788838384.729114:0:97374:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788838384.729452:0:97374:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788838384.828910:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838385.022838:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788838385.022860:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135230080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788838385.022930:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838385.023022:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135230080 00000100:00100000:3.0:1788838385.023032:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135230080 00000100:00100000:3.0:1788838385.023098:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:3.0:1788838385.023107:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135230080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838385.023130:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838385.023171:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135230080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838385.023178:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00080000:1.0:1788838385.023336:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838385.023370:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135230080:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788838385.855831:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788838385.881112:0:97424:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788838385.881567:0:97424:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1788838386.557366:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838386.557373:0:27607:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1788838386.557389:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838386.557392:0:27607:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1788838386.557482:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135230208:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.557556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.557601:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135230720:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.557626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.557642:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135231232:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.557661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.557679:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788838386.557685:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135230336:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.557703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.557720:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135230848:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.557740:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.557755:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135231360:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.557775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.557818:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135230592:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.557859:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.557875:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135231104:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.557894:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.557909:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788838386.557914:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135230464:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.557934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.557948:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff6270be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135230976:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.557967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.557982:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135231488:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558001:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838386.558042:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135231232 00000100:00100000:0.0:1788838386.558050:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135231232 00000100:00100000:0.0:1788838386.558089:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135230336 00000100:00100000:0.0:1788838386.558093:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135230336 00000100:00100000:0.0:1788838386.558113:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135230848 00000100:00100000:0.0:1788838386.558116:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135230848 00000100:00100000:0.0:1788838386.558126:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135231360 00000100:00100000:0.0:1788838386.558128:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135231360 00000100:00100000:0.0:1788838386.558140:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135230464 00000100:00100000:0.0:1788838386.558142:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135230464 00000100:00100000:0.0:1788838386.558154:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135231488 00000100:00100000:0.0:1788838386.558156:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135231488 00000100:00100000:0.0:1788838386.558172:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1788838386.558180:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135231232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558232:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875729135231232:12345-0@lo:400:kworker.0 Request processed in 52us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838386.558245:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1788838386.558263:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:0.0:1788838386.558275:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135230336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558302:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135230336:12345-0@lo:400:kworker.0 Request processed in 27us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838386.558308:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:0.0:1788838386.558322:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1788838386.558328:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135230848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558352:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135230848:12345-0@lo:400:kworker.0 Request processed in 25us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838386.558358:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1788838386.558369:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:0.0:1788838386.558374:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135231360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558397:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135231360:12345-0@lo:400:kworker.0 Request processed in 24us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838386.558403:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:0.0:1788838386.558426:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1788838386.558432:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135230464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558460:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875729135230464:12345-0@lo:400:kworker.0 Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838386.558465:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1788838386.558475:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:0.0:1788838386.558481:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135231488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558502:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875729135231488:12345-0@lo:400:kworker.0 Request processed in 21us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838386.558506:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:0.0:1788838386.558539:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875729135230464:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558557:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875729135231488:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558584:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135230336:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558593:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135230848:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558601:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135231360:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.558609:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875729135231232:0@lo:400:kworker.0 00000100:00100000:2.0:1788838386.558823:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135230720 00000100:00100000:2.0:1788838386.558829:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135230720 00000100:00100000:2.0:1788838386.558858:0:26216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135231104 00000100:00100000:2.0:1788838386.558861:0:26216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135231104 00000100:00100000:2.0:1788838386.558894:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:2.0:1788838386.558902:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135230720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838386.558948:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135230720:12345-0@lo:400:kworker.0 Request processed in 47us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838386.558954:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000100:00100000:2.0:1788838386.558966:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775 00000100:00100000:2.0:1788838386.558972:0:26216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135231104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838386.559003:0:26216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135231104:12345-0@lo:400:kworker.0 Request processed in 31us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838386.559008:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00100000:2.0:1788838386.559066:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135230720:0@lo:400:kworker.0 00000100:00100000:1.0:1788838386.559304:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135230592 00000100:00100000:1.0:1788838386.559309:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135230592 00000100:00100000:1.0:1788838386.559339:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135230976 00000100:00100000:1.0:1788838386.559342:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135230976 00000100:00100000:1.0:1788838386.559359:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4309 00000100:00100000:1.0:1788838386.559365:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135230592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838386.559403:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135230592:12345-0@lo:400:kworker.0 Request processed in 38us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838386.559408:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4309 00000100:00100000:1.0:1788838386.559433:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4310 00000100:00100000:1.0:1788838386.559440:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135230976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838386.559468:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50270aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135230976:12345-0@lo:400:kworker.0 Request processed in 29us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838386.559474:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4310 00000100:00080000:1.0:1788838386.559494:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788838386.559498:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788838386.559501:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788838386.559636:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135230976:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.559647:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135230592:0@lo:400:kworker.0 00000100:00100000:0.0:1788838386.559658:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135231104:0@lo:400:kworker.0 00000100:00100000:3.0:1788838386.559755:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135230208 00000100:00100000:3.0:1788838386.559760:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135230208 00000100:00100000:3.0:1788838386.559814:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788838386.559823:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135230208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838386.559862:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3645:x1875729135230208:12345-0@lo:400:kworker.0 Request processed in 41us (2306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838386.559869:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788838386.559988:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff6270bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57943c9a-ca27-46d8-8845-5d2bce640e45:3645:1875729135230208:0@lo:400:kworker.0 00010000:00010000:3.0:1788838386.881258:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838387.776219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838387.776261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838387.776306:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838387.776338:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838387.776363:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116542208 00000100:00100000:3.0:1788838387.776373:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116542208 00000100:00100000:3.0:1788838387.776445:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:3.0:1788838387.776455:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116542208:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1788838387.776529:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116542208:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838387.776537:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:2.0:1788838387.778002:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116542592 00000100:00100000:2.0:1788838387.778016:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116542592 00000100:00100000:2.0:1788838387.778159:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2776 00000100:00100000:2.0:1788838387.778170:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116542592:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838387.778234:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116542592:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 66us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838387.778240:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2776 00000100:00080000:2.0:1788838387.778262:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838387.778622:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116542336 00000100:00100000:0.0:1788838387.778629:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116542336 00000100:00100000:0.0:1788838387.778677:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116542464 00000100:00100000:0.0:1788838387.778680:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116542464 00000100:00100000:0.0:1788838387.778701:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1526 00000100:00100000:0.0:1788838387.778709:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2405:x1875729116542336:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838387.778743:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2405:x1875729116542336:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838387.778749:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1526 00000100:00100000:0.0:1788838387.778764:0:66255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1527 00000100:00100000:0.0:1788838387.778770:0:66255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff503c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116542464:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838387.778828:0:66255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff503c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116542464:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838387.778853:0:66255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1527 00000100:00080000:2.0:1788838387.778970:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838387.778974:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788838387.901500:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838388.628508:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff501aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135231616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838388.628580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838388.628632:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff501aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135231744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788838388.628655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838388.628695:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135231616 00000100:00100000:1.0:1788838388.628703:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135231616 00000100:00100000:1.0:1788838388.628756:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135231744 00000100:00100000:1.0:1788838388.628760:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135231744 00000100:00100000:1.0:1788838388.628784:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4311 00000100:00100000:1.0:1788838388.628792:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135231616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788838388.628868:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00000100:00100000:1.0:1788838388.629373:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501aff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135231616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 580us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838388.629382:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4311 00000100:00100000:1.0:1788838388.629414:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4312 00000100:00100000:1.0:1788838388.629422:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135231744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788838388.629443:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:1.0:1788838388.629475:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135231744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838388.629481:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4312 00000100:00100000:1.0:1788838388.629550:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff501aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135231616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788838388.629584:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff501aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135231744:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788838388.925890:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838389.117166:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788838389.117200:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff502708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135231872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788838389.117307:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838389.117561:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135231872 00000100:00100000:0.0:1788838389.117573:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135231872 00000100:00100000:0.0:1788838389.117664:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:0.0:1788838389.117677:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135231872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788838389.117719:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838389.117778:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135231872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838389.117786:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:0.0:1788838389.117877:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff502708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135231872:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788838389.118504:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788838389.950370:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788838390.141225:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788838390.141256:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135232000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788838390.141354:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838390.141539:0:12691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135232000 00000100:00100000:0.0:1788838390.141550:0:12691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135232000 00000100:00100000:0.0:1788838390.141643:0:12691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:0.0:1788838390.141655:0:12691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135232000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788838390.141692:0:12691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788838390.141759:0:12691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135232000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838390.141767:0:12691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00100000:1.0:1788838390.141886:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135232000:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788838390.141945:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788838390.973116:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788838391.685177:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838391.685185:0:86008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1788838391.685223:0:86008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788838391.685226:0:86008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1788838391.685530:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135232256:0@lo:400:kworker.0 00000100:00100000:3.0:1788838391.685622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838391.685665:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135232768:0@lo:400:kworker.0 00000100:00100000:3.0:1788838391.685691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838391.685709:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135233280:0@lo:400:kworker.0 00000100:00100000:3.0:1788838391.685732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838391.685774:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788838391.685781:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135232384:0@lo:400:kworker.0 00000100:00100000:3.0:1788838391.685827:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838391.685846:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135232896:0@lo:400:kworker.0 00000100:00100000:3.0:1788838391.685886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838391.685906:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135233408:0@lo:400:kworker.0 00000100:00100000:3.0:1788838391.685936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838391.689472:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135232128:0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.689630:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838391.689732:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135232640:0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.689778:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838391.689816:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135233152:0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.689844:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838391.689880:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788838391.689887:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135232512:0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.689914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838391.689941:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135233024:0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.689964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838391.690012:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135232256 00000100:00100000:1.0:1788838391.690022:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135232256 00000100:00100000:1.0:1788838391.690080:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135232768 00000100:00100000:1.0:1788838391.690083:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135232768 00000100:00100000:1.0:1788838391.690096:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135233280 00000100:00100000:1.0:1788838391.690099:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135233280 00000100:00100000:1.0:1788838391.690113:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135232384 00000100:00100000:1.0:1788838391.690116:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135232384 00000100:00100000:1.0:1788838391.690129:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135233408 00000100:00100000:1.0:1788838391.690132:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135233408 00000100:00100000:1.0:1788838391.690143:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135233152 00000100:00100000:1.0:1788838391.690146:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135233152 00000100:00100000:1.0:1788838391.690161:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1788838391.690170:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135232256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.690249:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875729135232256:12345-0@lo:400:kworker.0 Request processed in 79us (4626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838391.690257:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1788838391.691927:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:1.0:1788838391.691944:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135232768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.692034:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875729135232768:12345-0@lo:400:kworker.0 Request processed in 97us (6341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838391.692041:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:1.0:1788838391.692055:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:1.0:1788838391.692063:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135233280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.692095:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875729135233280:12345-0@lo:400:kworker.0 Request processed in 34us (6363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838391.692112:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:1.0:1788838391.692126:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:1.0:1788838391.692133:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135232384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.692167:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135232384:12345-0@lo:400:kworker.0 Request processed in 35us (6340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838391.692173:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:1.0:1788838391.692185:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:1.0:1788838391.692191:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135233408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.692403:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135233408:12345-0@lo:400:kworker.0 Request processed in 212us (6465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838391.692411:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:1.0:1788838391.692425:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:1.0:1788838391.692432:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135233152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.692480:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875729135233152:12345-0@lo:400:kworker.0 Request processed in 48us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838391.692544:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:1.0:1788838391.692586:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135232896 00000100:00100000:1.0:1788838391.692595:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135232896 00000100:00100000:1.0:1788838391.692635:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135232512 00000100:00100000:1.0:1788838391.692639:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135232512 00000100:00100000:1.0:1788838391.692658:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4313 00000100:00100000:1.0:1788838391.692665:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135232896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.692702:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135232896:12345-0@lo:400:kworker.0 Request processed in 38us (6816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838391.692709:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4313 00000100:00100000:1.0:1788838391.692731:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4314 00000100:00100000:1.0:1788838391.692737:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135232512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838391.692783:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875729135232512:12345-0@lo:400:kworker.0 Request processed in 46us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838391.692789:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4314 00000100:00100000:1.0:1788838391.692831:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135232640 00000100:00100000:1.0:1788838391.692835:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135232640 00000100:00100000:1.0:1788838391.692999:0:26218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135233024 00000100:00100000:1.0:1788838391.693003:0:26218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135233024 00000100:00100000:2.0:1788838391.693680:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135232384:0@lo:400:kworker.0 00000100:00100000:2.0:1788838391.693700:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135232896:0@lo:400:kworker.0 00000100:00100000:2.0:1788838391.693713:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135233408:0@lo:400:kworker.0 00000100:00100000:2.0:1788838391.693725:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875729135232256:0@lo:400:kworker.0 00000100:00100000:2.0:1788838391.693737:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875729135232768:0@lo:400:kworker.0 00000100:00100000:2.0:1788838391.693749:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875729135233280:0@lo:400:kworker.0 00000100:00080000:2.0:1788838391.693916:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788838391.693922:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788838391.693925:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838391.695226:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:3.0:1788838391.695249:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135232640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838391.695367:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3644:x1875729135232640:12345-0@lo:400:kworker.0 Request processed in 127us (5587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838391.695375:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00100000:3.0:1788838391.695413:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:3.0:1788838391.695421:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135233024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838391.695454:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135233024:12345-0@lo:400:kworker.0 Request processed in 34us (5489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838391.695472:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:0.0:1788838391.696235:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135232128 00000100:00100000:0.0:1788838391.696250:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135232128 00000100:00100000:0.0:1788838391.696420:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788838391.696431:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135232128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838391.696504:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3644:x1875729135232128:12345-0@lo:400:kworker.0 Request processed in 75us (6875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838391.696523:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788838391.696934:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135232512:0@lo:400:kworker.0 00000100:00100000:0.0:1788838391.696951:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135233024:0@lo:400:kworker.0 00000100:00100000:0.0:1788838391.696962:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57943c9a-ca27-46d8-8845-5d2bce640e45:3644:1875729135232128:0@lo:400:kworker.0 00000100:00100000:0.0:1788838391.696975:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff503c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875729135232640:0@lo:400:kworker.0 00000100:00100000:0.0:1788838391.696989:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875729135233152:0@lo:400:kworker.0 00010000:00010000:1.0:1788838392.008920:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788838392.420916:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838392.422811:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116542720 00000100:00100000:3.0:1788838392.422828:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116542720 00000100:00100000:3.0:1788838392.422924:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2779 00000100:00100000:3.0:1788838392.422939:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116542720:12345-192.168.203.30@tcp:8:ptlrpcd_rcv.0 00010000:02000400:3.0:1788838392.422985:0:8460:0:(ldlm_lib.c:974:target_handle_reconnect()) lustre-OST0000: Client efc561ba-875e-4857-b79b-9bd7023bd57c (at 192.168.203.30@tcp) reconnected, waiting for 3 clients in recovery for 1:25 00010000:00080000:3.0:1788838392.450341:0:8460:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp recovering/t4294969478 exp ffff8ff604961800 cur 3786 last 1788838392 00002000:00100000:3.0:1788838392.454563:0:8460:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli efc561ba-875e-4857-b79b-9bd7023bd57c/ffff8ff604961800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788838392.454605:0:8460:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.203.30@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1788838392.454644:0:8460:0:(import.c:65:import_set_state_nolock()) ffff8ff627f2d800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788838392.454657:0:8460:0:(import.c:65:import_set_state_nolock()) ffff8ff627f2d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788838392.454761:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116542720:12345-192.168.203.30@tcp:8:ptlrpcd_rcv.0 Request processed in 31824us (33860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838392.454773:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2779 00000100:00100000:3.0:1788838392.470161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838392.470249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838392.481234:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1788838392.485256:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116542848 00000100:00100000:2.0:1788838392.485280:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116542848 00000100:00100000:2.0:1788838392.489072:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116542976 00000100:00100000:2.0:1788838392.489089:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116542976 00000100:00100000:2.0:1788838392.489126:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6087 00000100:00100000:2.0:1788838392.489139:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116542848:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788838392.489165:0:26215:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff63333e680 x1875729116542848/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838392.489194:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116542848:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 58us (19049us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838392.489201:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6087 00000100:00100000:2.0:1788838392.489224:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6088 00000100:00100000:2.0:1788838392.489232:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116542976:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788838392.489241:0:26215:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff63333f800 x1875729116542976/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788838392.489251:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116542976:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 22us (19004us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788838392.489256:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6088 00010000:00080000:3.0:1788838392.489846:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838392.489860:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff63333e680 x1875729116542848/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838392.489870:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:3.0:1788838392.489885:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838392.489887:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838392.489892:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff63333f800 x1875729116542976/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838392.489914:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:3.0:1788838392.489921:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788838392.490009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838392.490037:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838392.490062:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116543104 00000100:00100000:3.0:1788838392.490068:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116543104 00000100:00100000:3.0:1788838392.490100:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116543232 00000100:00100000:3.0:1788838392.490103:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116543232 00000100:00100000:3.0:1788838392.490117:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116543360 00000100:00100000:3.0:1788838392.490119:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116543360 00000100:00100000:3.0:1788838392.490137:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6089 00000100:00100000:3.0:1788838392.490144:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116543104:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788838392.490155:0:26213:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff63333c380 x1875729116543104/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838392.490169:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116543104:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 27us (8958us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838392.490176:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6089 00000100:00100000:3.0:1788838392.490184:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6090 00000100:00100000:3.0:1788838392.490190:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff641349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116543232:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788838392.490197:0:26213:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff641349450 x1875729116543232/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838392.490206:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff641349450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116543232:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 17us (198us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838392.490211:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6090 00000100:00100000:3.0:1788838392.490219:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6091 00000100:00100000:3.0:1788838392.490233:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116543360:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788838392.490241:0:26213:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff63333c000 x1875729116543360/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838392.490250:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2403:x1875729116543360:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 20us (214us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838392.490256:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6091 00010000:00080000:3.0:1788838392.490267:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838392.490271:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff63333c380 x1875729116543104/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838392.490278:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:3.0:1788838392.490287:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838392.490289:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838392.490292:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff641349450 x1875729116543232/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838392.490299:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:3.0:1788838392.490303:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838392.490305:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838392.490309:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff63333c000 x1875729116543360/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838392.490316:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:3.0:1788838392.490319:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788838392.490344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838392.490364:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116543488 00000100:00100000:3.0:1788838392.490368:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116543488 00000100:00100000:3.0:1788838392.490400:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6092 00000100:00100000:3.0:1788838392.490407:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116543488:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788838392.490415:0:26214:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff63333df80 x1875729116543488/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838392.490437:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+5:2403:x1875729116543488:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 30us (92us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838392.490443:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6092 00010000:00080000:3.0:1788838392.490454:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838392.490459:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff63333df80 x1875729116543488/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838392.490465:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:3.0:1788838392.490471:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788838392.490494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838392.490520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838392.490538:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116543616 00000100:00100000:3.0:1788838392.490541:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116543616 00000100:00100000:3.0:1788838392.490562:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116543744 00000100:00100000:3.0:1788838392.490565:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116543744 00000100:00100000:3.0:1788838392.490582:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6093 00000100:00100000:3.0:1788838392.490587:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116543616:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788838392.490595:0:26210:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff63333ca80 x1875729116543616/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838392.490607:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116543616:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 21us (114us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838392.490613:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6093 00000100:00100000:3.0:1788838392.490619:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6094 00000100:00100000:3.0:1788838392.490624:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116543744:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788838392.490630:0:26210:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8ff63333fb80 x1875729116543744/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788838392.490644:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:efc561ba-875e-4857-b79b-9bd7023bd57c+6:2403:x1875729116543744:12345-192.168.203.30@tcp:101:ldlm_lock_repla.0 Request processed in 20us (124us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788838392.490650:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6094 00010000:00080000:3.0:1788838392.490666:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838392.490670:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff63333ca80 x1875729116543616/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838392.490677:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:3.0:1788838392.491028:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788838392.491030:0:96981:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788838392.491036:0:96981:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.203.30@tcp: req@ffff8ff63333fb80 x1875729116543744/t0(0) o101->efc561ba-875e-4857-b79b-9bd7023bd57c@192.168.203.30@tcp:293/0 lens 328/0 e 0 to 0 dl 1788838403 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788838392.491043:0:96981:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:3.0:1788838392.491046:0:96981:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000001:02000400:1.0:1788838392.496335:0:97617:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00000100:00100000:1.0:1788838392.901388:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838392.901767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838392.901844:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838392.901874:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1788838392.902034:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116543872 00000100:00100000:3.0:1788838392.902055:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116543872 00000100:00100000:3.0:1788838392.902118:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:3.0:1788838392.902130:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116543872:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838392.902151:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116544128 00000100:00100000:2.0:1788838392.902162:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116544128 00000100:00100000:3.0:1788838392.902207:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2407:x1875729116543872:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838392.902218:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:2.0:1788838392.902495:0:67312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116544000 00000100:00100000:2.0:1788838392.902502:0:67312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116544000 00000100:00100000:2.0:1788838392.902539:0:67312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1534 00000100:00100000:2.0:1788838392.902552:0:67312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116544128:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838392.902669:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1535 00000100:00100000:0.0:1788838392.902682:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2407:x1875729116544000:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:3.0:1788838392.902698:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838392.902768:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116544256 00000100:00100000:1.0:1788838392.902773:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116544256 00000100:00100000:1.0:1788838392.902841:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2780 00000100:00100000:1.0:1788838392.902852:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116544256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:3.0:1788838392.902968:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788838392.902971:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838392.907032:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2407:x1875729116544000:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 4336us (5169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838392.907051:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1535 00000100:00100000:2.0:1788838392.907488:0:67312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff501afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2407:x1875729116544128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 4935us (5725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838392.907499:0:67312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1534 00000100:00100000:1.0:1788838392.910548:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2407:x1875729116544256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 7685us (8659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838392.910565:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2780 00010000:00010000:0.0:1788838393.020964:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838393.725481:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838393.725568:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788838393.725589:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135233664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788838393.725684:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838393.725779:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135233664 00000100:00100000:3.0:1788838393.725790:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135233664 00000100:00100000:3.0:1788838393.725882:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4315 00000100:00100000:3.0:1788838393.725894:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135233664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838393.725940:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00000100:00100000:3.0:1788838393.725994:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875729135233664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838393.726001:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4315 00000100:00100000:3.0:1788838393.726314:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135233664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838393.726413:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135233536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788838393.726454:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838393.726954:0:8472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135233536 00000100:00100000:1.0:1788838393.726962:0:8472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135233536 00000100:00100000:0.0:1788838393.727175:0:8472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4316 00000100:00100000:0.0:1788838393.727184:0:8472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135233536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788838393.727218:0:8472:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:0.0:1788838393.727275:0:8472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502708700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135233536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838393.727283:0:8472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4316 00000100:00100000:1.0:1788838393.727350:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135233536:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788838394.065116:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788838394.238644:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788838394.238673:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135233792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788838394.238769:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838394.239044:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135233792 00000100:00100000:1.0:1788838394.239056:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135233792 00000100:00080000:3.0:1788838394.239260:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788838394.239603:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:1.0:1788838394.239623:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135233792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788838394.239665:0:8465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788838394.239736:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135233792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838394.239745:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:1.0:1788838394.239836:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135233792:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788838394.638687:0:97665:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:3.0:1788838395.073127:0:6535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838395.261726:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838395.261771:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff63333f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135233920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788838395.261897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838395.261995:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135233920 00000100:00100000:3.0:1788838395.262005:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135233920 00000100:00100000:3.0:1788838395.262102:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:3.0:1788838395.262116:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135233920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788838395.262149:0:8464:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788838395.262211:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875729135233920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838395.262219:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:0.0:1788838395.262566:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff63333f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135233920:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788838395.262855:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788838396.093247:0:63563:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788838396.355932:0:97714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00000100:00080000:2.0:1788838396.797548:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838396.797558:0:27607:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1788838396.797579:0:27607:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788838396.797583:0:27607:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1788838396.797649:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135234176:0@lo:400:kworker.0 00000100:00100000:2.0:1788838396.797659:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135234432:0@lo:400:kworker.0 00000100:00100000:3.0:1788838396.797740:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135234048:0@lo:400:kworker.0 00000100:00100000:0.0:1788838396.798093:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135234304:0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.800361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838396.800442:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135234688:0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.800490:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838396.800512:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135235200:0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.800539:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788838396.800606:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135234176 00000100:00100000:1.0:1788838396.800617:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135234176 00000100:00100000:1.0:1788838396.800685:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135234688 00000100:00100000:1.0:1788838396.800689:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135234688 00000100:00100000:1.0:1788838396.800710:0:66253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135235200 00000100:00100000:1.0:1788838396.800713:0:66253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135235200 00000100:00100000:1.0:1788838396.800738:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:1.0:1788838396.800748:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135234176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.800831:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875729135234176:12345-0@lo:400:kworker.0 Request processed in 83us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838396.800838:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:1.0:1788838396.800875:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:1.0:1788838396.800881:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135234688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.800908:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64066ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875729135234688:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838396.800914:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:1.0:1788838396.800923:0:66253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:1.0:1788838396.800929:0:66253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135235200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.800952:0:66253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875729135235200:12345-0@lo:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838396.800958:0:66253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00080000:1.0:1788838396.800974:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788838396.801024:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875729135234176:0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.801034:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875729135234688:0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.801042:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875729135235200:0@lo:400:kworker.0 00000100:00100000:3.0:1788838396.808122:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838396.808205:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135234560:0@lo:400:kworker.0 00000100:00100000:3.0:1788838396.808279:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838396.808311:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135235072:0@lo:400:kworker.0 00000100:00100000:3.0:1788838396.808341:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838396.808421:0:66254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135235072 00000100:00100000:3.0:1788838396.808431:0:66254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135235072 00000100:00100000:3.0:1788838396.808491:0:66254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:3.0:1788838396.808501:0:66254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135235072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838396.808567:0:66254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875729135235072:12345-0@lo:400:kworker.0 Request processed in 67us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838396.808575:0:66254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:3.0:1788838396.808602:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135234560 00000100:00100000:3.0:1788838396.808607:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135234560 00000100:00100000:3.0:1788838396.808636:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781 00000100:00100000:3.0:1788838396.808643:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff63333f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135234560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788838396.808689:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff63333f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3643:x1875729135234560:12345-0@lo:400:kworker.0 Request processed in 47us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838396.808696:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781 00000100:00100000:3.0:1788838396.808749:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875729135234560:0@lo:400:kworker.0 00000100:00100000:3.0:1788838396.808762:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875729135235072:0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.817338:0:94398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135234048 00000100:00100000:1.0:1788838396.817372:0:94398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135234048 00000100:00100000:1.0:1788838396.817480:0:94398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788838396.817493:0:94398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135234048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.817624:0:94398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:57943c9a-ca27-46d8-8845-5d2bce640e45+24:3643:x1875729135234048:12345-0@lo:400:kworker.0 Request processed in 134us (9513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838396.817632:0:94398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788838396.818571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838396.818649:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135234944:0@lo:400:kworker.0 00000100:00100000:2.0:1788838396.818707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788838396.818748:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135234944 00000100:00100000:2.0:1788838396.818755:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135234944 00000100:00100000:2.0:1788838396.818906:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:2.0:1788838396.818918:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135234944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788838396.818974:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3646:x1875729135234944:12345-0@lo:400:kworker.0 Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838396.818982:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000100:00100000:2.0:1788838396.819053:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875729135234944:0@lo:400:kworker.0 00000100:00100000:3.0:1788838396.819207:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57943c9a-ca27-46d8-8845-5d2bce640e45:3643:1875729135234048:0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.820702:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135234432 00000100:00100000:1.0:1788838396.820717:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135234432 00000100:00100000:1.0:1788838396.820842:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4317 00000100:00100000:1.0:1788838396.820854:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff50f38ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135234432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.820970:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff50f38ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3646:x1875729135234432:12345-0@lo:400:kworker.0 Request processed in 119us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838396.820977:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4317 00000100:00080000:1.0:1788838396.821001:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788838396.824668:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838396.824743:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135234816:0@lo:400:kworker.0 00000100:00100000:0.0:1788838396.824830:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838396.824868:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50f38c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135235328:0@lo:400:kworker.0 00000100:00100000:0.0:1788838396.824894:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788838396.824963:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135234816 00000100:00100000:0.0:1788838396.824973:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135234816 00000100:00100000:0.0:1788838396.825032:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4318 00000100:00100000:0.0:1788838396.825042:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135234816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838396.825111:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502708380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875729135234816:12345-0@lo:400:kworker.0 Request processed in 69us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838396.825119:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4318 00000100:00100000:0.0:1788838396.825152:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135234304 00000100:00100000:0.0:1788838396.825156:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135234304 00000100:00100000:0.0:1788838396.825196:0:76060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135235328 00000100:00100000:0.0:1788838396.825199:0:76060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135235328 00000100:00100000:0.0:1788838396.825224:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1788838396.825231:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135234304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838396.825264:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875729135234304:12345-0@lo:400:kworker.0 Request processed in 33us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838396.825270:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1788838396.825282:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:0.0:1788838396.825308:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135235328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788838396.825341:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875729135235328:12345-0@lo:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838396.825362:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00080000:0.0:1788838396.825385:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838396.825425:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875729135234304:0@lo:400:kworker.0 00000100:00100000:0.0:1788838396.825438:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875729135234816:0@lo:400:kworker.0 00000100:00100000:0.0:1788838396.825449:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875729135235328:0@lo:400:kworker.0 00000100:00100000:2.0:1788838396.826490:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50f38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875729135234432:0@lo:400:kworker.0 00000100:00100000:1.0:1788838396.928308:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838396.928372:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838396.928421:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1788838396.928465:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1788838396.928536:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116544768 00000100:00100000:0.0:1788838396.928551:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116544768 00000100:00100000:0.0:1788838396.928643:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2783 00000100:00100000:0.0:1788838396.928655:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64066b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116544768:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1788838396.928752:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64066b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:efc561ba-875e-4857-b79b-9bd7023bd57c+7:2405:x1875729116544768:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 99us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788838396.928761:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2783 00000100:00100000:2.0:1788838396.928855:0:94395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116544384 00000100:00100000:2.0:1788838396.928860:0:94395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116544384 00000100:00100000:2.0:1788838396.928906:0:94395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:2.0:1788838396.928914:0:94395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff632f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116544384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1788838396.928947:0:94395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff632f2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2af93169-6705-472b-b7ff-fd7cc5c04782+10:2405:x1875729116544384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 34us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788838396.928954:0:94395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00080000:1.0:1788838396.929111:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788838396.929304:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116544512 00000100:00100000:3.0:1788838396.929309:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116544512 00000100:00080000:1.0:1788838396.929410:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788838396.929632:0:66255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729116544640 00000100:00100000:3.0:1788838396.929637:0:66255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729116544640 00000100:00080000:1.0:1788838396.929696:0:6542:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788838396.931693:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1542 00000100:00100000:1.0:1788838396.931849:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2405:x1875729116544512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838396.931976:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff640668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+51:2405:x1875729116544512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 266us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838396.931986:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1542 00000100:00100000:1.0:1788838396.932023:0:76060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1543 00000100:00100000:1.0:1788838396.932032:0:76060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64066a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116544640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1788838396.932064:0:76060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64066a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:efc561ba-875e-4857-b79b-9bd7023bd57c+11:2405:x1875729116544640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (3598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838396.932071:0:76060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1543 00010000:00010000:0.0:1788838397.117859:0:15289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788838398.141186:0:6534:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788838398.845709:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788838398.845747:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff50475df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135235456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838398.845902:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838398.846050:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135235456 00000100:00100000:3.0:1788838398.846063:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135235456 00000100:00100000:3.0:1788838398.846152:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4319 00000100:00100000:3.0:1788838398.846164:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff502709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135235456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788838398.846213:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445048320 avail 1298808832 00000100:00100000:1.0:1788838398.846271:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788838398.846279:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff502709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875729135235456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788838398.846281:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ff640669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135235584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788838398.846287:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4319 00000100:00100000:1.0:1788838398.846313:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788838398.846942:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff50475df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875729135235456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788838398.848164:0:37907:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729135235584 00000100:00100000:0.0:1788838398.848175:0:37907:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729135235584 00000100:00100000:3.0:1788838398.851113:0:37907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4320 00000100:00100000:3.0:1788838398.851131:0:37907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ff64066a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135235584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788838398.851185:0:37907:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445433344 avail 1299193856 00000100:00100000:3.0:1788838398.851310:0:37907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ff64066a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875729135235584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 182us (4995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788838398.851318:0:37907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4320 00000100:00100000:1.0:1788838398.854864:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ff640669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875729135235584:0@lo:41:osp-pre-1-0.0 Debug log: 71370 lines, 71370 kept, 0 dropped, 0 bad.